2024-09-19T09:32:13.790 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:32:13.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:32:13.897 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929 branch: squid description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911929' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEqqht7HwGDvmF8S8mlhuFoQ2+5VDN2+/nebqVZXB+7U9+4fzDr/duGTK5HPiEtkSO/i7nLRvJ/mpw5fdH9P6S0= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtBm06JQ0wOzjoP0tPe27Lm+qtGDCLhcB8JSWRYA6PbWzcikkUwGKl7PgaL6C+zM0xFL0NAPcXV7ctnpsoj6fo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T09:32:13.898 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:32:13.898 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:32:13.898 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:32:13.900 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:32:13.919 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:32:13.919 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:32:13.919 INFO:teuthology.packaging:ref: None 2024-09-19T09:32:13.919 INFO:teuthology.packaging:tag: None 2024-09-19T09:32:13.919 INFO:teuthology.packaging:branch: squid 2024-09-19T09:32:13.920 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:32:13.920 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:32:14.169 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:32:14.171 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:32:14.178 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:32:14.178 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:32:14.198 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:32:14.216 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:32:14.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:32:14.247 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:27:25.146133', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEqqht7HwGDvmF8S8mlhuFoQ2+5VDN2+/nebqVZXB+7U9+4fzDr/duGTK5HPiEtkSO/i7nLRvJ/mpw5fdH9P6S0='} 2024-09-19T09:32:14.268 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:27:25.144839', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtBm06JQ0wOzjoP0tPe27Lm+qtGDCLhcB8JSWRYA6PbWzcikkUwGKl7PgaL6C+zM0xFL0NAPcXV7ctnpsoj6fo='} 2024-09-19T09:32:14.268 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:32:14.275 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-19T09:32:14.275 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-19T09:32:14.275 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:32:14.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f110133bf40>, signals=[15]) 2024-09-19T09:32:14.340 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:32:14.347 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:32:14.347 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:32:14.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:32:14.427 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:32:14.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:32:14.502 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:32:14.509 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-09-19T09:32:14.527 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-09-19T09:32:14.527 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:32:14.584 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:32:14.585 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:32:14.585 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:32:14.585 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:32:14.585 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-09-19T09:32:14.609 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-19T09:32:14.629 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-19T09:32:14.629 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-19T09:32:14.687 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-19T09:32:14.687 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-19T09:32:14.687 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:32:14.688 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:32:14.689 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-19T09:32:14.718 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:32:14.727 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:32:14.732 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:32:14.733 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:32:14.735 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:32:14.752 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:32:14.760 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:32:14.761 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:32:14.792 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:32:14.902 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:32:14.956 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:32:14.970 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:32:14.970 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T09:32:14.970 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T09:32:14.971 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:32:14.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:32:14.988 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-09-19T09:32:15.045 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:32:15.046 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.14.0-503.el9.x86_64 2024-09-19T09:32:15.046 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2024-09-19T09:32:17.366 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T09:32:37.106 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-19T09:32:41.407 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T09:32:42.924 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-19T09:32:43.712 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-19T09:32:49.042 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-19T09:32:50.949 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:32:50.949 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:32:51.041 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:32:51.046 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout:Install 4 Packages 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:32:51.047 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 79 M 2024-09-19T09:32:51.048 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 126 M 2024-09-19T09:32:51.048 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-19T09:32:51.285 INFO:teuthology.orchestra.run.smithi123.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 327 kB/s | 36 kB 00:00 2024-09-19T09:32:51.544 INFO:teuthology.orchestra.run.smithi123.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-19T09:32:52.002 INFO:teuthology.orchestra.run.smithi123.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 40 MB/s | 29 MB 00:00 2024-09-19T09:32:52.511 INFO:teuthology.orchestra.run.smithi123.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-19T09:32:52.511 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:32:52.511 INFO:teuthology.orchestra.run.smithi123.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-19T09:32:53.198 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-19T09:32:53.555 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-19T09:32:53.556 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-19T09:32:54.519 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-19T09:32:54.519 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-19T09:32:56.949 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-19T09:32:57.669 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:32:57.753 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:33:00.500 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:33:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:33:05.497 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:33:05.798 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:10.653 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:48.835 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:48.875 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:49.260 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:49.260 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:33:49.260 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:33:49.260 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:33:50.099 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:33:50.100 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-19T09:33:50.465 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:33:50.542 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:33:50.542 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:33:50.543 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:33:50.543 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:33:50.543 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:33:50.543 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:33:50.543 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:33:50.543 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:33:50.601 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:33:50.601 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:33:50.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2024-09-19T09:33:50.633 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2024-09-19T09:33:50.633 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2024-09-19T09:33:50.633 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.06 2024-09-19T09:33:50.633 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 82.el9 2024-09-19T09:33:50.633 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Group : Unspecified 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 8274670 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : builder@centos.org 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2024-09-19T09:33:50.634 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:33:50.635 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:33:50.636 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:33:50.636 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:33:50.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:33:51.343 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-09-19T09:33:52.670 INFO:teuthology.orchestra.run.smithi123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:33:52.697 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-09-19T09:33:52.699 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-09-19T09:33:52.714 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.TBCjTe8dgb 2024-09-19T09:33:52.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TBCjTe8dgb 2024-09-19T09:33:52.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.TBCjTe8dgb 2024-09-19T09:33:52.934 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.TBCjTe8dgb is 6KB 2024-09-19T09:33:52.983 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.TBCjTe8dgb 2024-09-19T09:33:52.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:33:53.064 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:33:53.065 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:33:53.065 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:33:53.065 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:33:53.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:33:53.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-09-19T09:34:23.225 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:34:23.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-19T09:34:23.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:34:41.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-09-19T09:34:50.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-19T09:34:50.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:34:53.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-09-19T09:35:05.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-19T09:35:05.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:35:37.694 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-19T09:35:38.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-19T09:35:38.209 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:35:38.210 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-09-19T09:35:38.253 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:35:38.253 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:35:38.253 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:35:38.253 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:35:39.255 DEBUG:teuthology.parallel:result is None 2024-09-19T09:35:39.255 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:35:39.322 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:35:39.323 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:35:39.326 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:35:39.344 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:35:39.350 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:35:39.356 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:35:39.356 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:35:39.381 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:35:39.505 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:35:39.511 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:35:39.511 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:35:39.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:39.529 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:35:39.531 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:35:39.611 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:39.641 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:39.642 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:39.663 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:39.665 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:35:39.671 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:35:39.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:35:39.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:35:39.701 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:35:39.710 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:35:39.710 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:35:39.739 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:35:39.758 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:39.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:39.885 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:39.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:40.006 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:35:40.006 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:35:40.071 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:40.116 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:40.166 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:40.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:40.294 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:35:40.295 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:35:40.361 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-09-19T09:35:40.363 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-19T09:35:40.407 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:35:40.441 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:35:40.774 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:35:40.789 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:35:40.789 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:35:40.875 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:35:40.883 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:35:40.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-09-19T09:35:40.936 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-09-19T09:35:40.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-19T09:35:40.999 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-19T09:35:41.001 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:35:41.001 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-09-19T09:35:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-09-19T09:35:41.022 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-19T09:35:41.043 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-19T09:35:41.043 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:35:41.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:35:41.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:41.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:35:41.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:41.116 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:35:41.116 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:35:41.159 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:35:41.195 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:35:41.204 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:35:41.215 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:35:41.216 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:39:40.744 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-19T09:39:40.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-19T09:39:40.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:39:40.824 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-19T09:39:40.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-19T09:39:40.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T09:39:40.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:39:40.984 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-19T09:39:41.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T09:39:41.077 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:39:41.090 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:39:41.090 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:39:41.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:39:41.093 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:39:41.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:39:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:39:41.134 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:39:41.146 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:39:41.158 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-09-19T09:39:41.160 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:39:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-09-19T09:39:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:39:41.185 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-19T09:39:41.196 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-19T09:39:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:39:41.210 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:39:41.224 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:39:41.251 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:39:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:39:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-19T09:39:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.255 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.283 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:39:41.288 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:39:41.288 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-19T09:39:41.288 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.288 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.288 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.288 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:41.288 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:39:41.296 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:39:41.297 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:39:41.297 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:39:41.297 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:39:41.302 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:39:41.302 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:39:41.303 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:39:41.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:39:41.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:39:41.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:39:41.459 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:39:41.459 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:39:41.464 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:39:41.464 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:39:41.570 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:39:41.570 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:39:41.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:39:41.581 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:39:41.581 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:39:41.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:39:41.596 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:39:41.596 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:39:41.607 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:39:41.607 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:39:41.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:39:41.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:39:41.736 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:39:41.747 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:39:41.801 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-19T09:39:41.802 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-19T09:39:41.811 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-09-19T09:39:41.812 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-09-19T09:39:42.025 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-19T09:39:42.049 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-09-19T09:39:42.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:39:42.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:39:42.581 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 330 kB/s | 84 kB 00:00 2024-09-19T09:39:42.624 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-19T09:39:42.857 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-19T09:39:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T09:39:43.132 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T09:39:43.175 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:39:43.882 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T09:39:45.542 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-19T09:39:46.108 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-19T09:39:50.068 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-19T09:39:51.519 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-19T09:39:52.298 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-19T09:39:54.857 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-19T09:39:57.754 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T09:39:59.067 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-19T09:39:59.880 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:39:59.881 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:39:59.892 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:39:59.893 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:39:59.894 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:39:59.895 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:39:59.896 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:39:59.899 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:39:59.900 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:39:59.963 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-19T09:39:59.987 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-19T09:39:59.987 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-19T09:39:59.987 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:39:59.988 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:39:59.989 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:39:59.990 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:39:59.991 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:39:59.992 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:39:59.993 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:39:59.994 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:39:59.995 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:39:59.996 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:39:59.997 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:39:59.998 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:39:59.999 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-19T09:40:00.000 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-19T09:40:00.001 INFO:teuthology.orchestra.run.smithi194.stdout:Install 148 Packages 2024-09-19T09:40:00.001 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 8 Packages 2024-09-19T09:40:00.001 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:00.001 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 226 M 2024-09-19T09:40:00.001 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-19T09:40:00.538 INFO:teuthology.orchestra.run.smithi194.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-19T09:40:00.722 INFO:teuthology.orchestra.run.smithi194.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-19T09:40:00.789 INFO:teuthology.orchestra.run.smithi194.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T09:40:00.922 INFO:teuthology.orchestra.run.smithi194.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-19T09:40:00.973 INFO:teuthology.orchestra.run.smithi194.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 2.4 MB 00:00 2024-09-19T09:40:00.984 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-19T09:40:01.048 INFO:teuthology.orchestra.run.smithi194.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-19T09:40:01.331 INFO:teuthology.orchestra.run.smithi194.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-19T09:40:01.690 INFO:teuthology.orchestra.run.smithi194.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 16 MB/s | 21 MB 00:01 2024-09-19T09:40:01.732 INFO:teuthology.orchestra.run.smithi194.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T09:40:02.074 INFO:teuthology.orchestra.run.smithi194.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 16 MB/s | 17 MB 00:01 2024-09-19T09:40:02.105 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-19T09:40:02.191 INFO:teuthology.orchestra.run.smithi194.stdout:(11/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 12 MB/s | 11 MB 00:00 2024-09-19T09:40:02.215 INFO:teuthology.orchestra.run.smithi194.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.6 MB/s | 228 kB 00:00 2024-09-19T09:40:02.241 INFO:teuthology.orchestra.run.smithi194.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 541 kB/s | 27 kB 00:00 2024-09-19T09:40:02.266 INFO:teuthology.orchestra.run.smithi194.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 630 kB/s | 32 kB 00:00 2024-09-19T09:40:02.316 INFO:teuthology.orchestra.run.smithi194.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T09:40:02.342 INFO:teuthology.orchestra.run.smithi194.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T09:40:02.367 INFO:teuthology.orchestra.run.smithi194.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:40:02.417 INFO:teuthology.orchestra.run.smithi194.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T09:40:02.476 INFO:teuthology.orchestra.run.smithi194.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 776 kB/s | 45 kB 00:00 2024-09-19T09:40:02.534 INFO:teuthology.orchestra.run.smithi194.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T09:40:02.635 INFO:teuthology.orchestra.run.smithi194.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-19T09:40:02.660 INFO:teuthology.orchestra.run.smithi194.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.3 MB/s | 161 kB 00:00 2024-09-19T09:40:02.685 INFO:teuthology.orchestra.run.smithi194.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T09:40:02.719 INFO:teuthology.orchestra.run.smithi194.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T09:40:02.744 INFO:teuthology.orchestra.run.smithi194.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T09:40:02.769 INFO:teuthology.orchestra.run.smithi194.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:40:02.828 INFO:teuthology.orchestra.run.smithi194.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T09:40:02.878 INFO:teuthology.orchestra.run.smithi194.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 639 kB/s | 32 kB 00:00 2024-09-19T09:40:02.937 INFO:teuthology.orchestra.run.smithi194.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-19T09:40:02.962 INFO:teuthology.orchestra.run.smithi194.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T09:40:03.346 INFO:teuthology.orchestra.run.smithi194.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 19 MB/s | 7.4 MB 00:00 2024-09-19T09:40:03.396 INFO:teuthology.orchestra.run.smithi194.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.8 MB/s | 3.6 MB 00:00 2024-09-19T09:40:03.421 INFO:teuthology.orchestra.run.smithi194.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.2 MB/s | 249 kB 00:00 2024-09-19T09:40:03.447 INFO:teuthology.orchestra.run.smithi194.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 982 kB/s | 49 kB 00:00 2024-09-19T09:40:03.472 INFO:teuthology.orchestra.run.smithi194.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T09:40:03.497 INFO:teuthology.orchestra.run.smithi194.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T09:40:03.531 INFO:teuthology.orchestra.run.smithi194.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T09:40:03.556 INFO:teuthology.orchestra.run.smithi194.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 310 kB/s | 18 kB 00:00 2024-09-19T09:40:03.706 INFO:teuthology.orchestra.run.smithi194.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 456 kB/s | 80 kB 00:00 2024-09-19T09:40:03.781 INFO:teuthology.orchestra.run.smithi194.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T09:40:03.806 INFO:teuthology.orchestra.run.smithi194.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-19T09:40:03.840 INFO:teuthology.orchestra.run.smithi194.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T09:40:03.916 INFO:teuthology.orchestra.run.smithi194.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-19T09:40:04.349 INFO:teuthology.orchestra.run.smithi194.stdout:(44/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T09:40:04.375 INFO:teuthology.orchestra.run.smithi194.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 199 kB/s | 106 kB 00:00 2024-09-19T09:40:04.400 INFO:teuthology.orchestra.run.smithi194.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 279 kB/s | 135 kB 00:00 2024-09-19T09:40:04.458 INFO:teuthology.orchestra.run.smithi194.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-19T09:40:04.460 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-19T09:40:04.470 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-19T09:40:04.470 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:40:04.474 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:40:04.567 INFO:teuthology.orchestra.run.smithi194.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 575 kB/s | 125 kB 00:00 2024-09-19T09:40:04.571 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-19T09:40:04.596 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:40:04.625 INFO:teuthology.orchestra.run.smithi194.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-19T09:40:04.667 INFO:teuthology.orchestra.run.smithi194.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-19T09:40:04.668 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:40:04.678 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] flex-2.6.4-9.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/flex-2.6.4-9.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:40:04.678 INFO:teuthology.orchestra.run.smithi194.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-19T09:40:04.709 INFO:teuthology.orchestra.run.smithi194.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-19T09:40:04.734 INFO:teuthology.orchestra.run.smithi194.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 639 kB/s | 107 kB 00:00 2024-09-19T09:40:04.751 INFO:teuthology.orchestra.run.smithi194.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 785 kB/s | 33 kB 00:00 2024-09-19T09:40:04.777 INFO:teuthology.orchestra.run.smithi194.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-19T09:40:04.794 INFO:teuthology.orchestra.run.smithi194.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-09-19T09:40:04.811 INFO:teuthology.orchestra.run.smithi194.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-19T09:40:04.836 INFO:teuthology.orchestra.run.smithi194.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-19T09:40:04.853 INFO:teuthology.orchestra.run.smithi194.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T09:40:04.886 INFO:teuthology.orchestra.run.smithi194.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-19T09:40:04.920 INFO:teuthology.orchestra.run.smithi194.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-19T09:40:04.944 INFO:teuthology.orchestra.run.smithi194.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 428 kB/s | 24 kB 00:00 2024-09-19T09:40:04.969 INFO:teuthology.orchestra.run.smithi194.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 973 kB/s | 47 kB 00:00 2024-09-19T09:40:05.003 INFO:teuthology.orchestra.run.smithi194.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T09:40:05.028 INFO:teuthology.orchestra.run.smithi194.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T09:40:05.045 INFO:teuthology.orchestra.run.smithi194.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 921 kB/s | 38 kB 00:00 2024-09-19T09:40:05.087 INFO:teuthology.orchestra.run.smithi194.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-09-19T09:40:05.221 INFO:teuthology.orchestra.run.smithi194.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-19T09:40:05.262 INFO:teuthology.orchestra.run.smithi194.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-09-19T09:40:05.321 INFO:teuthology.orchestra.run.smithi194.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-19T09:40:05.348 INFO:teuthology.orchestra.run.smithi194.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-19T09:40:05.388 INFO:teuthology.orchestra.run.smithi194.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-19T09:40:05.422 INFO:teuthology.orchestra.run.smithi194.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T09:40:05.447 INFO:teuthology.orchestra.run.smithi194.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T09:40:05.489 INFO:teuthology.orchestra.run.smithi194.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:40:05.564 INFO:teuthology.orchestra.run.smithi194.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-19T09:40:05.589 INFO:teuthology.orchestra.run.smithi194.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T09:40:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T09:40:05.640 INFO:teuthology.orchestra.run.smithi194.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-19T09:40:05.665 INFO:teuthology.orchestra.run.smithi194.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T09:40:05.691 INFO:teuthology.orchestra.run.smithi194.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T09:40:05.716 INFO:teuthology.orchestra.run.smithi194.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T09:40:05.816 INFO:teuthology.orchestra.run.smithi194.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T09:40:05.841 INFO:teuthology.orchestra.run.smithi194.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-19T09:40:05.866 INFO:teuthology.orchestra.run.smithi194.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T09:40:05.892 INFO:teuthology.orchestra.run.smithi194.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:40:05.917 INFO:teuthology.orchestra.run.smithi194.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-19T09:40:05.942 INFO:teuthology.orchestra.run.smithi194.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T09:40:05.967 INFO:teuthology.orchestra.run.smithi194.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T09:40:05.993 INFO:teuthology.orchestra.run.smithi194.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-09-19T09:40:06.010 INFO:teuthology.orchestra.run.smithi194.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T09:40:06.035 INFO:teuthology.orchestra.run.smithi194.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-09-19T09:40:06.102 INFO:teuthology.orchestra.run.smithi194.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T09:40:06.127 INFO:teuthology.orchestra.run.smithi194.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-19T09:40:06.161 INFO:teuthology.orchestra.run.smithi194.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-19T09:40:06.186 INFO:teuthology.orchestra.run.smithi194.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T09:40:06.211 INFO:teuthology.orchestra.run.smithi194.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-19T09:40:06.245 INFO:teuthology.orchestra.run.smithi194.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-19T09:40:06.270 INFO:teuthology.orchestra.run.smithi194.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T09:40:06.295 INFO:teuthology.orchestra.run.smithi194.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T09:40:06.320 INFO:teuthology.orchestra.run.smithi194.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T09:40:06.346 INFO:teuthology.orchestra.run.smithi194.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:40:06.371 INFO:teuthology.orchestra.run.smithi194.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T09:40:06.396 INFO:teuthology.orchestra.run.smithi194.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-09-19T09:40:06.447 INFO:teuthology.orchestra.run.smithi194.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-09-19T09:40:06.489 INFO:teuthology.orchestra.run.smithi194.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-19T09:40:06.514 INFO:teuthology.orchestra.run.smithi194.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 837 kB/s | 19 kB 00:00 2024-09-19T09:40:06.548 INFO:teuthology.orchestra.run.smithi194.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-19T09:40:06.573 INFO:teuthology.orchestra.run.smithi194.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:40:06.598 INFO:teuthology.orchestra.run.smithi194.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:40:06.623 INFO:teuthology.orchestra.run.smithi194.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:40:06.640 INFO:teuthology.orchestra.run.smithi194.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 8.9 MB/s | 151 kB 00:00 2024-09-19T09:40:06.693 INFO:teuthology.orchestra.run.smithi194.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T09:40:06.849 INFO:teuthology.orchestra.run.smithi194.stdout:(113/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-19T09:40:06.891 INFO:teuthology.orchestra.run.smithi194.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-19T09:40:06.916 INFO:teuthology.orchestra.run.smithi194.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-19T09:40:06.942 INFO:teuthology.orchestra.run.smithi194.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-09-19T09:40:06.967 INFO:teuthology.orchestra.run.smithi194.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T09:40:07.001 INFO:teuthology.orchestra.run.smithi194.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T09:40:07.034 INFO:teuthology.orchestra.run.smithi194.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T09:40:07.068 INFO:teuthology.orchestra.run.smithi194.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T09:40:07.093 INFO:teuthology.orchestra.run.smithi194.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T09:40:07.202 INFO:teuthology.orchestra.run.smithi194.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-19T09:40:07.219 INFO:teuthology.orchestra.run.smithi194.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-19T09:40:07.244 INFO:teuthology.orchestra.run.smithi194.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 960 kB/s | 144 kB 00:00 2024-09-19T09:40:07.269 INFO:teuthology.orchestra.run.smithi194.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-19T09:40:07.286 INFO:teuthology.orchestra.run.smithi194.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-19T09:40:07.303 INFO:teuthology.orchestra.run.smithi194.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-09-19T09:40:07.320 INFO:teuthology.orchestra.run.smithi194.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-09-19T09:40:07.337 INFO:teuthology.orchestra.run.smithi194.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T09:40:07.362 INFO:teuthology.orchestra.run.smithi194.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:40:07.388 INFO:teuthology.orchestra.run.smithi194.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:40:07.421 INFO:teuthology.orchestra.run.smithi194.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-19T09:40:07.446 INFO:teuthology.orchestra.run.smithi194.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-19T09:40:07.471 INFO:teuthology.orchestra.run.smithi194.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T09:40:07.497 INFO:teuthology.orchestra.run.smithi194.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T09:40:07.522 INFO:teuthology.orchestra.run.smithi194.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T09:40:07.547 INFO:teuthology.orchestra.run.smithi194.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-19T09:40:07.581 INFO:teuthology.orchestra.run.smithi194.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-19T09:40:07.606 INFO:teuthology.orchestra.run.smithi194.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-19T09:40:07.631 INFO:teuthology.orchestra.run.smithi194.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T09:40:07.657 INFO:teuthology.orchestra.run.smithi194.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T09:40:07.669 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-09-19T09:40:07.682 INFO:teuthology.orchestra.run.smithi194.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:40:07.724 INFO:teuthology.orchestra.run.smithi194.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-19T09:40:07.749 INFO:teuthology.orchestra.run.smithi194.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T09:40:07.774 INFO:teuthology.orchestra.run.smithi194.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T09:40:07.800 INFO:teuthology.orchestra.run.smithi194.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:40:07.833 INFO:teuthology.orchestra.run.smithi194.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T09:40:07.892 INFO:teuthology.orchestra.run.smithi194.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T09:40:08.109 INFO:teuthology.orchestra.run.smithi194.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T09:40:08.184 INFO:teuthology.orchestra.run.smithi194.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-19T09:40:08.251 INFO:teuthology.orchestra.run.smithi194.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 6.5 MB/s | 2.3 MB 00:00 2024-09-19T09:40:08.310 INFO:teuthology.orchestra.run.smithi194.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T09:40:08.335 INFO:teuthology.orchestra.run.smithi194.stdout:(153/156): NetworkManager-team-1.51.0-1.el9.x86 272 kB/s | 41 kB 00:00 2024-09-19T09:40:08.393 INFO:teuthology.orchestra.run.smithi194.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-19T09:40:08.435 INFO:teuthology.orchestra.run.smithi194.stdout:(155/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.5 MB/s | 1.8 MB 00:00 2024-09-19T09:40:08.560 INFO:teuthology.orchestra.run.smithi194.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-19T09:40:08.566 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:40:08.566 INFO:teuthology.orchestra.run.smithi194.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-19T09:40:09.794 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-19T09:40:09.942 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:09.942 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:09.944 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-19T09:40:09.944 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-19T09:40:09.957 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:40:09.958 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:40:09.959 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:40:09.960 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:40:09.962 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:40:09.965 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:40:09.966 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:40:10.032 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-19T09:40:10.053 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-19T09:40:10.053 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-09-19T09:40:10.053 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-19T09:40:10.053 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:40:10.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:40:10.055 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:40:10.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:40:10.057 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:40:10.058 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:40:10.059 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:40:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:40:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:40:10.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:40:10.063 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:40:10.064 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:40:10.065 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:40:10.066 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout:Install 148 Packages 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 8 Packages 2024-09-19T09:40:10.067 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:40:10.068 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 226 M 2024-09-19T09:40:10.068 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-19T09:40:10.379 INFO:teuthology.orchestra.run.smithi123.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 34 kB/s | 6.6 kB 00:00 2024-09-19T09:40:10.771 INFO:teuthology.orchestra.run.smithi123.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.2 MB/s | 896 kB 00:00 2024-09-19T09:40:10.863 INFO:teuthology.orchestra.run.smithi123.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T09:40:11.455 INFO:teuthology.orchestra.run.smithi123.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.0 MB/s | 2.4 MB 00:00 2024-09-19T09:40:11.748 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-19T09:40:11.748 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-19T09:40:11.855 INFO:teuthology.orchestra.run.smithi123.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.8 MB/s | 1.5 MB 00:00 2024-09-19T09:40:12.805 INFO:teuthology.orchestra.run.smithi123.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.0 MB/s | 4.7 MB 00:00 2024-09-19T09:40:13.172 INFO:teuthology.orchestra.run.smithi123.stdout:(7/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 1.8 MB/s | 5.4 MB 00:02 2024-09-19T09:40:15.439 INFO:teuthology.orchestra.run.smithi123.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 6.4 MB/s | 17 MB 00:02 2024-09-19T09:40:15.631 INFO:teuthology.orchestra.run.smithi123.stdout:(9/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.9 MB/s | 21 MB 00:05 2024-09-19T09:40:15.656 INFO:teuthology.orchestra.run.smithi123.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 116 kB/s | 25 kB 00:00 2024-09-19T09:40:15.723 INFO:teuthology.orchestra.run.smithi123.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T09:40:15.773 INFO:teuthology.orchestra.run.smithi123.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 543 kB/s | 27 kB 00:00 2024-09-19T09:40:15.840 INFO:teuthology.orchestra.run.smithi123.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 475 kB/s | 32 kB 00:00 2024-09-19T09:40:15.957 INFO:teuthology.orchestra.run.smithi123.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-19T09:40:16.007 INFO:teuthology.orchestra.run.smithi123.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T09:40:16.075 INFO:teuthology.orchestra.run.smithi123.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T09:40:16.191 INFO:teuthology.orchestra.run.smithi123.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.2 MB/s | 506 kB 00:00 2024-09-19T09:40:16.658 INFO:teuthology.orchestra.run.smithi123.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 3.0 MB/s | 11 MB 00:03 2024-09-19T09:40:16.725 INFO:teuthology.orchestra.run.smithi123.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 680 kB/s | 45 kB 00:00 2024-09-19T09:40:16.792 INFO:teuthology.orchestra.run.smithi123.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T09:40:16.867 INFO:teuthology.orchestra.run.smithi123.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T09:40:16.951 INFO:teuthology.orchestra.run.smithi123.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 7.0 MB/s | 5.3 MB 00:00 2024-09-19T09:40:17.018 INFO:teuthology.orchestra.run.smithi123.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.1 MB/s | 320 kB 00:00 2024-09-19T09:40:17.043 INFO:teuthology.orchestra.run.smithi123.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.2 MB/s | 300 kB 00:00 2024-09-19T09:40:17.077 INFO:teuthology.orchestra.run.smithi123.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T09:40:17.111 INFO:teuthology.orchestra.run.smithi123.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T09:40:17.178 INFO:teuthology.orchestra.run.smithi123.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T09:40:17.245 INFO:teuthology.orchestra.run.smithi123.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 476 kB/s | 32 kB 00:00 2024-09-19T09:40:17.320 INFO:teuthology.orchestra.run.smithi123.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T09:40:17.813 INFO:teuthology.orchestra.run.smithi123.stdout:(30/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.3 MB/s | 3.6 MB 00:00 2024-09-19T09:40:17.879 INFO:teuthology.orchestra.run.smithi123.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 3.9 MB/s | 3.1 MB 00:00 2024-09-19T09:40:17.963 INFO:teuthology.orchestra.run.smithi123.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T09:40:18.013 INFO:teuthology.orchestra.run.smithi123.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 992 kB/s | 49 kB 00:00 2024-09-19T09:40:18.056 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-19T09:40:18.063 INFO:teuthology.orchestra.run.smithi123.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T09:40:18.130 INFO:teuthology.orchestra.run.smithi123.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T09:40:18.155 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:40:18.194 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:40:18.255 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:40:18.280 INFO:teuthology.orchestra.run.smithi123.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T09:40:18.289 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:40:18.315 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:40:18.331 INFO:teuthology.orchestra.run.smithi123.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T09:40:18.366 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:40:18.440 INFO:teuthology.orchestra.run.smithi123.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-19T09:40:18.473 INFO:teuthology.orchestra.run.smithi123.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-19T09:40:18.573 INFO:teuthology.orchestra.run.smithi123.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-19T09:40:18.615 INFO:teuthology.orchestra.run.smithi123.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-19T09:40:18.666 INFO:teuthology.orchestra.run.smithi123.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-19T09:40:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:40:18.716 INFO:teuthology.orchestra.run.smithi123.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-19T09:40:18.741 INFO:teuthology.orchestra.run.smithi123.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T09:40:18.784 INFO:teuthology.orchestra.run.smithi123.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T09:40:18.791 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:18.817 INFO:teuthology.orchestra.run.smithi123.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T09:40:18.842 INFO:teuthology.orchestra.run.smithi123.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-19T09:40:18.913 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:18.942 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:19.009 INFO:teuthology.orchestra.run.smithi123.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-19T09:40:19.016 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:19.043 INFO:teuthology.orchestra.run.smithi123.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-19T09:40:19.046 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:40:19.084 INFO:teuthology.orchestra.run.smithi123.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-19T09:40:19.110 INFO:teuthology.orchestra.run.smithi123.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-19T09:40:19.152 INFO:teuthology.orchestra.run.smithi123.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-19T09:40:19.169 INFO:teuthology.orchestra.run.smithi123.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-19T09:40:19.202 INFO:teuthology.orchestra.run.smithi123.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 546 kB/s | 18 kB 00:00 2024-09-19T09:40:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:40:19.236 INFO:teuthology.orchestra.run.smithi123.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-09-19T09:40:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:40:19.295 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:19.328 INFO:teuthology.orchestra.run.smithi123.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T09:40:19.370 INFO:teuthology.orchestra.run.smithi123.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T09:40:19.400 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:19.484 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:19.506 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:19.536 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:19.579 INFO:teuthology.orchestra.run.smithi123.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-19T09:40:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:19.762 INFO:teuthology.orchestra.run.smithi123.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T09:40:19.804 INFO:teuthology.orchestra.run.smithi123.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 589 kB/s | 24 kB 00:00 2024-09-19T09:40:19.846 INFO:teuthology.orchestra.run.smithi123.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T09:40:19.878 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:19.913 INFO:teuthology.orchestra.run.smithi123.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-19T09:40:19.989 INFO:teuthology.orchestra.run.smithi123.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-19T09:40:20.012 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:40:20.013 INFO:teuthology.orchestra.run.smithi123.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-19T09:40:20.039 INFO:teuthology.orchestra.run.smithi123.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-19T09:40:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:20.206 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:20.423 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:20.537 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:40:20.629 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:40:20.660 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:40:20.703 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:40:20.767 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:40:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:40:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:40:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:40:20.920 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:40:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:40:21.016 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:40:21.069 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:40:21.101 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:40:21.136 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:40:21.147 INFO:teuthology.orchestra.run.smithi123.stdout:(66/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 8.8 MB/s | 49 MB 00:05 2024-09-19T09:40:21.211 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:40:21.223 INFO:teuthology.orchestra.run.smithi123.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-19T09:40:21.247 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:40:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:40:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:40:21.389 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:40:21.445 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:40:21.498 INFO:teuthology.orchestra.run.smithi123.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-19T09:40:21.557 INFO:teuthology.orchestra.run.smithi123.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-19T09:40:21.599 INFO:teuthology.orchestra.run.smithi123.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-09-19T09:40:21.600 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:40:21.624 INFO:teuthology.orchestra.run.smithi123.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T09:40:21.682 INFO:teuthology.orchestra.run.smithi123.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T09:40:21.901 INFO:teuthology.orchestra.run.smithi123.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-19T09:40:21.941 INFO:teuthology.orchestra.run.smithi123.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:40:21.970 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:40:22.030 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:40:22.033 INFO:teuthology.orchestra.run.smithi123.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-19T09:40:22.133 INFO:teuthology.orchestra.run.smithi123.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-19T09:40:22.175 INFO:teuthology.orchestra.run.smithi123.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-19T09:40:22.217 INFO:teuthology.orchestra.run.smithi123.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T09:40:22.293 INFO:teuthology.orchestra.run.smithi123.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T09:40:22.334 INFO:teuthology.orchestra.run.smithi123.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-09-19T09:40:22.543 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:40:22.624 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:40:22.655 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:40:22.689 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:40:22.727 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:40:22.769 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:40:22.925 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:40:22.980 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:40:23.034 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:40:23.035 INFO:teuthology.orchestra.run.smithi123.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 5.1 MB 00:00 2024-09-19T09:40:23.077 INFO:teuthology.orchestra.run.smithi123.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-19T09:40:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:40:23.127 INFO:teuthology.orchestra.run.smithi123.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T09:40:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:40:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:40:23.169 INFO:teuthology.orchestra.run.smithi123.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-19T09:40:23.203 INFO:teuthology.orchestra.run.smithi123.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-19T09:40:23.213 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:40:23.245 INFO:teuthology.orchestra.run.smithi123.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-19T09:40:23.249 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:40:23.286 INFO:teuthology.orchestra.run.smithi123.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-19T09:40:23.292 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:40:23.364 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:40:23.370 INFO:teuthology.orchestra.run.smithi123.stdout:(88/156): postgresql-server-13.16-1.el9.x86_64. 3.2 MB/s | 5.8 MB 00:01 2024-09-19T09:40:23.395 INFO:teuthology.orchestra.run.smithi123.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-19T09:40:23.412 INFO:teuthology.orchestra.run.smithi123.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T09:40:23.429 INFO:teuthology.orchestra.run.smithi123.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T09:40:23.463 INFO:teuthology.orchestra.run.smithi123.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T09:40:23.497 INFO:teuthology.orchestra.run.smithi123.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T09:40:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:40:23.547 INFO:teuthology.orchestra.run.smithi123.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T09:40:23.631 INFO:teuthology.orchestra.run.smithi123.stdout:(95/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-19T09:40:23.656 INFO:teuthology.orchestra.run.smithi123.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 330 kB/s | 36 kB 00:00 2024-09-19T09:40:23.681 INFO:teuthology.orchestra.run.smithi123.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T09:40:23.723 INFO:teuthology.orchestra.run.smithi123.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T09:40:23.764 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:40:23.765 INFO:teuthology.orchestra.run.smithi123.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 2.2 MB/s | 96 kB 00:00 2024-09-19T09:40:23.798 INFO:teuthology.orchestra.run.smithi123.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-19T09:40:23.824 INFO:teuthology.orchestra.run.smithi123.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T09:40:23.845 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:40:23.849 INFO:teuthology.orchestra.run.smithi123.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-19T09:40:23.955 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:40:23.994 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:40:24.038 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:40:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:40:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:40:24.133 INFO:teuthology.orchestra.run.smithi123.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-19T09:40:24.165 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:40:24.183 INFO:teuthology.orchestra.run.smithi123.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:40:24.216 INFO:teuthology.orchestra.run.smithi123.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T09:40:24.242 INFO:teuthology.orchestra.run.smithi123.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-19T09:40:24.292 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:40:24.332 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:40:24.360 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:40:24.391 INFO:teuthology.orchestra.run.smithi123.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-09-19T09:40:24.394 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:40:24.417 INFO:teuthology.orchestra.run.smithi123.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 997 kB/s | 26 kB 00:00 2024-09-19T09:40:24.432 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:40:24.442 INFO:teuthology.orchestra.run.smithi123.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:40:24.464 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:40:24.468 INFO:teuthology.orchestra.run.smithi123.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:40:24.493 INFO:teuthology.orchestra.run.smithi123.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T09:40:24.494 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:40:24.530 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:40:24.535 INFO:teuthology.orchestra.run.smithi123.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T09:40:24.562 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:40:24.569 INFO:teuthology.orchestra.run.smithi123.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T09:40:24.594 INFO:teuthology.orchestra.run.smithi123.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:40:24.604 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:40:24.619 INFO:teuthology.orchestra.run.smithi123.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:40:24.638 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:40:24.645 INFO:teuthology.orchestra.run.smithi123.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-09-19T09:40:24.670 INFO:teuthology.orchestra.run.smithi123.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T09:40:24.704 INFO:teuthology.orchestra.run.smithi123.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-19T09:40:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:40:24.737 INFO:teuthology.orchestra.run.smithi123.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T09:40:24.765 INFO:teuthology.orchestra.run.smithi123.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T09:40:24.768 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:40:24.800 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:40:24.829 INFO:teuthology.orchestra.run.smithi123.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-19T09:40:24.855 INFO:teuthology.orchestra.run.smithi123.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 859 kB/s | 863 kB 00:01 2024-09-19T09:40:24.888 INFO:teuthology.orchestra.run.smithi123.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-19T09:40:24.902 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:40:24.913 INFO:teuthology.orchestra.run.smithi123.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 760 kB/s | 18 kB 00:00 2024-09-19T09:40:24.939 INFO:teuthology.orchestra.run.smithi123.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 127 kB/s | 11 kB 00:00 2024-09-19T09:40:24.959 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:40:24.964 INFO:teuthology.orchestra.run.smithi123.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T09:40:24.989 INFO:teuthology.orchestra.run.smithi123.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T09:40:25.015 INFO:teuthology.orchestra.run.smithi123.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-19T09:40:25.040 INFO:teuthology.orchestra.run.smithi123.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:40:25.065 INFO:teuthology.orchestra.run.smithi123.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:40:25.090 INFO:teuthology.orchestra.run.smithi123.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:40:25.124 INFO:teuthology.orchestra.run.smithi123.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-19T09:40:25.149 INFO:teuthology.orchestra.run.smithi123.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-19T09:40:25.166 INFO:teuthology.orchestra.run.smithi123.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 391 kB/s | 16 kB 00:00 2024-09-19T09:40:25.183 INFO:teuthology.orchestra.run.smithi123.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-19T09:40:25.209 INFO:teuthology.orchestra.run.smithi123.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T09:40:25.234 INFO:teuthology.orchestra.run.smithi123.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-19T09:40:25.259 INFO:teuthology.orchestra.run.smithi123.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-19T09:40:25.284 INFO:teuthology.orchestra.run.smithi123.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T09:40:25.310 INFO:teuthology.orchestra.run.smithi123.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T09:40:25.335 INFO:teuthology.orchestra.run.smithi123.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:40:25.369 INFO:teuthology.orchestra.run.smithi123.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-19T09:40:25.403 INFO:teuthology.orchestra.run.smithi123.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-19T09:40:25.428 INFO:teuthology.orchestra.run.smithi123.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-19T09:40:25.453 INFO:teuthology.orchestra.run.smithi123.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T09:40:25.487 INFO:teuthology.orchestra.run.smithi123.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T09:40:25.554 INFO:teuthology.orchestra.run.smithi123.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:40:25.674 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:40:25.714 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:40:25.748 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:40:25.812 INFO:teuthology.orchestra.run.smithi123.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T09:40:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:40:25.895 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:40:25.947 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:40:25.963 INFO:teuthology.orchestra.run.smithi123.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-09-19T09:40:26.026 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:40:26.067 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:40:26.079 INFO:teuthology.orchestra.run.smithi123.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.0 MB/s | 3.2 MB 00:00 2024-09-19T09:40:26.121 INFO:teuthology.orchestra.run.smithi123.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-09-19T09:40:26.147 INFO:teuthology.orchestra.run.smithi123.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 612 kB/s | 41 kB 00:00 2024-09-19T09:40:26.213 INFO:teuthology.orchestra.run.smithi123.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-19T09:40:26.252 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:40:26.255 INFO:teuthology.orchestra.run.smithi123.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2024-09-19T09:40:26.281 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:40:26.347 INFO:teuthology.orchestra.run.smithi123.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-19T09:40:26.358 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:40:26.999 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:40:27.105 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:40:28.324 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:40:28.411 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:40:28.438 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:40:28.472 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:40:28.755 INFO:teuthology.orchestra.run.smithi123.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-19T09:40:28.759 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:40:28.760 INFO:teuthology.orchestra.run.smithi123.stdout:Total 12 MB/s | 226 MB 00:18 2024-09-19T09:40:28.783 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:40:28.818 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:28.908 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:28.939 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:40:28.976 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:40:29.457 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:40:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:40:29.947 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-19T09:40:30.099 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-19T09:40:30.099 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-19T09:40:31.811 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:31.843 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:32.304 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-19T09:40:32.305 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-19T09:40:32.386 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:32.422 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:32.514 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:32.514 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:40:32.514 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:40:32.515 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:32.548 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:40:38.654 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-19T09:40:38.742 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:40:38.783 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:40:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:40:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:40:38.909 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:40:38.967 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:40:39.296 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:40:39.411 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:39.532 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:39.562 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:39.653 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:39.692 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:40:39.880 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:40:39.946 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:40:39.974 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:40.078 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:40.116 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:40.180 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:40.209 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:40.228 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:40.429 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:40.643 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:40.791 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:40:40.901 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:40.984 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:41.206 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:41.316 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:40:41.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:40:41.459 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:40:41.507 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:40:41.572 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:40:41.616 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:40:41.649 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:40:41.692 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:40:41.767 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:40:41.784 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:40:41.853 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:40:41.907 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:40:41.939 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:40:41.981 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:40:42.057 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:40:42.093 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:40:42.136 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:40:42.165 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:40:42.234 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:40:42.287 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:40:42.361 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:40:42.494 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:40:42.548 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:40:43.063 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:40:43.152 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:40:43.181 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:40:43.233 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:40:43.270 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:40:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:40:43.480 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:40:43.548 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:40:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:40:43.683 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:40:43.716 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:40:43.751 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:40:43.798 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:40:43.843 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:40:43.886 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:40:43.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:40:44.071 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:40:44.113 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:40:44.154 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-19T09:40:44.165 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:44.265 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:40:44.297 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:40:44.340 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:40:44.360 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:40:44.360 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:44.360 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:40:44.360 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:44.439 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:40:44.587 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:40:44.612 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:40:44.720 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:40:44.850 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:40:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:40:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:40:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:40:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:40:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:40:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:40:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:40:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:40:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:40:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:40:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:40:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:40:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:40:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:40:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:40:45.844 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:46.094 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:40:46.118 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:40:46.118 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:46.118 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:40:46.118 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:40:46.118 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:40:46.119 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:40:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:40:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:40:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:40:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:40:46.513 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:40:46.553 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:40:46.577 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:40:46.577 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:46.577 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:46.599 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:40:46.640 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:40:46.691 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:40:46.740 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:40:46.794 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:40:46.826 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:40:46.854 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:40:46.940 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:40:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:40:47.037 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:40:47.106 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:40:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:40:47.327 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:40:47.370 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:40:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:40:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:40:47.583 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:40:47.693 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:40:47.842 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:40:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:40:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:40:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:40:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:40:48.964 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:40:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:40:49.061 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:40:49.241 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:40:49.396 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:40:49.437 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:40:49.738 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:40:49.783 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:49.873 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:40:49.941 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:40:50.016 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:40:50.044 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:40:50.148 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:40:50.308 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:40:50.338 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:40:50.363 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:40:50.363 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:50.363 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:40:50.363 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:40:50.363 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:40:50.364 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:50.414 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:40:50.420 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:40:50.426 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:40:50.460 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:50.522 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:40:50.532 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:50.562 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:40:50.570 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:40:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:40:51.524 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:40:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:40:51.549 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:51.549 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:40:51.549 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:40:51.549 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:40:51.549 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:51.592 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:40:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:40:51.615 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:51.615 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:40:51.615 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:40:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:51.993 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:40:52.017 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:40:52.017 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:40:52.017 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:40:52.017 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:40:52.017 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:40:52.017 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:40:52.909 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:53.495 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:53.528 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:53.624 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:53.624 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:40:53.625 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:40:53.625 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:40:53.662 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:40:56.546 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:40:56.587 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:40:56.628 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:40:56.669 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:40:56.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:40:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:40:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:40:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:40:56.977 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:40:57.032 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:40:57.661 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:40:57.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:40:57.716 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:40:58.552 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:40:58.641 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:40:58.683 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:40:58.764 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:40:58.794 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:40:58.820 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:40:58.846 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:40:58.846 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:40:58.938 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:40:58.938 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:40:59.022 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:40:59.047 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:40:59.053 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:40:59.053 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:40:59.232 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:40:59.232 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:40:59.316 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:40:59.379 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:04.782 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:04.782 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:41:04.782 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:41:04.783 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:41:04.784 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:41:04.785 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:41:04.786 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:41:04.787 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:41:04.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:41:04.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:41:04.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:41:04.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:41:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:41:04.793 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:41:04.794 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:41:04.795 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:41:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-09-19T09:41:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:05.572 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:05.587 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:05.588 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:05.588 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:41:05.588 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:07.050 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:07.077 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:07.077 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.077 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:41:07.077 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:07.077 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:07.077 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:07.301 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:07.324 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:07.324 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.324 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:41:07.324 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:07.325 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:07.325 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:07.552 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:07.553 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.554 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.555 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:41:07.556 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:41:07.557 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:41:07.558 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.559 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:41:07.560 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:07.561 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:41:07.562 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:41:07.563 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:41:07.564 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:41:07.565 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:41:07.565 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:41:07.565 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:41:07.565 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:07.565 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-19T09:41:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:07.783 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.783 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:41:07.783 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:07.783 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:07.881 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:41:07.929 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:41:07.979 DEBUG:teuthology.parallel:result is None 2024-09-19T09:41:07.985 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:41:08.169 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:41:08.218 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:41:08.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:41:08.375 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:41:08.515 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:41:08.568 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:41:08.600 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:41:08.628 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:41:09.099 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:09.127 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:09.158 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:41:09.220 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:41:09.249 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:10.300 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:10.335 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:11.295 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:11.327 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:11.430 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:11.599 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:41:11.628 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:11.652 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:11.652 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:41:11.652 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:11.652 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:11.707 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:11.806 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:41:11.863 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:41:12.781 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:41:12.815 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:12.838 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:12.839 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:12.839 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:41:12.839 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:12.839 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:12.839 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:12.882 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:12.905 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:12.905 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:12.905 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:41:12.905 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:12.958 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:12.981 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:12.981 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:12.981 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:41:12.981 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:12.981 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:12.981 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:13.284 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:13.306 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:13.306 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:13.306 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:41:13.307 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:13.307 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:13.307 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:17.896 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:41:17.937 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:41:17.977 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:41:18.010 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:41:18.028 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:41:18.222 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:41:18.266 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:41:18.297 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:41:18.327 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:41:18.381 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:41:18.942 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:18.978 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:18.998 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:19.821 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:41:19.924 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:41:19.975 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:41:20.073 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:41:20.102 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:41:20.127 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:41:20.182 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:41:20.182 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:20.271 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:20.271 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:20.355 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:20.380 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:41:20.385 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:20.385 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:20.565 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:20.565 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:20.705 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:26.303 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:41:26.304 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:41:26.305 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:41:26.306 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:41:26.307 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:41:26.308 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:41:26.309 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:41:26.310 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:41:26.311 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:41:26.312 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:41:26.313 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:41:26.314 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:41:26.315 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:41:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:28.976 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.977 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.978 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:41:28.979 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:41:28.980 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:41:28.981 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:41:28.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:41:28.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:41:28.984 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:41:28.985 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.986 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:41:28.987 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:41:28.988 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:41:28.989 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:41:28.989 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:28.989 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-19T09:41:29.408 DEBUG:teuthology.parallel:result is None 2024-09-19T09:41:29.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:29.558 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:41:29.580 INFO:teuthology.orchestra.run.smithi123.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:41:29.581 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:41:29.581 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:41:29.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:29.739 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:41:29.766 INFO:teuthology.orchestra.run.smithi194.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:41:29.766 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:41:29.766 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:41:29.768 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:41:29.768 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:29.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:41:29.796 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:29.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:41:29.838 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:41:29.839 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:29.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:41:29.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:41:29.929 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:29.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:41:29.957 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:41:30.024 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:41:30.025 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:30.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:41:30.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:41:30.114 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:30.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:41:30.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:41:30.207 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:41:30.207 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:30.207 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:41:30.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:41:30.297 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:30.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:41:30.323 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:41:30.388 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T09:41:30.475 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T09:41:30.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-09-19T09:41:30.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-19T09:41:30.503 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T09:41:30.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T09:41:30.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T09:41:30.568 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T09:41:30.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T09:41:30.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T09:41:30.640 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-19T09:41:30.640 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-19T09:41:30.640 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-19T09:41:30.640 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:30.640 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T09:41:30.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T09:41:30.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T09:41:30.824 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:30.825 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T09:41:30.840 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T09:41:30.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T09:41:30.982 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T09:41:30.982 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T09:41:30.982 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929', 'branch': 'squid', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7911929', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1747, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'sleep_before_teardown': 0, 'subset': '176/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEqqht7HwGDvmF8S8mlhuFoQ2+5VDN2+/nebqVZXB+7U9+4fzDr/duGTK5HPiEtkSO/i7nLRvJ/mpw5fdH9P6S0=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEtBm06JQ0wOzjoP0tPe27Lm+qtGDCLhcB8JSWRYA6PbWzcikkUwGKl7PgaL6C+zM0xFL0NAPcXV7ctnpsoj6fo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T09:41:30.983 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T09:41:30.985 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T09:41:31.031 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T09:41:31.041 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T09:41:31.096 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:31.096 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:41:31.119 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:41:31.119 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-09-19T09:41:31.175 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:41:31.175 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:31.175 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T09:41:31.175 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:31.176 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:31.176 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-19 09:41:21.042717251 +0000 2024-09-19T09:41:31.176 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-19 09:39:05.188530118 +0000 2024-09-19T09:41:31.176 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-19 09:39:05.188530118 +0000 2024-09-19T09:41:31.176 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-19 09:39:05.188530118 +0000 2024-09-19T09:41:31.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:41:31.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-19T09:41:31.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-19T09:41:31.239 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000280583 s, 1.8 MB/s 2024-09-19T09:41:31.240 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:41:31.297 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-09-19T09:41:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:41:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:31.352 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:41:31.352 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:31.352 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:31.353 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-19 09:41:21.043717227 +0000 2024-09-19T09:41:31.353 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-19 09:39:05.527521942 +0000 2024-09-19T09:41:31.353 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-19 09:39:05.527521942 +0000 2024-09-19T09:41:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-19 09:39:05.527521942 +0000 2024-09-19T09:41:31.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:41:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-19T09:41:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-19T09:41:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000200866 s, 2.5 MB/s 2024-09-19T09:41:31.417 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:41:31.474 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-09-19T09:41:31.529 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-19 09:41:21.043717227 +0000 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-19 09:39:05.850514152 +0000 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-19 09:39:05.850514152 +0000 2024-09-19T09:41:31.530 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-19 09:39:05.850514152 +0000 2024-09-19T09:41:31.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:41:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-19T09:41:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-19T09:41:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000177866 s, 2.9 MB/s 2024-09-19T09:41:31.593 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:41:31.649 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-19 09:41:21.043717227 +0000 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-19 09:39:06.172506385 +0000 2024-09-19T09:41:31.705 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-19 09:39:06.172506385 +0000 2024-09-19T09:41:31.706 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-19 09:39:06.172506385 +0000 2024-09-19T09:41:31.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:41:31.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-19T09:41:31.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-19T09:41:31.769 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000188412 s, 2.7 MB/s 2024-09-19T09:41:31.770 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:41:31.825 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:31.826 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:31.826 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:41:31.843 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:41:31.844 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 09:40:59.718718421 +0000 2024-09-19T09:41:31.900 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 09:39:19.466845755 +0000 2024-09-19T09:41:31.901 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 09:39:19.466845755 +0000 2024-09-19T09:41:31.901 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 09:39:19.466845755 +0000 2024-09-19T09:41:31.901 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:41:31.966 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T09:41:31.966 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T09:41:31.966 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000326364 s, 1.6 MB/s 2024-09-19T09:41:31.967 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:41:32.026 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-19T09:41:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:41:32.082 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:32.082 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:41:32.082 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:32.082 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:32.083 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 09:40:59.718718421 +0000 2024-09-19T09:41:32.083 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 09:39:19.796838830 +0000 2024-09-19T09:41:32.083 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 09:39:19.796838830 +0000 2024-09-19T09:41:32.083 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 09:39:19.796838830 +0000 2024-09-19T09:41:32.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:41:32.147 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T09:41:32.147 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T09:41:32.147 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000201182 s, 2.5 MB/s 2024-09-19T09:41:32.148 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:41:32.205 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-19T09:41:32.261 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 09:40:59.719718400 +0000 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 09:39:20.114832158 +0000 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 09:39:20.114832158 +0000 2024-09-19T09:41:32.262 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 09:39:20.114832158 +0000 2024-09-19T09:41:32.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:41:32.325 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T09:41:32.325 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T09:41:32.325 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000213091 s, 2.4 MB/s 2024-09-19T09:41:32.326 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:41:32.383 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-19T09:41:32.439 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:41:32.439 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:41:32.439 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T09:41:32.440 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:41:32.440 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:41:32.440 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 09:40:59.719718400 +0000 2024-09-19T09:41:32.440 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 09:39:20.437825381 +0000 2024-09-19T09:41:32.440 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 09:39:20.437825381 +0000 2024-09-19T09:41:32.440 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 09:39:20.437825381 +0000 2024-09-19T09:41:32.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:41:32.503 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T09:41:32.503 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T09:41:32.503 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000204273 s, 2.5 MB/s 2024-09-19T09:41:32.504 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:41:32.560 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:32.560 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T09:41:32.561 INFO:tasks.ceph:Generating config... 2024-09-19T09:41:32.562 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-19T09:41:32.562 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-19T09:41:32.562 INFO:tasks.ceph:[client] debug client = 20 2024-09-19T09:41:32.562 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T09:41:32.562 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-19T09:41:32.562 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-19T09:41:32.562 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-19T09:41:32.562 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-19T09:41:32.563 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T09:41:32.564 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-19T09:41:32.565 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-19T09:41:32.565 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-19T09:41:32.565 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T09:41:32.566 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-19T09:41:32.566 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T09:41:32.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T09:41:32.615 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T09:41:32.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T09:41:32.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T09:41:32.725 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.194'), ('mon.c', '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]')] 2024-09-19T09:41:32.726 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-19T09:41:32.726 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:32.727 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T09:41:32.781 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.194 --addv c '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:32.866 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid 837baa2f-03c1-414f-aff3-ae2b21065b15 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = quincy 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:fsid 837baa2f-03c1-414f-aff3-ae2b21065b15 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2024-09-19T09:41:32.866122+0000 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-09-19T09:41:32.866122+0000 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 17 (quincy) 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] mon.c 2024-09-19T09:41:32.867 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T09:41:32.869 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T09:41:32.884 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 837baa2f-03c1-414f-aff3-ae2b21065b15... 2024-09-19T09:41:32.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T09:41:32.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-09-19T09:41:32.968 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-09-19T09:41:32.969 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-09-19T09:41:32.970 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.971 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-09-19T09:41:32.971 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-09-19T09:41:32.971 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-09-19T09:41:32.971 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-09-19T09:41:32.971 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2024-09-19T09:41:32.971 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 837baa2f-03c1-414f-aff3-ae2b21065b15 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-09-19T09:41:32.972 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-09-19T09:41:32.973 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-09-19T09:41:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: filestore flush min = 0 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: mon client directed command retry = 5 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-09-19T09:41:32.975 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject delay max = 1 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject delay probability = 0.005 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject delay type = client mds 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject socket failures = 2500 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: osd blocked scrub grace period = 3600 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: osd max markdown count = 1000 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-09-19T09:41:32.976 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-09-19T09:41:32.977 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-09-19T09:41:32.978 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: mon down mkfs grace = 300 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on pool no app = False 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-09-19T09:41:32.979 INFO:teuthology.orchestra.run.smithi123.stdout: client_shutdown_timeout = 120 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.e] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-19T09:41:32.980 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.f] 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds bal fragment size max = 10000 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds bal merge size = 5 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds bal split bits = 3 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds bal split size = 100 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds oft prefetch dirfrags = True 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2024-09-19T09:41:32.981 INFO:teuthology.orchestra.run.smithi123.stdout: mds_dir_prefetch = True 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: mds_sleep_rank_change = 5000000.0 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: mon client directed command retry = 5 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject delay max = 1 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject delay probability = 0.005 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject delay type = client mds osd 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: ms inject socket failures = 2500 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-19T09:41:32.982 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-19T09:41:32.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-19T09:41:32.985 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T09:41:32.986 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.123,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on skipped message = False 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 837baa2f-03c1-414f-aff3-ae2b21065b15 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-19T09:41:32.987 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.988 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-19T09:41:32.989 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: filestore flush min = 0 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: mon client directed command retry = 5 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T09:41:32.990 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject delay max = 1 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject delay probability = 0.005 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject delay type = client mds 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject socket failures = 2500 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: osd blocked scrub grace period = 3600 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: osd max markdown count = 1000 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-19T09:41:32.991 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-19T09:41:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T09:41:32.993 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: mon down mkfs grace = 300 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on pool no app = False 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-19T09:41:32.994 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: client_shutdown_timeout = 120 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-09-19T09:41:32.995 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.e] 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.f] 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal fragment size max = 10000 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal merge size = 5 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal split bits = 3 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal split size = 100 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2024-09-19T09:41:32.996 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: mds oft prefetch dirfrags = True 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: mds_dir_prefetch = True 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: mds_sleep_rank_change = 5000000.0 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: mon client directed command retry = 5 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject delay max = 1 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject delay probability = 0.005 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject delay type = client mds osd 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject socket failures = 2500 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-09-19T09:41:32.997 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-09-19T09:41:32.998 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T09:41:32.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T09:41:33.079 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T09:41:33.080 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:33.080 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T09:41:33.095 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:33.095 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T09:41:33.150 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:41:33.150 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:33.150 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T09:41:33.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T09:41:33.225 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:41:33.225 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:33.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:41:33.280 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:33.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T09:41:33.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T09:41:33.314 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:41:33.315 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:33.370 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T09:41:33.370 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T09:41:33.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T09:41:33.421 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T09:41:33.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T09:41:33.483 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T09:41:33.486 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T09:41:33.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T09:41:33.537 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T09:41:33.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-19T09:41:33.564 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T09:41:33.655 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T09:41:33.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-19T09:41:33.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-19T09:41:33.773 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-19T09:41:33.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-19T09:41:33.800 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T09:41:33.854 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T09:41:33.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-19T09:41:33.881 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T09:41:33.973 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T09:41:33.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-19T09:41:34.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-19T09:41:34.091 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-19T09:41:34.094 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-19T09:41:34.119 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T09:41:34.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:41:34.161 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T09:41:34.174 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T09:41:34.174 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T09:41:34.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T09:41:34.239 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:34.240 INFO:tasks.ceph:role: osd.0 2024-09-19T09:41:34.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:41:34.240 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:34.825 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-19T09:41:34.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-19T09:41:34.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T09:41:34.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T09:41:35.012 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T09:41:35.079 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:35.079 INFO:tasks.ceph:role: osd.1 2024-09-19T09:41:35.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:41:35.079 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T09:41:35.152 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:35.152 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:35.152 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:35.152 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:35.152 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:35.153 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:35.153 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:35.153 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:35.153 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:35.153 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:35.635 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-19T09:41:35.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-19T09:41:35.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T09:41:35.728 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T09:41:35.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:35.822 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:35.822 INFO:tasks.ceph:role: osd.2 2024-09-19T09:41:35.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:41:35.822 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T09:41:35.895 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:35.895 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:35.895 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:35.895 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:35.895 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:35.895 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:35.896 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:35.896 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:35.896 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:35.896 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:36.413 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-19T09:41:36.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-19T09:41:36.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:36.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:36.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:36.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:36.645 INFO:tasks.ceph:role: osd.3 2024-09-19T09:41:36.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:41:36.646 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T09:41:36.717 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:36.717 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:36.717 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:36.718 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:37.224 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-19T09:41:37.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-19T09:41:37.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:37.341 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:37.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:37.470+0000 7fab87c0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T09:41:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:37.470+0000 7fab87c0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T09:41:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:37.470+0000 7fab87c0b640 -1 bdev(0x55e3d8915800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T09:41:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:37.470+0000 7fab87c0b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T09:41:41.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:41:41.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:41.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:41.512+0000 7f533cdbd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T09:41:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:41.512+0000 7f533cdbd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T09:41:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:41.512+0000 7f533cdbd640 -1 bdev(0x556168b0f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T09:41:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:41.512+0000 7f533cdbd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T09:41:45.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:41:45.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:45.286+0000 7f69a8334640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T09:41:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:45.286+0000 7f69a8334640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T09:41:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:45.286+0000 7f69a8334640 -1 bdev(0x557548a75800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T09:41:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:45.286+0000 7f69a8334640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T09:41:49.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:41:49.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:49.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:49.314+0000 7fa56a215640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T09:41:49.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:49.315+0000 7fa56a215640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T09:41:49.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:49.315+0000 7fa56a215640 -1 bdev(0x56275ba61800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T09:41:49.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:41:49.315+0000 7fa56a215640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T09:41:53.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:41:53.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T09:41:53.274 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:53.274 INFO:tasks.ceph:role: osd.4 2024-09-19T09:41:53.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:41:53.274 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T09:41:53.349 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:53.349 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:53.349 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:53.349 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:53.349 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:53.349 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:53.350 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:53.350 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:53.350 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:53.350 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:53.864 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-19T09:41:53.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-19T09:41:53.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T09:41:53.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T09:41:54.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T09:41:54.091 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:54.091 INFO:tasks.ceph:role: osd.5 2024-09-19T09:41:54.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:41:54.092 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T09:41:54.165 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:54.166 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:54.627 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-19T09:41:54.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-19T09:41:54.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T09:41:54.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T09:41:54.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T09:41:54.821 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:54.821 INFO:tasks.ceph:role: osd.6 2024-09-19T09:41:54.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:41:54.822 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T09:41:54.895 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:54.895 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:54.896 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:55.378 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-19T09:41:55.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-19T09:41:55.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T09:41:55.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T09:41:55.554 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T09:41:55.621 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:41:55.622 INFO:tasks.ceph:role: osd.7 2024-09-19T09:41:55.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:41:55.622 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:41:55.696 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:41:55.697 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:41:55.697 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:41:55.697 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:41:56.201 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-19T09:41:56.205 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-19T09:41:56.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T09:41:56.335 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T09:41:56.371 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:41:56.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:41:56.460+0000 7f5c97c1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T09:41:56.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:41:56.461+0000 7f5c97c1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T09:41:56.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:41:56.461+0000 7f5c97c1b640 -1 bdev(0x55f4eb41d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T09:41:56.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:41:56.461+0000 7f5c97c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T09:42:00.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:42:00.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:42:00.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:00.241+0000 7f4b89617640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T09:42:00.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:00.241+0000 7f4b89617640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T09:42:00.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:00.241+0000 7f4b89617640 -1 bdev(0x563eb2e5b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T09:42:00.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:00.242+0000 7f4b89617640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T09:42:00.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:42:00.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:42:03.672 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:42:03.701 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:42:03.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:03.790+0000 7f520860d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T09:42:03.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:03.791+0000 7f520860d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T09:42:03.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:03.791+0000 7f520860d640 -1 bdev(0x55d12f617800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T09:42:03.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:03.791+0000 7f520860d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T09:42:07.705 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T09:42:07.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:42:07.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:07.824+0000 7f64ccdc3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T09:42:07.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:07.824+0000 7f64ccdc3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T09:42:07.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:07.824+0000 7f64ccdc3640 -1 bdev(0x55bca43cb800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T09:42:07.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:07.824+0000 7f64ccdc3640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T09:42:11.732 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T09:42:11.762 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T09:42:11.762 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:11.762 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T09:42:11.793 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:11.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-19T09:42:11.864 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:11.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-19T09:42:11.933 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:11.933 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-19T09:42:12.001 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:12.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T09:42:12.068 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:12.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T09:42:12.134 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:12.134 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T09:42:12.200 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:12.200 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T09:42:12.267 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T09:42:12.297 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-19T09:42:12.365 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-19T09:42:12.433 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-19T09:42:12.501 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T09:42:12.567 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T09:42:12.633 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T09:42:12.699 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:12.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T09:42:12.765 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:12.765 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T09:42:12.783 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T09:42:12.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T09:42:12.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T09:42:12.850 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-09-19T09:42:12.850 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etm22sRGRAAf71zHRn0B46VYdtCScK4LA== 2024-09-19T09:42:12.850 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-09-19T09:42:12.850 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etmJ0//HxAAHbF5ghkVCtRGl+DpWJ/NRA== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etm/9MFJxAAgIliLM4ZF/01G/48GG6Xaw== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.e] 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etmx/UPLhAAoMq3oZnxrETg/sSG6BvylA== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDR8etmRRIZHBAARHMwoO9zuEmXqo8wHKES8Q== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDV8etmxL6UHhAAa4LhFZYUrZsaGGAdk3Bynw== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDZ8etmfXceERAA2n6hVMDu588M/6IiYd/K7A== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDd8etmF+DQEhAAazQ8ILNpj9YwNT0aovOb2Q== 2024-09-19T09:42:12.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etmZQ3LHBAAAy7e5ztKmWQyrcRVCs2edQ== 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etmtxrdMhAAbXpwEaLxFQCsHsQJcKr2vQ== 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDN8etmjTYAOhAAQRkQj7AIsKkYLw98DswEYw== 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.f] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDO8etme2NsBRAAU0Jj3dh/TNHCAjK+wWOcrw== 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDk8etm6XaJGxAAvcGX4MVMNYbuvScwLLuf6w== 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDo8etmGut1DhAA9480Pr57o1dbz5zv9/UTCg== 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-09-19T09:42:12.852 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDr8etmMl8zLxAALGUqGHAFxgzZgl3PY0TiQA== 2024-09-19T09:42:12.853 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-09-19T09:42:12.853 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDv8etmAScyMRAAGCB9QbFSZVMJTk3bZnw29A== 2024-09-19T09:42:12.853 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-19T09:42:12.853 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDO8etmd0KXCRAAM/hkAkr60DzQBR3g8pLyqg== 2024-09-19T09:42:12.854 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2024-09-19T09:42:12.854 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etm22sRGRAAf71zHRn0B46VYdtCScK4LA== 2024-09-19T09:42:12.854 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-19T09:42:12.854 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etmJ0//HxAAHbF5ghkVCtRGl+DpWJ/NRA== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etm/9MFJxAAgIliLM4ZF/01G/48GG6Xaw== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.e] 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etmx/UPLhAAoMq3oZnxrETg/sSG6BvylA== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDR8etmRRIZHBAARHMwoO9zuEmXqo8wHKES8Q== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDV8etmxL6UHhAAa4LhFZYUrZsaGGAdk3Bynw== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDZ8etmfXceERAA2n6hVMDu588M/6IiYd/K7A== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDd8etmF+DQEhAAazQ8ILNpj9YwNT0aovOb2Q== 2024-09-19T09:42:12.855 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etmZQ3LHBAAAy7e5ztKmWQyrcRVCs2edQ== 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etmtxrdMhAAbXpwEaLxFQCsHsQJcKr2vQ== 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDN8etmjTYAOhAAQRkQj7AIsKkYLw98DswEYw== 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.f] 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDO8etme2NsBRAAU0Jj3dh/TNHCAjK+wWOcrw== 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDk8etm6XaJGxAAvcGX4MVMNYbuvScwLLuf6w== 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDo8etmGut1DhAA9480Pr57o1dbz5zv9/UTCg== 2024-09-19T09:42:12.856 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2024-09-19T09:42:12.857 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDr8etmMl8zLxAALGUqGHAFxgzZgl3PY0TiQA== 2024-09-19T09:42:12.857 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2024-09-19T09:42:12.857 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDv8etmAScyMRAAGCB9QbFSZVMJTk3bZnw29A== 2024-09-19T09:42:12.857 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-19T09:42:12.857 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDO8etmd0KXCRAAM/hkAkr60DzQBR3g8pLyqg== 2024-09-19T09:42:12.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:42:12.897 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:42:12.950 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:12.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.006 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.121 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.173 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:42:13.335 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:42:13.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.445 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.500 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:42:13.554 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.556 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.606 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.609 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.659 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.661 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.713 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:42:13.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:42:13.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:42:13.819 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T09:42:13.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T09:42:13.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T09:42:13.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T09:42:13.965 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T09:42:13.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T09:42:14.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T09:42:14.110 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T09:42:14.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T09:42:14.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T09:42:14.295 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:42:14.297 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:42:14.350 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T09:42:14.351 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T09:42:14.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T09:42:14.355 INFO:tasks.ceph.mon.a:Started 2024-09-19T09:42:14.355 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:42:14.356 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:42:14.393 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:42:14.393 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T09:42:14.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T09:42:14.395 INFO:tasks.ceph.mon.c:Started 2024-09-19T09:42:14.395 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T09:42:14.396 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T09:42:14.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T09:42:14.400 INFO:tasks.ceph.mgr.y:Started 2024-09-19T09:42:14.400 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T09:42:14.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T09:42:14.403 INFO:tasks.ceph.mgr.x:Started 2024-09-19T09:42:14.403 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T09:42:14.403 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T09:42:14.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.500+0000 7f134cf11640 1 Processor -- start 2024-09-19T09:42:14.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.500+0000 7f134cf11640 1 -- start start 2024-09-19T09:42:14.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134cf11640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 0x7f13480cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134cf11640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f13480cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134cf11640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134815b580 con 0x7f13480cdbb0 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134cf11640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f134815c100 con 0x7f1348155360 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134cf11640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f134815e910 con 0x7f13480cd040 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 0x7f13480cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 0x7f13480cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45314/0 (socket says 172.21.15.123:45314) 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 -- 172.21.15.123:0/3394009348 learned_addr learned my addr 172.21.15.123:0/3394009348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 -- 172.21.15.123:0/3394009348 >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 msgr2=0x7f13480cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 -- 172.21.15.123:0/3394009348 >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 msgr2=0x7f13480cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 --2- 172.21.15.123:0/3394009348 >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 0x7f13480cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f134659c640 1 --2- 172.21.15.123:0/3394009348 >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 0x7f13480cb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f1345d9b640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f13480cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f1345d9b640 1 -- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 msgr2=0x7f13480cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f1345d9b640 1 -- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 msgr2=0x7f13480cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f1345d9b640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f13480cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.501+0000 7f1345d9b640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f13480cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:42:14.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303321053 0 0) 0x7f134815b580 con 0x7f13480cdbb0 2024-09-19T09:42:14.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1330003520 con 0x7f13480cdbb0 2024-09-19T09:42:14.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2422562249 0 0) 0x7f1330003520 con 0x7f13480cdbb0 2024-09-19T09:42:14.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 msgr2=0x7f13480cd670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:42:14.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f13480cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 msgr2=0x7f13480cb900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 --2- 172.21.15.123:0/3394009348 >> v2:172.21.15.123:3300/0 conn(0x7f1348155360 0x7f13480cb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134815b860 con 0x7f13480cdbb0 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f13400019f0 con 0x7f13480cdbb0 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 >> v1:172.21.15.194:6789/0 conn(0x7f13480cdbb0 legacy=0x7f134815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13300039b0 0x7f1330003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f1330004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f134815c100 con 0x7f1330004d40 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f134815e910 con 0x7f13300039b0 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.665+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f133000bb20 con 0x7f13480cd040 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f134659c640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13300039b0 0x7f1330003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f1346d9d640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f1345d9b640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f1330004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f134659c640 1 -- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 msgr2=0x7f1330004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f134659c640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cd040 0x7f1330004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f134659c640 1 -- 172.21.15.123:0/3394009348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1330004d40 msgr2=0x7f13300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f134659c640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.666+0000 7f134659c640 1 -- 172.21.15.123:0/3394009348 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1330003520 con 0x7f13300039b0 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.667+0000 7f134659c640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13300039b0 0x7f1330003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1338009890 tx=0x7f1330005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d911cedbdc03cebe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.667+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338037070 con 0x7f13300039b0 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.667+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133802ad00 con 0x7f13300039b0 2024-09-19T09:42:14.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.667+0000 7f134559a640 1 -- 172.21.15.123:0/3394009348 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133800f040 con 0x7f13300039b0 2024-09-19T09:42:14.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f134cf11640 1 -- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13300039b0 msgr2=0x7f1330003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f134cf11640 1 --2- 172.21.15.123:0/3394009348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13300039b0 0x7f1330003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1338009890 tx=0x7f1330005830 comp rx=0 tx=0).stop 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f1346d9d640 1 -- 172.21.15.123:0/3394009348 reap_dead start 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f134cf11640 1 -- 172.21.15.123:0/3394009348 shutdown_connections 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f134cf11640 1 -- 172.21.15.123:0/3394009348 >> 172.21.15.123:0/3394009348 conn(0x7f134806cb60 msgr2=0x7f134806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f134cf11640 1 -- 172.21.15.123:0/3394009348 shutdown_connections 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.668+0000 7f134cf11640 1 -- 172.21.15.123:0/3394009348 wait complete. 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 Processor -- start 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 -- start start 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 0x7f134814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13481f5190 0x7f13481f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cfe30 0x7f134815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13480cbe40 con 0x7f13300039b0 2024-09-19T09:42:14.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f134815be20 con 0x7f13481f5190 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.670+0000 7f134cf11640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1348155740 con 0x7f13480cfe30 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 0x7f134814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 0x7f134814d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45336/0 (socket says 172.21.15.123:45336) 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 -- 172.21.15.123:0/3423979767 learned_addr learned my addr 172.21.15.123:0/3423979767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f1345d9b640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13481f5190 0x7f13481f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f1346d9d640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cfe30 0x7f134815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 -- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cfe30 msgr2=0x7f134815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cfe30 0x7f134815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 -- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13481f5190 msgr2=0x7f13481f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13481f5190 0x7f13481f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 -- 172.21.15.123:0/3423979767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134814dac0 con 0x7f13300039b0 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f1345d9b640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13481f5190 0x7f13481f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:14.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134659c640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 0x7f134814d4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1338009980 tx=0x7f1338004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338042020 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133800f000 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338037040 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.671+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134814dda0 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.672+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13481f4990 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.672+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1338045020 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.672+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f133803e880 con 0x7f13300039b0 2024-09-19T09:42:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.673+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13480cc150 con 0x7f13300039b0 2024-09-19T09:42:14.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.675+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f13480cc150 con 0x7f13300039b0 2024-09-19T09:42:14.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.737+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f134814e080 con 0x7f13300039b0 2024-09-19T09:42:14.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.739+0000 7f1336ffd640 1 -- 172.21.15.123:0/3423979767 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f133804c030 con 0x7f13300039b0 2024-09-19T09:42:14.740 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-09-19T09:42:14.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 msgr2=0x7f134814d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 0x7f134814d4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1338009980 tx=0x7f1338004730 comp rx=0 tx=0).stop 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 shutdown_connections 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13480cfe30 0x7f134815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13481f5190 0x7f13481f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 --2- 172.21.15.123:0/3423979767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13300039b0 0x7f134814d4a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 >> 172.21.15.123:0/3423979767 conn(0x7f134806cb60 msgr2=0x7f13480c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 shutdown_connections 2024-09-19T09:42:14.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:14.740+0000 7f134cf11640 1 -- 172.21.15.123:0/3423979767 wait complete. 2024-09-19T09:42:14.752 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T09:42:14.752 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T09:42:14.753 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:14.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T09:42:14.770 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:14.768+0000 7fd7e1320040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:42:14.773 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:14.771+0000 7f213c5d4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:42:14.777 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:14.777 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T09:42:14.810 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:14.808+0000 7fd7e1320040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:42:14.815 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:14.813+0000 7f213c5d4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:42:14.839 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:14.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T09:42:14.904 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:42:14.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T09:42:14.959 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:14.957+0000 7f213c5d4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:42:14.969 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:14.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T09:42:14.970 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:14.968+0000 7fd7e1320040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:42:14.994 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:14.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T09:42:15.012 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:15.010+0000 7f213c5d4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:42:15.022 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:15.020+0000 7fd7e1320040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:42:15.046 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:15.046 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T09:42:15.111 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T09:42:15.112 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T09:42:15.172 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:15.171+0000 7f213c5d4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:42:15.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 184c1d58-a744-4d9f-924d-453709c92009 0 2024-09-19T09:42:15.179 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:15.177+0000 7fd7e1320040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:42:15.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.275+0000 7fc352d42640 1 Processor -- start 2024-09-19T09:42:15.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.275+0000 7fc352d42640 1 -- start start 2024-09-19T09:42:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc352d42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc34c06ee60 0x7fc34c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc352d42640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c155410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc352d42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c0c8830 con 0x7fc34c06ce90 2024-09-19T09:42:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc352d42640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc34c155950 con 0x7fc34c06ee60 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc352d42640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc34c0cbc50 con 0x7fc34c06d270 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42074/0 (socket says 172.21.15.194:42074) 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 -- 172.21.15.194:0/651651701 learned_addr learned my addr 172.21.15.194:0/651651701 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc34bfff640 1 --2- 172.21.15.194:0/651651701 >> v2:172.21.15.123:3300/0 conn(0x7fc34c06ee60 0x7fc34c154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 -- 172.21.15.194:0/651651701 >> v2:172.21.15.123:3300/0 conn(0x7fc34c06ee60 msgr2=0x7fc34c154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 --2- 172.21.15.194:0/651651701 >> v2:172.21.15.123:3300/0 conn(0x7fc34c06ee60 0x7fc34c154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 -- 172.21.15.194:0/651651701 >> v1:172.21.15.123:6789/0 conn(0x7fc34c06ce90 legacy=0x7fc34c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.276+0000 7fc3512df640 1 -- 172.21.15.194:0/651651701 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c0c8ad0 con 0x7fc34c06d270 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.277+0000 7fc3512df640 1 --2- 172.21.15.194:0/651651701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c155410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc344009e80 tx=0x7fc34402a7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5b05c77244e568b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.277+0000 7fc34b7fe640 1 -- 172.21.15.194:0/651651701 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344036070 con 0x7fc34c06d270 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.277+0000 7fc34b7fe640 1 -- 172.21.15.194:0/651651701 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc344031600 con 0x7fc34c06d270 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.277+0000 7fc34b7fe640 1 -- 172.21.15.194:0/651651701 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440319d0 con 0x7fc34c06d270 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 -- 172.21.15.194:0/651651701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 msgr2=0x7fc34c155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 --2- 172.21.15.194:0/651651701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c155410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc344009e80 tx=0x7fc34402a7e0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 -- 172.21.15.194:0/651651701 shutdown_connections 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 --2- 172.21.15.194:0/651651701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c155410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 --2- 172.21.15.194:0/651651701 >> v2:172.21.15.123:3300/0 conn(0x7fc34c06ee60 0x7fc34c154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 -- 172.21.15.194:0/651651701 >> 172.21.15.194:0/651651701 conn(0x7fc34c06fb20 msgr2=0x7fc34c06ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 -- 172.21.15.194:0/651651701 shutdown_connections 2024-09-19T09:42:15.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.278+0000 7fc352d42640 1 -- 172.21.15.194:0/651651701 wait complete. 2024-09-19T09:42:15.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.279+0000 7fc352d42640 1 Processor -- start 2024-09-19T09:42:15.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.279+0000 7fc352d42640 1 -- start start 2024-09-19T09:42:15.282 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:15.279+0000 7f213c5d4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:42:15.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc352d42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc34c06ce90 0x7fc34c15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc352d42640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc352d42640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34c06ee60 0x7fc34c067950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc352d42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c15ebe0 con 0x7fc34c06ce90 2024-09-19T09:42:15.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc352d42640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c15e900 con 0x7fc34c06ee60 2024-09-19T09:42:15.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc352d42640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc34c0c9090 con 0x7fc34c06d270 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc3512df640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34c06ee60 0x7fc34c067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c143580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42076/0 (socket says 172.21.15.194:42076) 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 -- 172.21.15.194:0/2012177655 learned_addr learned my addr 172.21.15.194:0/2012177655 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc350ade640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc34c06ce90 0x7fc34c15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 -- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34c06ee60 msgr2=0x7fc34c067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34c06ee60 0x7fc34c067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 -- 172.21.15.194:0/2012177655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc34c06ce90 msgr2=0x7fc34c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc34c06ce90 0x7fc34c15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 -- 172.21.15.194:0/2012177655 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c15cf40 con 0x7fc34c06d270 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.280+0000 7fc34bfff640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c143580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc33800e8a0 tx=0x7fc33800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338017070 con 0x7fc34c06d270 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33800c940 con 0x7fc34c06d270 2024-09-19T09:42:15.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34c15c460 con 0x7fc34c06d270 2024-09-19T09:42:15.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800cd30 con 0x7fc34c06d270 2024-09-19T09:42:15.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34c15d1e0 con 0x7fc34c06d270 2024-09-19T09:42:15.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc33801a070 con 0x7fc34c06d270 2024-09-19T09:42:15.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.281+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc338013470 con 0x7fc34c06d270 2024-09-19T09:42:15.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.282+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34c068f50 con 0x7fc34c06d270 2024-09-19T09:42:15.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.285+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc34c068f50 con 0x7fc34c06d270 2024-09-19T09:42:15.297 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:15.295+0000 7fd7e1320040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:42:15.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.355+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "184c1d58-a744-4d9f-924d-453709c92009", "id": 0} v 0) -- 0x7fc34c15b200 con 0x7fc34c06d270 2024-09-19T09:42:15.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.361+0000 7fc3497fa640 1 -- 172.21.15.194:0/2012177655 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "184c1d58-a744-4d9f-924d-453709c92009", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc338005990 con 0x7fc34c06d270 2024-09-19T09:42:15.364 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 msgr2=0x7fc34c143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c143580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc33800e8a0 tx=0x7fc33800ed60 comp rx=0 tx=0).stop 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 shutdown_connections 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34c06ee60 0x7fc34c067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc34c06d270 0x7fc34c143580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 --2- 172.21.15.194:0/2012177655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc34c06ce90 0x7fc34c15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 >> 172.21.15.194:0/2012177655 conn(0x7fc34c06fb20 msgr2=0x7fc34c159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 shutdown_connections 2024-09-19T09:42:15.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.362+0000 7fc352d42640 1 -- 172.21.15.194:0/2012177655 wait complete. 2024-09-19T09:42:15.374 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 5777b9a1-1974-47d1-85c0-51d92a35271e 1 2024-09-19T09:42:15.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.470+0000 7f978f650640 1 Processor -- start 2024-09-19T09:42:15.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 -- start start 2024-09-19T09:42:15.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f978806ce90 0x7f978815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 0x7f9788154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 0x7f9788155410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9788155950 con 0x7f978806ce90 2024-09-19T09:42:15.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f97880cbc50 con 0x7f978806d270 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978f650640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f97880c8830 con 0x7f978806ee60 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978cbeb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 0x7f9788154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978dbed640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 0x7f9788155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978cbeb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 0x7f9788154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42088/0 (socket says 172.21.15.194:42088) 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978dbed640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 0x7f9788155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56370/0 (socket says 172.21.15.194:56370) 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.471+0000 7f978cbeb640 1 -- 172.21.15.194:0/3991835741 learned_addr learned my addr 172.21.15.194:0/3991835741 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978cbeb640 1 -- 172.21.15.194:0/3991835741 >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 msgr2=0x7f9788155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978cbeb640 1 --2- 172.21.15.194:0/3991835741 >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 0x7f9788155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978cbeb640 1 -- 172.21.15.194:0/3991835741 >> v2:172.21.15.123:3300/0 conn(0x7f978806ce90 msgr2=0x7f978815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978cbeb640 1 --2- 172.21.15.194:0/3991835741 >> v2:172.21.15.123:3300/0 conn(0x7f978806ce90 0x7f978815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978cbeb640 1 -- 172.21.15.194:0/3991835741 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97880c8ad0 con 0x7f978806ee60 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978dbed640 1 --2- 172.21.15.194:0/3991835741 >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 0x7f9788155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:15.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f978cbeb640 1 --2- 172.21.15.194:0/3991835741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 0x7f9788154ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97880c4bb0 tx=0x7f977c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb102a725868b043 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.472+0000 7f977bfff640 1 -- 172.21.15.194:0/3991835741 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c037070 con 0x7f978806ee60 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f977bfff640 1 -- 172.21.15.194:0/3991835741 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c032440 con 0x7f978806ee60 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f977bfff640 1 -- 172.21.15.194:0/3991835741 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c032810 con 0x7f978806ee60 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 -- 172.21.15.194:0/3991835741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 msgr2=0x7f9788154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 --2- 172.21.15.194:0/3991835741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 0x7f9788154ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97880c4bb0 tx=0x7f977c02a270 comp rx=0 tx=0).stop 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 -- 172.21.15.194:0/3991835741 shutdown_connections 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 --2- 172.21.15.194:0/3991835741 >> v2:172.21.15.194:3300/0 conn(0x7f978806d270 0x7f9788155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 --2- 172.21.15.194:0/3991835741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ee60 0x7f9788154ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 --2- 172.21.15.194:0/3991835741 >> v2:172.21.15.123:3300/0 conn(0x7f978806ce90 0x7f978815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 -- 172.21.15.194:0/3991835741 >> 172.21.15.194:0/3991835741 conn(0x7f978806fb20 msgr2=0x7f978806ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 -- 172.21.15.194:0/3991835741 shutdown_connections 2024-09-19T09:42:15.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.473+0000 7f978f650640 1 -- 172.21.15.194:0/3991835741 wait complete. 2024-09-19T09:42:15.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.474+0000 7f978f650640 1 Processor -- start 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.474+0000 7f978f650640 1 -- start start 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978f650640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ce90 0x7f97880c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978f650640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 0x7f978815e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978f650640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978806ee60 0x7f97881565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978f650640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f978815ebe0 con 0x7f978806ee60 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978f650640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f978815e900 con 0x7f978806d270 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978f650640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f97880c9090 con 0x7f978806ce90 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978cbeb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 0x7f978815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978d3ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ce90 0x7f97880c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978cbeb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 0x7f978815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56382/0 (socket says 172.21.15.194:56382) 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978cbeb640 1 -- 172.21.15.194:0/1394747038 learned_addr learned my addr 172.21.15.194:0/1394747038 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978dbed640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978806ee60 0x7f97881565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978d3ec640 1 -- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 msgr2=0x7f978815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978d3ec640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 0x7f978815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978d3ec640 1 -- 172.21.15.194:0/1394747038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978806ee60 msgr2=0x7f97881565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978d3ec640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978806ee60 0x7f97881565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978d3ec640 1 -- 172.21.15.194:0/1394747038 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97880733e0 con 0x7f978806ce90 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978cbeb640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 0x7f978815e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.475+0000 7f978dbed640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978806ee60 0x7f97881565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f978d3ec640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ce90 0x7f97880c5430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f978400b420 tx=0x7f978400b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784011830 con 0x7f978806ce90 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9784016070 con 0x7f978806ce90 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9788073650 con 0x7f978806ce90 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784011c10 con 0x7f978806ce90 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97881573d0 con 0x7f978806ce90 2024-09-19T09:42:15.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f978401b460 con 0x7f978806ce90 2024-09-19T09:42:15.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.476+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f978401a720 con 0x7f978806ce90 2024-09-19T09:42:15.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.477+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9788156f00 con 0x7f978806ce90 2024-09-19T09:42:15.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.479+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9784011db0 con 0x7f978806ce90 2024-09-19T09:42:15.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.548+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5777b9a1-1974-47d1-85c0-51d92a35271e", "id": 1} v 0) -- 0x7f978815b200 con 0x7f978806ce90 2024-09-19T09:42:15.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.554+0000 7f9779ffb640 1 -- 172.21.15.194:0/1394747038 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5777b9a1-1974-47d1-85c0-51d92a35271e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f978401a970 con 0x7f978806ce90 2024-09-19T09:42:15.556 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-19T09:42:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ce90 msgr2=0x7f97880c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ce90 0x7f97880c5430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f978400b420 tx=0x7f978400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 shutdown_connections 2024-09-19T09:42:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978806ee60 0x7f97881565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978806d270 0x7f978815e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 --2- 172.21.15.194:0/1394747038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f978806ce90 0x7f97880c5430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 >> 172.21.15.194:0/1394747038 conn(0x7f978806fb20 msgr2=0x7f978806ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 shutdown_connections 2024-09-19T09:42:15.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.555+0000 7f978f650640 1 -- 172.21.15.194:0/1394747038 wait complete. 2024-09-19T09:42:15.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new f35e9331-0589-4735-a00e-892e21ac0f5e 2 2024-09-19T09:42:15.615 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:15.614+0000 7f213c5d4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:42:15.624 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:15.623+0000 7fd7e1320040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:42:15.664 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:15.662+0000 7f213c5d4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:42:15.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.665+0000 7f83cb9c4640 1 Processor -- start 2024-09-19T09:42:15.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.665+0000 7f83cb9c4640 1 -- start start 2024-09-19T09:42:15.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83cb9c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83c40ca010 0x7f83c40c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83cb9c4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f83c40cdc30 0x7f83c40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83cb9c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c4157ed0 con 0x7f83c4152210 2024-09-19T09:42:15.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83cb9c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f83c4158ac0 con 0x7f83c40ca010 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83cb9c4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f83c415c190 con 0x7f83c40cdc30 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f83c40cdc30 0x7f83c40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f83c40cdc30 0x7f83c40c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56386/0 (socket says 172.21.15.194:56386) 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 -- 172.21.15.194:0/2837238017 learned_addr learned my addr 172.21.15.194:0/2837238017 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c8f5f640 1 --2- 172.21.15.194:0/2837238017 >> v2:172.21.15.123:3300/0 conn(0x7f83c40ca010 0x7f83c40c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 -- 172.21.15.194:0/2837238017 >> v2:172.21.15.123:3300/0 conn(0x7f83c40ca010 msgr2=0x7f83c40c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 --2- 172.21.15.194:0/2837238017 >> v2:172.21.15.123:3300/0 conn(0x7f83c40ca010 0x7f83c40c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 -- 172.21.15.194:0/2837238017 >> v1:172.21.15.123:6789/0 conn(0x7f83c4152210 legacy=0x7f83c4072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.666+0000 7f83c9f61640 1 -- 172.21.15.194:0/2837238017 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4158190 con 0x7f83c40cdc30 2024-09-19T09:42:15.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.667+0000 7f83c9f61640 1 --2- 172.21.15.194:0/2837238017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c40cdc30 0x7f83c40c5f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83c406f150 tx=0x7f83bc02c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3306e772c86f77e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.667+0000 7f83bbfff640 1 -- 172.21.15.194:0/2837238017 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00b2e0 con 0x7f83c40cdc30 2024-09-19T09:42:15.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.667+0000 7f83bbfff640 1 -- 172.21.15.194:0/2837238017 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc037070 con 0x7f83c40cdc30 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.667+0000 7f83bbfff640 1 -- 172.21.15.194:0/2837238017 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00b480 con 0x7f83c40cdc30 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2837238017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c40cdc30 msgr2=0x7f83c40c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2837238017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c40cdc30 0x7f83c40c5f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83c406f150 tx=0x7f83bc02c940 comp rx=0 tx=0).stop 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2837238017 shutdown_connections 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2837238017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c40cdc30 0x7f83c40c5f40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2837238017 >> v2:172.21.15.123:3300/0 conn(0x7f83c40ca010 0x7f83c40c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2837238017 >> 172.21.15.194:0/2837238017 conn(0x7f83c406daa0 msgr2=0x7f83c406de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2837238017 shutdown_connections 2024-09-19T09:42:15.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.668+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2837238017 wait complete. 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.669+0000 7f83cb9c4640 1 Processor -- start 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.669+0000 7f83cb9c4640 1 -- start start 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83cb9c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83c40ca010 0x7f83c4155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83cb9c4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 0x7f83c4147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83cb9c4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c4152210 0x7f83c415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83cb9c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41525f0 con 0x7f83c40ca010 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83cb9c4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4158750 con 0x7f83c4152210 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83cb9c4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f83c415be50 con 0x7f83c40cdc30 2024-09-19T09:42:15.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c8f5f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 0x7f83c4147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c4152210 0x7f83c415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c8f5f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 0x7f83c4147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42118/0 (socket says 172.21.15.194:42118) 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9760640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83c40ca010 0x7f83c4155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c8f5f640 1 -- 172.21.15.194:0/2722560 learned_addr learned my addr 172.21.15.194:0/2722560 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 -- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 msgr2=0x7f83c4147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 0x7f83c4147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 -- 172.21.15.194:0/2722560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83c40ca010 msgr2=0x7f83c4155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83c40ca010 0x7f83c4155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 -- 172.21.15.194:0/2722560 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c41575c0 con 0x7f83c4152210 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9760640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83c40ca010 0x7f83c4155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c8f5f640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 0x7f83c4147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.670+0000 7f83c9f61640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c4152210 0x7f83c415a300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83bc033000 tx=0x7f83bc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00b720 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc009e50 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c4159540 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc032aa0 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c4159b00 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f83bc043020 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.671+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f83bc03b3f0 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.672+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c40cd820 con 0x7f83c4152210 2024-09-19T09:42:15.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.674+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f83bc04a060 con 0x7f83c4152210 2024-09-19T09:42:15.683 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:15.682+0000 7fd7e1320040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:42:15.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.742+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f35e9331-0589-4735-a00e-892e21ac0f5e", "id": 2} v 0) -- 0x7f83c40c9df0 con 0x7f83c4152210 2024-09-19T09:42:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.748+0000 7f83b9ffb640 1 -- 172.21.15.194:0/2722560 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f35e9331-0589-4735-a00e-892e21ac0f5e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f83bc032c40 con 0x7f83c4152210 2024-09-19T09:42:15.750 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c4152210 msgr2=0x7f83c415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c4152210 0x7f83c415a300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83bc033000 tx=0x7f83bc004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 shutdown_connections 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c4152210 0x7f83c415a300 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c40cdc30 0x7f83c4147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 --2- 172.21.15.194:0/2722560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83c40ca010 0x7f83c4155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 >> 172.21.15.194:0/2722560 conn(0x7f83c406daa0 msgr2=0x7f83c40718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 shutdown_connections 2024-09-19T09:42:15.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.749+0000 7f83cb9c4640 1 -- 172.21.15.194:0/2722560 wait complete. 2024-09-19T09:42:15.762 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new b4c04a04-7f30-4053-88a6-e3999460781a 3 2024-09-19T09:42:15.813 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:15.811+0000 7f213c5d4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:42:15.839 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:15.838+0000 7fd7e1320040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:42:15.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.858+0000 7f6a99ee6640 1 Processor -- start 2024-09-19T09:42:15.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.858+0000 7f6a99ee6640 1 -- start start 2024-09-19T09:42:15.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a99ee6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 0x7f6a9415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a99ee6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 0x7f6a94154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a99ee6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a9406d270 0x7f6a94155410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a99ee6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6a94155950 con 0x7f6a9406d270 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a99ee6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f6a940cbc50 con 0x7f6a9406ce90 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a99ee6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6a940c8830 con 0x7f6a9406ee60 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a937fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 0x7f6a9415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 0x7f6a94154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 0x7f6a94154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42120/0 (socket says 172.21.15.194:42120) 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a937fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 0x7f6a9415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56410/0 (socket says 172.21.15.194:56410) 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 -- 172.21.15.194:0/3917662252 learned_addr learned my addr 172.21.15.194:0/3917662252 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a93fff640 1 --2- 172.21.15.194:0/3917662252 >> v2:172.21.15.123:3300/0 conn(0x7f6a9406d270 0x7f6a94155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 -- 172.21.15.194:0/3917662252 >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 msgr2=0x7f6a9415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 --2- 172.21.15.194:0/3917662252 >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 0x7f6a9415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 -- 172.21.15.194:0/3917662252 >> v2:172.21.15.123:3300/0 conn(0x7f6a9406d270 msgr2=0x7f6a94155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:15.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 --2- 172.21.15.194:0/3917662252 >> v2:172.21.15.123:3300/0 conn(0x7f6a9406d270 0x7f6a94155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a92ffd640 1 -- 172.21.15.194:0/3917662252 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940c8ad0 con 0x7f6a9406ee60 2024-09-19T09:42:15.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.859+0000 7f6a937fe640 1 --2- 172.21.15.194:0/3917662252 >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 0x7f6a9415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:15.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.860+0000 7f6a92ffd640 1 --2- 172.21.15.194:0/3917662252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 0x7f6a94154ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a940689c0 tx=0x7f6a8402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fae263625e605f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.860+0000 7f6a927fc640 1 -- 172.21.15.194:0/3917662252 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84037070 con 0x7f6a9406ee60 2024-09-19T09:42:15.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.860+0000 7f6a927fc640 1 -- 172.21.15.194:0/3917662252 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a84032440 con 0x7f6a9406ee60 2024-09-19T09:42:15.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.860+0000 7f6a927fc640 1 -- 172.21.15.194:0/3917662252 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84032810 con 0x7f6a9406ee60 2024-09-19T09:42:15.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 -- 172.21.15.194:0/3917662252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 msgr2=0x7f6a94154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/3917662252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 0x7f6a94154ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a940689c0 tx=0x7f6a8402a270 comp rx=0 tx=0).stop 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 -- 172.21.15.194:0/3917662252 shutdown_connections 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/3917662252 >> v2:172.21.15.123:3300/0 conn(0x7f6a9406d270 0x7f6a94155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/3917662252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ee60 0x7f6a94154ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/3917662252 >> v2:172.21.15.194:3300/0 conn(0x7f6a9406ce90 0x7f6a9415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 -- 172.21.15.194:0/3917662252 >> 172.21.15.194:0/3917662252 conn(0x7f6a9406fb20 msgr2=0x7f6a9406ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 -- 172.21.15.194:0/3917662252 shutdown_connections 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.861+0000 7f6a99ee6640 1 -- 172.21.15.194:0/3917662252 wait complete. 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.862+0000 7f6a99ee6640 1 Processor -- start 2024-09-19T09:42:15.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.862+0000 7f6a99ee6640 1 -- start start 2024-09-19T09:42:15.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a99ee6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 0x7f6a94155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a99ee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a9406d270 0x7f6a9415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a99ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9406ee60 0x7f6a941f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a99ee6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9415ebe0 con 0x7f6a9406d270 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a99ee6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9415e900 con 0x7f6a9406ee60 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a99ee6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6a940c9090 con 0x7f6a9406ce90 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 0x7f6a94155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 0x7f6a94155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42126/0 (socket says 172.21.15.194:42126) 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 -- 172.21.15.194:0/4095172921 learned_addr learned my addr 172.21.15.194:0/4095172921 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a93fff640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9406ee60 0x7f6a941f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a92ffd640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a9406d270 0x7f6a9415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 -- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9406ee60 msgr2=0x7f6a941f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9406ee60 0x7f6a941f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 -- 172.21.15.194:0/4095172921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a9406d270 msgr2=0x7f6a9415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a9406d270 0x7f6a9415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 -- 172.21.15.194:0/4095172921 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a941f4ee0 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a937fe640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 0x7f6a94155d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9b0 tx=0x7f6a8800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.863+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88017070 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8800ca00 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9415cf00 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800cdd0 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9415df20 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a8801a070 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6a8801c970 con 0x7f6a9406ce90 2024-09-19T09:42:15.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.864+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9406f910 con 0x7f6a9406ce90 2024-09-19T09:42:15.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.866+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6a9406f910 con 0x7f6a9406ce90 2024-09-19T09:42:15.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.934+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4c04a04-7f30-4053-88a6-e3999460781a", "id": 3} v 0) -- 0x7f6a9415b200 con 0x7f6a9406ce90 2024-09-19T09:42:15.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.939+0000 7f6a7bfff640 1 -- 172.21.15.194:0/4095172921 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4c04a04-7f30-4053-88a6-e3999460781a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6a8801cc90 con 0x7f6a9406ce90 2024-09-19T09:42:15.941 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-19T09:42:15.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 msgr2=0x7f6a94155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:15.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 0x7f6a94155d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9b0 tx=0x7f6a8800ee70 comp rx=0 tx=0).stop 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 shutdown_connections 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9406ee60 0x7f6a941f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a9406d270 0x7f6a9415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 --2- 172.21.15.194:0/4095172921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a9406ce90 0x7f6a94155d10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 >> 172.21.15.194:0/4095172921 conn(0x7f6a9406fb20 msgr2=0x7f6a940700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 shutdown_connections 2024-09-19T09:42:15.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:15.940+0000 7f6a99ee6640 1 -- 172.21.15.194:0/4095172921 wait complete. 2024-09-19T09:42:15.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 400da593-7bbe-4427-8e55-a7d0225a8ff8 4 2024-09-19T09:42:16.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.049+0000 7fea5ff2c640 1 Processor -- start 2024-09-19T09:42:16.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5ff2c640 1 -- start start 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5ff2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea5814e7b0 0x7fea58075a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5ff2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea580c6530 0x7fea580c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5ff2c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea58072340 con 0x7fea5815b440 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5ff2c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fea580c60a0 con 0x7fea5814e7b0 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5ff2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fea580c5a90 con 0x7fea580c6530 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5e4c9640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fea5815b440 0x7fea5815b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56158/0 (socket says 172.21.15.194:56158) 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5e4c9640 1 -- 172.21.15.194:0/2539123759 learned_addr learned my addr 172.21.15.194:0/2539123759 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.050+0000 7fea5d4c7640 1 --2- 172.21.15.194:0/2539123759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea580c6530 0x7fea580c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.051+0000 7fea5dcc8640 1 --2- 172.21.15.194:0/2539123759 >> v2:172.21.15.123:3300/0 conn(0x7fea5814e7b0 0x7fea58075a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.051+0000 7fea5d4c7640 1 -- 172.21.15.194:0/2539123759 >> v2:172.21.15.123:3300/0 conn(0x7fea5814e7b0 msgr2=0x7fea58075a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:16.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.051+0000 7fea5d4c7640 1 --2- 172.21.15.194:0/2539123759 >> v2:172.21.15.123:3300/0 conn(0x7fea5814e7b0 0x7fea58075a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.051+0000 7fea5d4c7640 1 -- 172.21.15.194:0/2539123759 >> v1:172.21.15.194:6789/0 conn(0x7fea5815b440 legacy=0x7fea5815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.051+0000 7fea5d4c7640 1 -- 172.21.15.194:0/2539123759 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea580725e0 con 0x7fea580c6530 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.052+0000 7fea5d4c7640 1 --2- 172.21.15.194:0/2539123759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea580c6530 0x7fea580c6910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fea480097a0 tx=0x7fea4802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc6a46f979147f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.052+0000 7fea5ccc6640 1 -- 172.21.15.194:0/2539123759 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48037070 con 0x7fea580c6530 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.052+0000 7fea5ccc6640 1 -- 172.21.15.194:0/2539123759 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea48032440 con 0x7fea580c6530 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.052+0000 7fea5ccc6640 1 -- 172.21.15.194:0/2539123759 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48032810 con 0x7fea580c6530 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 -- 172.21.15.194:0/2539123759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea580c6530 msgr2=0x7fea580c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/2539123759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea580c6530 0x7fea580c6910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fea480097a0 tx=0x7fea4802a210 comp rx=0 tx=0).stop 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 -- 172.21.15.194:0/2539123759 shutdown_connections 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/2539123759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea580c6530 0x7fea580c6910 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/2539123759 >> v2:172.21.15.123:3300/0 conn(0x7fea5814e7b0 0x7fea58075a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 -- 172.21.15.194:0/2539123759 >> 172.21.15.194:0/2539123759 conn(0x7fea5806bc10 msgr2=0x7fea5806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 -- 172.21.15.194:0/2539123759 shutdown_connections 2024-09-19T09:42:16.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.053+0000 7fea5ff2c640 1 -- 172.21.15.194:0/2539123759 wait complete. 2024-09-19T09:42:16.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.054+0000 7fea5ff2c640 1 Processor -- start 2024-09-19T09:42:16.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.054+0000 7fea5ff2c640 1 -- start start 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea580c6530 0x7fea58156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 0x7fea581511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 0x7fea581578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fea580c6e50 con 0x7fea580c6530 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fea580c5d30 con 0x7fea5815b440 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fea58075f40 con 0x7fea5814e7b0 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5d4c7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 0x7fea581511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 0x7fea581578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5d4c7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 0x7fea581511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42142/0 (socket says 172.21.15.194:42142) 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 0x7fea581578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56426/0 (socket says 172.21.15.194:56426) 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5d4c7640 1 -- 172.21.15.194:0/3748310158 learned_addr learned my addr 172.21.15.194:0/3748310158 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5dcc8640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea580c6530 0x7fea58156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 -- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 msgr2=0x7fea581511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 0x7fea581511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 -- 172.21.15.194:0/3748310158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea580c6530 msgr2=0x7fea58156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea580c6530 0x7fea58156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 -- 172.21.15.194:0/3748310158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58143490 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5d4c7640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 0x7fea581511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5e4c9640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 0x7fea581578d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea5000cad0 tx=0x7fea5000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50017070 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5000ac30 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea581431f0 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50012400 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.055+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea580c87a0 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.056+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea5001a070 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.056+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fea5001ccc0 con 0x7fea5815b440 2024-09-19T09:42:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.056+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea58077460 con 0x7fea5815b440 2024-09-19T09:42:16.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.058+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fea58077460 con 0x7fea5815b440 2024-09-19T09:42:16.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.127+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "400da593-7bbe-4427-8e55-a7d0225a8ff8", "id": 4} v 0) -- 0x7fea5814fd10 con 0x7fea5815b440 2024-09-19T09:42:16.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.133+0000 7fea4e7fc640 1 -- 172.21.15.194:0/3748310158 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "400da593-7bbe-4427-8e55-a7d0225a8ff8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fea5001c880 con 0x7fea5815b440 2024-09-19T09:42:16.135 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 msgr2=0x7fea581578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 0x7fea581578d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea5000cad0 tx=0x7fea5000cf90 comp rx=0 tx=0).stop 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 shutdown_connections 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea5815b440 0x7fea581578d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea5814e7b0 0x7fea581511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 --2- 172.21.15.194:0/3748310158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea580c6530 0x7fea58156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 >> 172.21.15.194:0/3748310158 conn(0x7fea5806bc10 msgr2=0x7fea58154490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 shutdown_connections 2024-09-19T09:42:16.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.134+0000 7fea5ff2c640 1 -- 172.21.15.194:0/3748310158 wait complete. 2024-09-19T09:42:16.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new b48779a9-4c3f-478b-b59d-8a1847604bd6 5 2024-09-19T09:42:16.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.243+0000 7f9b1b359640 1 Processor -- start 2024-09-19T09:42:16.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.243+0000 7f9b1b359640 1 -- start start 2024-09-19T09:42:16.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b1b359640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b141552e0 0x7f9b1415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b1b359640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b140c0a10 0x7f9b1415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b1b359640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1415f340 con 0x7f9b141556c0 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b1b359640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9b14075a00 con 0x7f9b141552e0 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b1b359640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1415f600 con 0x7f9b140c0a10 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b140c0a10 0x7f9b1415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b140c0a10 0x7f9b1415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56438/0 (socket says 172.21.15.194:56438) 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 -- 172.21.15.194:0/9575709 learned_addr learned my addr 172.21.15.194:0/9575709 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b190f5640 1 --2- 172.21.15.194:0/9575709 >> v2:172.21.15.123:3300/0 conn(0x7f9b141552e0 0x7f9b1415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 -- 172.21.15.194:0/9575709 >> v2:172.21.15.123:3300/0 conn(0x7f9b141552e0 msgr2=0x7f9b1415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 --2- 172.21.15.194:0/9575709 >> v2:172.21.15.123:3300/0 conn(0x7f9b141552e0 0x7f9b1415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 -- 172.21.15.194:0/9575709 >> v1:172.21.15.123:6789/0 conn(0x7f9b141556c0 legacy=0x7f9b140c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b188f4640 1 -- 172.21.15.194:0/9575709 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14075cc0 con 0x7f9b140c0a10 2024-09-19T09:42:16.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.244+0000 7f9b190f5640 1 --2- 172.21.15.194:0/9575709 >> v2:172.21.15.123:3300/0 conn(0x7f9b141552e0 0x7f9b1415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:16.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.245+0000 7f9b188f4640 1 --2- 172.21.15.194:0/9575709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b1415bc90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b1406f170 tx=0x7f9b1002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3104fa21b77027c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.245+0000 7f9b0bfff640 1 -- 172.21.15.194:0/9575709 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10037070 con 0x7f9b140c0a10 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.245+0000 7f9b0bfff640 1 -- 172.21.15.194:0/9575709 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b10032440 con 0x7f9b140c0a10 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.245+0000 7f9b0bfff640 1 -- 172.21.15.194:0/9575709 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10032810 con 0x7f9b140c0a10 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 -- 172.21.15.194:0/9575709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 msgr2=0x7f9b1415bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 --2- 172.21.15.194:0/9575709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b1415bc90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b1406f170 tx=0x7f9b1002a270 comp rx=0 tx=0).stop 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 -- 172.21.15.194:0/9575709 shutdown_connections 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 --2- 172.21.15.194:0/9575709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b1415bc90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 --2- 172.21.15.194:0/9575709 >> v2:172.21.15.123:3300/0 conn(0x7f9b141552e0 0x7f9b1415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 -- 172.21.15.194:0/9575709 >> 172.21.15.194:0/9575709 conn(0x7f9b1406bc10 msgr2=0x7f9b1406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 -- 172.21.15.194:0/9575709 shutdown_connections 2024-09-19T09:42:16.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.246+0000 7f9b1b359640 1 -- 172.21.15.194:0/9575709 wait complete. 2024-09-19T09:42:16.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.247+0000 7f9b1b359640 1 Processor -- start 2024-09-19T09:42:16.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.247+0000 7f9b1b359640 1 -- start start 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b141e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b141552e0 0x7f9b14153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b141556c0 0x7f9b141e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14071930 con 0x7f9b141556c0 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1415b1c0 con 0x7f9b140c0a10 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9b14071ab0 con 0x7f9b141552e0 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b141e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b141e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56452/0 (socket says 172.21.15.194:56452) 2024-09-19T09:42:16.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 -- 172.21.15.194:0/4141605962 learned_addr learned my addr 172.21.15.194:0/4141605962 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b188f4640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b141552e0 0x7f9b14153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b198f6640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b141556c0 0x7f9b141e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 -- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b141552e0 msgr2=0x7f9b14153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b141552e0 0x7f9b14153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 -- 172.21.15.194:0/4141605962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b141556c0 msgr2=0x7f9b141e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b141556c0 0x7f9b141e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 -- 172.21.15.194:0/4141605962 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1415d780 con 0x7f9b140c0a10 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b190f5640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b141e7080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400e7e0 tx=0x7f9b0400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400f040 con 0x7f9b140c0a10 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b04004030 con 0x7f9b140c0a10 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1415da60 con 0x7f9b140c0a10 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.248+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04004400 con 0x7f9b140c0a10 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.249+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1415e020 con 0x7f9b140c0a10 2024-09-19T09:42:16.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.249+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9b0400ca60 con 0x7f9b140c0a10 2024-09-19T09:42:16.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.249+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f9b0400cdb0 con 0x7f9b140c0a10 2024-09-19T09:42:16.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.249+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1415bdd0 con 0x7f9b140c0a10 2024-09-19T09:42:16.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.253+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9b1415bdd0 con 0x7f9b140c0a10 2024-09-19T09:42:16.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.322+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b48779a9-4c3f-478b-b59d-8a1847604bd6", "id": 5} v 0) -- 0x7f9b1415b750 con 0x7f9b140c0a10 2024-09-19T09:42:16.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.328+0000 7f9b09ffb640 1 -- 172.21.15.194:0/4141605962 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b48779a9-4c3f-478b-b59d-8a1847604bd6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f9b04017020 con 0x7f9b140c0a10 2024-09-19T09:42:16.330 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-09-19T09:42:16.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.328+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 msgr2=0x7f9b141e7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.328+0000 7f9b1b359640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b141e7080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400e7e0 tx=0x7f9b0400eca0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 shutdown_connections 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b141556c0 0x7f9b141e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b141552e0 0x7f9b14153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 --2- 172.21.15.194:0/4141605962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b140c0a10 0x7f9b141e7080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 >> 172.21.15.194:0/4141605962 conn(0x7f9b1406bc10 msgr2=0x7f9b1414d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 shutdown_connections 2024-09-19T09:42:16.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.329+0000 7f9b1b359640 1 -- 172.21.15.194:0/4141605962 wait complete. 2024-09-19T09:42:16.341 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 0713ee56-1d00-45f2-8c41-1ef47f6cf615 6 2024-09-19T09:42:16.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.437+0000 7fc2b48d7640 1 Processor -- start 2024-09-19T09:42:16.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.437+0000 7fc2b48d7640 1 -- start start 2024-09-19T09:42:16.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2b48d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 0x7fc2b00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2b48d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc2b00cbbe0 0x7fc2b0162880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2b48d7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b0070830 con 0x7fc2b00c8280 2024-09-19T09:42:16.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2b48d7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b0158a20 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2b48d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b0070b10 con 0x7fc2b01521d0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 0x7fc2b00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2ae59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 0x7fc2b00cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42154/0 (socket says 172.21.15.194:42154) 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2ae59c640 1 -- 172.21.15.194:0/4043698128 learned_addr learned my addr 172.21.15.194:0/4043698128 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.438+0000 7fc2aed9d640 1 --2- 172.21.15.194:0/4043698128 >> v2:172.21.15.123:3300/0 conn(0x7fc2b00cbbe0 0x7fc2b0162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2ae59c640 1 -- 172.21.15.194:0/4043698128 >> v2:172.21.15.123:3300/0 conn(0x7fc2b00cbbe0 msgr2=0x7fc2b0162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2ae59c640 1 --2- 172.21.15.194:0/4043698128 >> v2:172.21.15.123:3300/0 conn(0x7fc2b00cbbe0 0x7fc2b0162880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2ae59c640 1 -- 172.21.15.194:0/4043698128 >> v1:172.21.15.123:6789/0 conn(0x7fc2b00c8280 legacy=0x7fc2b006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2ae59c640 1 -- 172.21.15.194:0/4043698128 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b01580f0 con 0x7fc2b01521d0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2ae59c640 1 --2- 172.21.15.194:0/4043698128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 0x7fc2b00cb6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00098a0 tx=0x7fc2a002a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13087ee3d963af15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2add9b640 1 -- 172.21.15.194:0/4043698128 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0037070 con 0x7fc2b01521d0 2024-09-19T09:42:16.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2add9b640 1 -- 172.21.15.194:0/4043698128 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a0032440 con 0x7fc2b01521d0 2024-09-19T09:42:16.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.439+0000 7fc2add9b640 1 -- 172.21.15.194:0/4043698128 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0032810 con 0x7fc2b01521d0 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 -- 172.21.15.194:0/4043698128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 msgr2=0x7fc2b00cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/4043698128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 0x7fc2b00cb6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00098a0 tx=0x7fc2a002a2e0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 -- 172.21.15.194:0/4043698128 shutdown_connections 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/4043698128 >> v2:172.21.15.123:3300/0 conn(0x7fc2b00cbbe0 0x7fc2b0162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/4043698128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b01521d0 0x7fc2b00cb6a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 -- 172.21.15.194:0/4043698128 >> 172.21.15.194:0/4043698128 conn(0x7fc2b006fb20 msgr2=0x7fc2b006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 -- 172.21.15.194:0/4043698128 shutdown_connections 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.440+0000 7fc2b48d7640 1 -- 172.21.15.194:0/4043698128 wait complete. 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.441+0000 7fc2b48d7640 1 Processor -- start 2024-09-19T09:42:16.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 -- start start 2024-09-19T09:42:16.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00c8280 0x7fc2b0155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 0x7fc2b0157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b01521d0 0x7fc2b01e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b0158eb0 con 0x7fc2b00c8280 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01586b0 con 0x7fc2b01521d0 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2b48d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b006eff0 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2a7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 0x7fc2b0157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2aed9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b01521d0 0x7fc2b01e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2a7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 0x7fc2b0157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42166/0 (socket says 172.21.15.194:42166) 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2a7fff640 1 -- 172.21.15.194:0/3291690595 learned_addr learned my addr 172.21.15.194:0/3291690595 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.442+0000 7fc2ae59c640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00c8280 0x7fc2b0155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a7fff640 1 -- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b01521d0 msgr2=0x7fc2b01e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a7fff640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b01521d0 0x7fc2b01e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a7fff640 1 -- 172.21.15.194:0/3291690595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00c8280 msgr2=0x7fc2b0155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a7fff640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00c8280 0x7fc2b0155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a7fff640 1 -- 172.21.15.194:0/3291690595 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b00684f0 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2aed9d640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b01521d0 0x7fc2b01e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2ae59c640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00c8280 0x7fc2b0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a7fff640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 0x7fc2b0157880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc29800b3f0 tx=0x7fc29800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298015020 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc298011830 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b00687b0 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298011c20 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b01f1cd0 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc298018020 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.443+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc29801a9f0 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.444+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b00c4980 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.446+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc29801f030 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.515+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0713ee56-1d00-45f2-8c41-1ef47f6cf615", "id": 6} v 0) -- 0x7fc2b00c4550 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.520+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/3291690595 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0713ee56-1d00-45f2-8c41-1ef47f6cf615", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc29801a400 con 0x7fc2b00cbbe0 2024-09-19T09:42:16.522 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.520+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 msgr2=0x7fc2b0157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 0x7fc2b0157880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc29800b3f0 tx=0x7fc29800b8b0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 shutdown_connections 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b01521d0 0x7fc2b01e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b00cbbe0 0x7fc2b0157880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 --2- 172.21.15.194:0/3291690595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00c8280 0x7fc2b0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 >> 172.21.15.194:0/3291690595 conn(0x7fc2b006fb20 msgr2=0x7fc2b0073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 shutdown_connections 2024-09-19T09:42:16.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.521+0000 7fc2b48d7640 1 -- 172.21.15.194:0/3291690595 wait complete. 2024-09-19T09:42:16.533 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new cda99eb2-00e3-480a-8893-f9578f04a092 7 2024-09-19T09:42:16.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.630+0000 7f40b1728640 1 Processor -- start 2024-09-19T09:42:16.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.630+0000 7f40b1728640 1 -- start start 2024-09-19T09:42:16.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40b1728640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40ac1551d0 0x7f40ac15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40b1728640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40ac1555b0 0x7f40ac0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40b1728640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ac15e620 con 0x7f40ac15f300 2024-09-19T09:42:16.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40b1728640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f40ac0c5c50 con 0x7f40ac1555b0 2024-09-19T09:42:16.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40b1728640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f40ac15b5f0 con 0x7f40ac1551d0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40ac1551d0 0x7f40ac15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40ac1551d0 0x7f40ac15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56468/0 (socket says 172.21.15.194:56468) 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 -- 172.21.15.194:0/974107093 learned_addr learned my addr 172.21.15.194:0/974107093 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aa7fc640 1 --2- 172.21.15.194:0/974107093 >> v2:172.21.15.123:3300/0 conn(0x7f40ac1555b0 0x7f40ac0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 -- 172.21.15.194:0/974107093 >> v2:172.21.15.123:3300/0 conn(0x7f40ac1555b0 msgr2=0x7f40ac0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 --2- 172.21.15.194:0/974107093 >> v2:172.21.15.123:3300/0 conn(0x7f40ac1555b0 0x7f40ac0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 -- 172.21.15.194:0/974107093 >> v1:172.21.15.123:6789/0 conn(0x7f40ac15f300 legacy=0x7f40ac06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.631+0000 7f40aaffd640 1 -- 172.21.15.194:0/974107093 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac15b8d0 con 0x7f40ac1551d0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.632+0000 7f40aaffd640 1 --2- 172.21.15.194:0/974107093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac1551d0 0x7f40ac15edc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06d4c0 tx=0x7f40a002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d6652f67c5a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.632+0000 7f40a9ffb640 1 -- 172.21.15.194:0/974107093 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0037070 con 0x7f40ac1551d0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.632+0000 7f40a9ffb640 1 -- 172.21.15.194:0/974107093 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a002ae50 con 0x7f40ac1551d0 2024-09-19T09:42:16.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.632+0000 7f40a9ffb640 1 -- 172.21.15.194:0/974107093 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0032860 con 0x7f40ac1551d0 2024-09-19T09:42:16.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 -- 172.21.15.194:0/974107093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac1551d0 msgr2=0x7f40ac15edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 --2- 172.21.15.194:0/974107093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac1551d0 0x7f40ac15edc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06d4c0 tx=0x7f40a002a300 comp rx=0 tx=0).stop 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 -- 172.21.15.194:0/974107093 shutdown_connections 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 --2- 172.21.15.194:0/974107093 >> v2:172.21.15.123:3300/0 conn(0x7f40ac1555b0 0x7f40ac0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 --2- 172.21.15.194:0/974107093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac1551d0 0x7f40ac15edc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 -- 172.21.15.194:0/974107093 >> 172.21.15.194:0/974107093 conn(0x7f40ac0d0e10 msgr2=0x7f40ac0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 -- 172.21.15.194:0/974107093 shutdown_connections 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.633+0000 7f40b1728640 1 -- 172.21.15.194:0/974107093 wait complete. 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.634+0000 7f40b1728640 1 Processor -- start 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.634+0000 7f40b1728640 1 -- start start 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40b1728640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 0x7f40ac1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40b1728640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40ac1555b0 0x7f40ac0b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40b1728640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 0x7f40ac1f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40b1728640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac15e8a0 con 0x7f40ac1555b0 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40b1728640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac15be90 con 0x7f40ac15f300 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40b1728640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f40ac06cde0 con 0x7f40ac1551d0 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40aaffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 0x7f40ac1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 0x7f40ac1f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40aaffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 0x7f40ac1f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:42180/0 (socket says 172.21.15.194:42180) 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 0x7f40ac1f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:56478/0 (socket says 172.21.15.194:56478) 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40aaffd640 1 -- 172.21.15.194:0/125164574 learned_addr learned my addr 172.21.15.194:0/125164574 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40aa7fc640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40ac1555b0 0x7f40ac0b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 -- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 msgr2=0x7f40ac1f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 0x7f40ac1f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 -- 172.21.15.194:0/125164574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40ac1555b0 msgr2=0x7f40ac0b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40ac1555b0 0x7f40ac0b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 -- 172.21.15.194:0/125164574 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac1f2520 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40aaffd640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 0x7f40ac1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.635+0000 7f40ab7fe640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 0x7f40ac1f2ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c700 tx=0x7f40a400cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4003b70 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a4003d10 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac15d210 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4005310 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac15d7d0 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f40a40054b0 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.636+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f40a4012a80 con 0x7f40ac15f300 2024-09-19T09:42:16.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.637+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ac15b080 con 0x7f40ac15f300 2024-09-19T09:42:16.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.639+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f40ac15e620 con 0x7f40ac15f300 2024-09-19T09:42:16.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.708+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cda99eb2-00e3-480a-8893-f9578f04a092", "id": 7} v 0) -- 0x7f40ac0cc070 con 0x7f40ac15f300 2024-09-19T09:42:16.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.717+0000 7f40937fe640 1 -- 172.21.15.194:0/125164574 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cda99eb2-00e3-480a-8893-f9578f04a092", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f40a4012d60 con 0x7f40ac15f300 2024-09-19T09:42:16.719 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-09-19T09:42:16.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 msgr2=0x7f40ac1f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 0x7f40ac1f2ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c700 tx=0x7f40a400cbc0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 shutdown_connections 2024-09-19T09:42:16.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40ac15f300 0x7f40ac1f2ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40ac1555b0 0x7f40ac0b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 --2- 172.21.15.194:0/125164574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40ac1551d0 0x7f40ac1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 >> 172.21.15.194:0/125164574 conn(0x7f40ac0d0e10 msgr2=0x7f40ac0cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 shutdown_connections 2024-09-19T09:42:16.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T09:42:16.718+0000 7f40b1728640 1 -- 172.21.15.194:0/125164574 wait complete. 2024-09-19T09:42:16.730 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T09:42:16.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T09:42:16.733 INFO:tasks.ceph.osd.0:Started 2024-09-19T09:42:16.733 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T09:42:16.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T09:42:16.735 INFO:tasks.ceph.osd.1:Started 2024-09-19T09:42:16.735 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T09:42:16.735 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T09:42:16.738 INFO:tasks.ceph.osd.2:Started 2024-09-19T09:42:16.738 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T09:42:16.738 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T09:42:16.740 INFO:tasks.ceph.osd.3:Started 2024-09-19T09:42:16.740 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T09:42:16.740 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T09:42:16.743 INFO:tasks.ceph.osd.4:Started 2024-09-19T09:42:16.743 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T09:42:16.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T09:42:16.745 INFO:tasks.ceph.osd.5:Started 2024-09-19T09:42:16.745 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T09:42:16.745 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T09:42:16.747 INFO:tasks.ceph.osd.6:Started 2024-09-19T09:42:16.747 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T09:42:16.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T09:42:16.750 INFO:tasks.ceph.osd.7:Started 2024-09-19T09:42:16.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:16.753 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:16.751+0000 7f213c5d4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:42:16.835 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:16.833+0000 7f213c5d4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:42:16.854 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:16.852+0000 7fd7e1320040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:42:16.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.877+0000 7fd2760a4640 1 Processor -- start 2024-09-19T09:42:16.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.877+0000 7fd2760a4640 1 -- start start 2024-09-19T09:42:16.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd2760a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd270153460 0x7fd270158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd2760a4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd270161860 0x7fd270163c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd2760a4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd270073b70 con 0x7fd2700cd3a0 2024-09-19T09:42:16.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd2760a4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd270074130 con 0x7fd270161860 2024-09-19T09:42:16.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd2760a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd270073e50 con 0x7fd270153460 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd270161860 0x7fd270163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd270161860 0x7fd270163c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45388/0 (socket says 172.21.15.123:45388) 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 -- 172.21.15.123:0/3909246305 learned_addr learned my addr 172.21.15.123:0/3909246305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26f7fe640 1 --2- 172.21.15.123:0/3909246305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd270153460 0x7fd270158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 -- 172.21.15.123:0/3909246305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd270153460 msgr2=0x7fd270158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 --2- 172.21.15.123:0/3909246305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd270153460 0x7fd270158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 -- 172.21.15.123:0/3909246305 >> v1:172.21.15.194:6789/0 conn(0x7fd2700cd3a0 legacy=0x7fd2700c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.878+0000 7fd26ffff640 1 -- 172.21.15.123:0/3909246305 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2700cc8c0 con 0x7fd270161860 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.879+0000 7fd26ffff640 1 --2- 172.21.15.123:0/3909246305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd270163c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd268009e50 tx=0x7fd26802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56edb83345faf927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.879+0000 7fd26e7fc640 1 -- 172.21.15.123:0/3909246305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd268036070 con 0x7fd270161860 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.879+0000 7fd26e7fc640 1 -- 172.21.15.123:0/3909246305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd268031600 con 0x7fd270161860 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.879+0000 7fd26e7fc640 1 -- 172.21.15.123:0/3909246305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680319d0 con 0x7fd270161860 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 -- 172.21.15.123:0/3909246305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 msgr2=0x7fd270163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 --2- 172.21.15.123:0/3909246305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd270163c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd268009e50 tx=0x7fd26802a680 comp rx=0 tx=0).stop 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 -- 172.21.15.123:0/3909246305 shutdown_connections 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 --2- 172.21.15.123:0/3909246305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd270163c50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 --2- 172.21.15.123:0/3909246305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd270153460 0x7fd270158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 -- 172.21.15.123:0/3909246305 >> 172.21.15.123:0/3909246305 conn(0x7fd2700ca380 msgr2=0x7fd2700ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 -- 172.21.15.123:0/3909246305 shutdown_connections 2024-09-19T09:42:16.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.880+0000 7fd2760a4640 1 -- 172.21.15.123:0/3909246305 wait complete. 2024-09-19T09:42:16.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.881+0000 7fd2760a4640 1 Processor -- start 2024-09-19T09:42:16.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.881+0000 7fd2760a4640 1 -- start start 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd2760a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2700cd3a0 0x7fd2701500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd2760a4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd270153460 0x7fd2701efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd2760a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd27014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd2760a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701594b0 con 0x7fd270161860 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd2760a4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd2700cce80 con 0x7fd270153460 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd2760a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd2700caea0 con 0x7fd2700cd3a0 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd27014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd27014b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45400/0 (socket says 172.21.15.123:45400) 2024-09-19T09:42:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 -- 172.21.15.123:0/1111558138 learned_addr learned my addr 172.21.15.123:0/1111558138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26f7fe640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2700cd3a0 0x7fd2701500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26effd640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd270153460 0x7fd2701efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 -- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2700cd3a0 msgr2=0x7fd2701500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2700cd3a0 0x7fd2701500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 -- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd270153460 msgr2=0x7fd2701efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd270153460 0x7fd2701efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 -- 172.21.15.123:0/1111558138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd270146f90 con 0x7fd270161860 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd26ffff640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd27014b2e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd268009f70 tx=0x7fd268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.882+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26803f020 con 0x7fd270161860 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.883+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd268037040 con 0x7fd270161860 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.883+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd268036070 con 0x7fd270161860 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.883+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2701ef470 con 0x7fd270161860 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.883+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27014a060 con 0x7fd270161860 2024-09-19T09:42:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.883+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd268042020 con 0x7fd270161860 2024-09-19T09:42:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.883+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd268044cb0 con 0x7fd270161860 2024-09-19T09:42:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.884+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd270067950 con 0x7fd270161860 2024-09-19T09:42:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.886+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd268049030 con 0x7fd270161860 2024-09-19T09:42:16.907 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:16.905+0000 7fd7e1320040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:42:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.944+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd27014f690 con 0x7fd270161860 2024-09-19T09:42:16.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.945+0000 7fd267fff640 1 -- 172.21.15.123:0/1111558138 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd268007bf0 con 0x7fd270161860 2024-09-19T09:42:16.947 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:16.947 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:16.710645+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 msgr2=0x7fd27014b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd27014b2e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd268009f70 tx=0x7fd268004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 shutdown_connections 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd270161860 0x7fd27014b2e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd270153460 0x7fd2701efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 --2- 172.21.15.123:0/1111558138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2700cd3a0 0x7fd2701500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 >> 172.21.15.123:0/1111558138 conn(0x7fd2700ca380 msgr2=0x7fd2700ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 shutdown_connections 2024-09-19T09:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:16.946+0000 7fd2760a4640 1 -- 172.21.15.123:0/1111558138 wait complete. 2024-09-19T09:42:16.958 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T09:42:16.958 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T09:42:17.209 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.207+0000 7f213c5d4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:42:17.273 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.271+0000 7fd7e1320040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:42:17.293 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.291+0000 7f213c5d4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:42:17.356 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.354+0000 7fd7e1320040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:42:17.401 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.399+0000 7f213c5d4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:42:17.448 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.446+0000 7f213c5d4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:42:17.463 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.461+0000 7fd7e1320040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:42:17.509 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.507+0000 7fd7e1320040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:42:17.559 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.558+0000 7f213c5d4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:42:17.611 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.610+0000 7f213c5d4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:42:17.621 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.619+0000 7fd7e1320040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:42:17.657 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.655+0000 7f213c5d4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:42:17.677 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.675+0000 7fd7e1320040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:42:17.723 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.721+0000 7fd7e1320040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:42:17.764 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:17.772 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.770+0000 7f213c5d4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:42:17.824 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.822+0000 7f213c5d4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:42:17.834 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.832+0000 7fd7e1320040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:42:17.854 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.852+0000 7f73e400a640 1 Processor -- start 2024-09-19T09:42:17.854 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.852+0000 7f73e400a640 1 -- start start 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e400a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73dc151f90 0x7f73dc06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e400a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f73dc0c9d00 0x7f73dc0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e400a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73dc0ca130 con 0x7f73dc0ccc30 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e400a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f73dc0c8980 con 0x7f73dc151f90 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e400a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f73dc0c8c60 con 0x7f73dc0c9d00 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73dc151f90 0x7f73dc06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:17.856 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73dc151f90 0x7f73dc06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45404/0 (socket says 172.21.15.123:45404) 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 -- 172.21.15.123:0/1770129822 learned_addr learned my addr 172.21.15.123:0/1770129822 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e15a5640 1 --2- 172.21.15.123:0/1770129822 >> v2:172.21.15.194:3300/0 conn(0x7f73dc0c9d00 0x7f73dc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 -- 172.21.15.123:0/1770129822 >> v2:172.21.15.194:3300/0 conn(0x7f73dc0c9d00 msgr2=0x7f73dc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 --2- 172.21.15.123:0/1770129822 >> v2:172.21.15.194:3300/0 conn(0x7f73dc0c9d00 0x7f73dc0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 -- 172.21.15.123:0/1770129822 >> v1:172.21.15.194:6789/0 conn(0x7f73dc0ccc30 legacy=0x7f73dc157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e1da6640 1 -- 172.21.15.123:0/1770129822 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc0c8f40 con 0x7f73dc151f90 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.853+0000 7f73e15a5640 1 --2- 172.21.15.123:0/1770129822 >> v2:172.21.15.194:3300/0 conn(0x7f73dc0c9d00 0x7f73dc0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.854+0000 7f73e1da6640 1 --2- 172.21.15.123:0/1770129822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc06bb90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06f4d0 tx=0x7f73d002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ee9f0de695d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:17.857 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.854+0000 7f73e0da4640 1 -- 172.21.15.123:0/1770129822 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0037070 con 0x7f73dc151f90 2024-09-19T09:42:17.858 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.854+0000 7f73e0da4640 1 -- 172.21.15.123:0/1770129822 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d002ae50 con 0x7f73dc151f90 2024-09-19T09:42:17.858 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.854+0000 7f73e0da4640 1 -- 172.21.15.123:0/1770129822 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0032860 con 0x7f73dc151f90 2024-09-19T09:42:17.861 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 -- 172.21.15.123:0/1770129822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 msgr2=0x7f73dc06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:17.861 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 --2- 172.21.15.123:0/1770129822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc06bb90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06f4d0 tx=0x7f73d002a300 comp rx=0 tx=0).stop 2024-09-19T09:42:17.861 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 -- 172.21.15.123:0/1770129822 shutdown_connections 2024-09-19T09:42:17.861 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 --2- 172.21.15.123:0/1770129822 >> v2:172.21.15.194:3300/0 conn(0x7f73dc0c9d00 0x7f73dc0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.861 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 --2- 172.21.15.123:0/1770129822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc06bb90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.861 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 -- 172.21.15.123:0/1770129822 >> 172.21.15.123:0/1770129822 conn(0x7f73dc0ca3f0 msgr2=0x7f73dc0ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 -- 172.21.15.123:0/1770129822 shutdown_connections 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.855+0000 7f73e400a640 1 -- 172.21.15.123:0/1770129822 wait complete. 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.856+0000 7f73e400a640 1 Processor -- start 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.856+0000 7f73e400a640 1 -- start start 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73dc0c9d00 0x7f73dc157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73dc0ccc30 0x7f73dc158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc1f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0c97e0 con 0x7f73dc151f90 2024-09-19T09:42:17.862 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0c9500 con 0x7f73dc0ccc30 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc152370 con 0x7f73dc0c9d00 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc1f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc1f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45412/0 (socket says 172.21.15.123:45412) 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e15a5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73dc0ccc30 0x7f73dc158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 -- 172.21.15.123:0/2603890172 learned_addr learned my addr 172.21.15.123:0/2603890172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e1da6640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73dc0c9d00 0x7f73dc157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 -- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73dc0c9d00 msgr2=0x7f73dc157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73dc0c9d00 0x7f73dc157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 -- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73dc0ccc30 msgr2=0x7f73dc158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73dc0ccc30 0x7f73dc158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.863 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 -- 172.21.15.123:0/2603890172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc0c3ef0 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e25a7640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc1f45a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c7d0 tx=0x7f73d400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d4003b70 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d4003d30 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d400aa30 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73dc0c4190 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.857+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73dc159440 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.858+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f73d400abd0 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.858+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f73d4012c80 con 0x7f73dc151f90 2024-09-19T09:42:17.864 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.858+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73dc0cc6f0 con 0x7f73dc151f90 2024-09-19T09:42:17.865 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.860+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f73d40125b0 con 0x7f73dc151f90 2024-09-19T09:42:17.878 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.876+0000 7f213c5d4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:42:17.884 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.882+0000 7fd7e1320040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:42:17.920 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.918+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73dc0caff0 con 0x7f73dc151f90 2024-09-19T09:42:17.920 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.919+0000 7f73ce7fc640 1 -- 172.21.15.123:0/2603890172 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f73d4012790 con 0x7f73dc151f90 2024-09-19T09:42:17.921 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-19T09:42:17.921 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:16.710645+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 msgr2=0x7f73dc1f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc1f45a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c7d0 tx=0x7f73d400cc90 comp rx=0 tx=0).stop 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 shutdown_connections 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73dc151f90 0x7f73dc1f45a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73dc0ccc30 0x7f73dc158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 --2- 172.21.15.123:0/2603890172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73dc0c9d00 0x7f73dc157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:17.922 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 >> 172.21.15.123:0/2603890172 conn(0x7f73dc0ca3f0 msgr2=0x7f73dc0c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:17.923 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 shutdown_connections 2024-09-19T09:42:17.923 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:17.920+0000 7f73e400a640 1 -- 172.21.15.123:0/2603890172 wait complete. 2024-09-19T09:42:17.931 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T09:42:17.937 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:17.935+0000 7fd7e1320040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:42:17.948 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.946+0000 7f213c5d4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:42:17.993 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:17.991+0000 7f213c5d4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:42:18.003 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:18.001+0000 7fd7e1320040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:42:18.037 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:18.036+0000 7f213c5d4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:42:18.047 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:18.046+0000 7fd7e1320040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:42:18.091 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:18.090+0000 7fd7e1320040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:42:18.200 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-19T09:42:18.198+0000 7fa6e8433640 -1 Falling back to public interface 2024-09-19T09:42:18.201 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-19T09:42:18.198+0000 7f9d051dd640 -1 Falling back to public interface 2024-09-19T09:42:18.201 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-19T09:42:18.198+0000 7f9d04185640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-19T09:42:18.201 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-19T09:42:18.198+0000 7f9d04185640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2024-09-19T09:42:18.434 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-19T09:42:18.432+0000 7f5b3aa12640 -1 Falling back to public interface 2024-09-19T09:42:18.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-19T09:42:18.436+0000 7f4adb816640 -1 Falling back to public interface 2024-09-19T09:42:18.497 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-19T09:42:18.495+0000 7f42ec1c5640 -1 Falling back to public interface 2024-09-19T09:42:18.689 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:18.687+0000 7f213c5d4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:42:18.694 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-19T09:42:18.692+0000 7f14f300b640 -1 Falling back to public interface 2024-09-19T09:42:18.715 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-19T09:42:18.713+0000 7fa5f0e1a640 -1 Falling back to public interface 2024-09-19T09:42:18.732 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-19T09:42:18.730+0000 7f4b8ee16640 -1 Falling back to public interface 2024-09-19T09:42:18.757 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-19T09:42:18.755+0000 7fd7e1320040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:42:19.701 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:19.699+0000 7f20dce9b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T09:42:19.701 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-19T09:42:19.700+0000 7f20dce9b640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T09:42:22.521 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-19T09:42:22.520+0000 7f9d051dd640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:42:22.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-19T09:42:22.716+0000 7f5b3aa12640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:42:22.744 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-19T09:42:22.742+0000 7fa6e8433640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:42:23.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-19T09:42:23.002+0000 7f4b8ee16640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:42:23.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-19T09:42:23.031+0000 7f4adb816640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:42:23.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-19T09:42:23.047+0000 7fa5f0e1a640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:42:23.085 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-19T09:42:23.084+0000 7f42ec1c5640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:42:23.179 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-19T09:42:23.177+0000 7f14f300b640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:42:24.576 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-19T09:42:24.574+0000 7f9d00949640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:42:24.590 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-19T09:42:24.589+0000 7f9cf8f7b640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:24.737 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:24.836 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.834+0000 7fd3d3b59640 1 Processor -- start 2024-09-19T09:42:24.836 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.834+0000 7fd3d3b59640 1 -- start start 2024-09-19T09:42:24.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d3b59640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3cc0b4dd0 0x7fd3cc1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d3b59640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3cc0c3ff0 con 0x7fd3cc076010 2024-09-19T09:42:24.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d3b59640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3cc0c42d0 con 0x7fd3cc153000 2024-09-19T09:42:24.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d3b59640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd3cc0c45b0 con 0x7fd3cc0b4dd0 2024-09-19T09:42:24.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d10f4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3cc0b4dd0 0x7fd3cc1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d10f4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3cc0b4dd0 0x7fd3cc1598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41908/0 (socket says 172.21.15.123:41908) 2024-09-19T09:42:24.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d10f4640 1 -- 172.21.15.123:0/3767190892 learned_addr learned my addr 172.21.15.123:0/3767190892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:24.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d10f4640 1 -- 172.21.15.123:0/3767190892 >> v1:172.21.15.194:6789/0 conn(0x7fd3cc153000 legacy=0x7fd3cc06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d10f4640 1 -- 172.21.15.123:0/3767190892 >> v1:172.21.15.123:6789/0 conn(0x7fd3cc076010 legacy=0x7fd3cc0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.835+0000 7fd3d10f4640 1 -- 172.21.15.123:0/3767190892 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc0c4890 con 0x7fd3cc0b4dd0 2024-09-19T09:42:24.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.836+0000 7fd3d10f4640 1 --2- 172.21.15.123:0/3767190892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc1598b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009870 tx=0x7fd3bc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df054da42e47144e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.836+0000 7fd3d08f3640 1 -- 172.21.15.123:0/3767190892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc037070 con 0x7fd3cc0b4dd0 2024-09-19T09:42:24.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.836+0000 7fd3d08f3640 1 -- 172.21.15.123:0/3767190892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc02ae50 con 0x7fd3cc0b4dd0 2024-09-19T09:42:24.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.836+0000 7fd3d08f3640 1 -- 172.21.15.123:0/3767190892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc032860 con 0x7fd3cc0b4dd0 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3767190892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc0b4dd0 msgr2=0x7fd3cc1598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3767190892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc1598b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009870 tx=0x7fd3bc02a300 comp rx=0 tx=0).stop 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3767190892 shutdown_connections 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3767190892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc1598b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3767190892 >> 172.21.15.123:0/3767190892 conn(0x7fd3cc0cb610 msgr2=0x7fd3cc0cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3767190892 shutdown_connections 2024-09-19T09:42:24.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.837+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3767190892 wait complete. 2024-09-19T09:42:24.842 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.838+0000 7fd3d3b59640 1 Processor -- start 2024-09-19T09:42:24.842 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.838+0000 7fd3d3b59640 1 -- start start 2024-09-19T09:42:24.842 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d3b59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d3b59640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3cc153000 0x7fd3cc155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d3b59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 0x7fd3cc15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d3b59640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1533e0 con 0x7fd3cc15ace0 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d3b59640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0c4b70 con 0x7fd3cc0b4dd0 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d3b59640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd3cc153560 con 0x7fd3cc153000 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 0x7fd3cc15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 0x7fd3cc15a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41910/0 (socket says 172.21.15.123:41910) 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 -- 172.21.15.123:0/3645210326 learned_addr learned my addr 172.21.15.123:0/3645210326 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d18f5640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d10f4640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3cc153000 0x7fd3cc155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.843 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 -- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3cc153000 msgr2=0x7fd3cc155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3cc153000 0x7fd3cc155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 -- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0b4dd0 msgr2=0x7fd3cc154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.839+0000 7fd3d20f6640 1 -- 172.21.15.123:0/3645210326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc153850 con 0x7fd3cc15ace0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.840+0000 7fd3d20f6640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 0x7fd3cc15a020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c730 tx=0x7fd3c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.840+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4003b70 con 0x7fd3cc15ace0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.840+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c4003d10 con 0x7fd3cc15ace0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.840+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc153b30 con 0x7fd3cc15ace0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.840+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400aa90 con 0x7fd3cc15ace0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.840+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc1540f0 con 0x7fd3cc15ace0 2024-09-19T09:42:24.844 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.841+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3cc0c8bd0 con 0x7fd3cc15ace0 2024-09-19T09:42:24.845 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.841+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7fd3c400ac30 con 0x7fd3cc15ace0 2024-09-19T09:42:24.845 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.842+0000 7fd3c27fc640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd3b006c220 0x7fd3b006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.845 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.842+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7fd3c408a3e0 con 0x7fd3cc15ace0 2024-09-19T09:42:24.845 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.842+0000 7fd3d18f5640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd3b006c220 0x7fd3b006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.846 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.842+0000 7fd3d18f5640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd3b006c220 0x7fd3b006e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8000f60 tx=0x7fd3c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.848 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:24.847+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd3cc0c8bd0 con 0x7fd3cc15ace0 2024-09-19T09:42:25.047 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.045+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3cc158840 con 0x7fd3cc15ace0 2024-09-19T09:42:25.048 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.046+0000 7fd3c27fc640 1 -- 172.21.15.123:0/3645210326 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7fd3cc158840 con 0x7fd3cc15ace0 2024-09-19T09:42:25.048 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-19T09:42:25.048 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":13,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:24.711852+0000","last_up_change":"2024-09-19T09:42:24.711852+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:25.050 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd3b006c220 msgr2=0x7fd3b006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:25.050 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd3b006c220 0x7fd3b006e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8000f60 tx=0x7fd3c8009040 comp rx=0 tx=0).stop 2024-09-19T09:42:25.050 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 msgr2=0x7fd3cc15a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:25.050 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 0x7fd3cc15a020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c730 tx=0x7fd3c400cbf0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 shutdown_connections 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3cc15ace0 0x7fd3cc15a020 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd3b006c220 0x7fd3b006e6e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3cc153000 0x7fd3cc155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 --2- 172.21.15.123:0/3645210326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3cc0b4dd0 0x7fd3cc154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 >> 172.21.15.123:0/3645210326 conn(0x7fd3cc0cb610 msgr2=0x7fd3cc06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 shutdown_connections 2024-09-19T09:42:25.051 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:25.048+0000 7fd3d3b59640 1 -- 172.21.15.123:0/3645210326 wait complete. 2024-09-19T09:42:25.060 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-19T09:42:26.396 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-19T09:42:26.395+0000 7f42e7931640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:42:26.408 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-19T09:42:26.407+0000 7f42dff63640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:26.433 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-19T09:42:26.431+0000 7f4b89e7c640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:42:26.437 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-19T09:42:26.435+0000 7fa6e4bd6640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:42:26.448 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-19T09:42:26.447+0000 7f4b824ae640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:26.449 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-19T09:42:26.448+0000 7fa6dc1d1640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:26.789 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-19T09:42:26.787+0000 7f14ee1b6640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:42:26.800 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-19T09:42:26.799+0000 7f4ad69be640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:42:26.803 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-19T09:42:26.801+0000 7f14e67e8640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:26.820 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-19T09:42:26.818+0000 7f4aceff0640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:26.823 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-19T09:42:26.822+0000 7f5b35c00640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:42:26.826 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-19T09:42:26.824+0000 7fa5ebfc5640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:42:26.836 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-19T09:42:26.835+0000 7f5b2e232640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:26.840 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-19T09:42:26.839+0000 7fa5e45f7640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:42:31.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:42:31.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:42:31.867 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:31.960 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.958+0000 7fdbe7f0c640 1 Processor -- start 2024-09-19T09:42:31.960 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe7f0c640 1 -- start start 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe7f0c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdbe015ee10 0x7fdbe015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe7f0c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdbe0073a20 0x7fdbe0155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe7f0c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe00b43e0 con 0x7fdbe015ea30 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe7f0c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe00cce10 con 0x7fdbe015ee10 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe7f0c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe00cda60 con 0x7fdbe0073a20 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.959+0000 7fdbe54a7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdbe015ee10 0x7fdbe015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe54a7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdbe015ee10 0x7fdbe015f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41938/0 (socket says 172.21.15.123:41938) 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe54a7640 1 -- 172.21.15.123:0/3771668514 learned_addr learned my addr 172.21.15.123:0/3771668514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe64a9640 1 --2- 172.21.15.123:0/3771668514 >> v2:172.21.15.194:3300/0 conn(0x7fdbe0073a20 0x7fdbe0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:31.962 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe54a7640 1 -- 172.21.15.123:0/3771668514 >> v2:172.21.15.194:3300/0 conn(0x7fdbe0073a20 msgr2=0x7fdbe0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:31.963 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe54a7640 1 --2- 172.21.15.123:0/3771668514 >> v2:172.21.15.194:3300/0 conn(0x7fdbe0073a20 0x7fdbe0155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:31.963 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe54a7640 1 -- 172.21.15.123:0/3771668514 >> v1:172.21.15.123:6789/0 conn(0x7fdbe015ea30 legacy=0x7fdbe00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:31.963 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe4ca6640 1 -- 172.21.15.123:0/3771668514 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359449062 0 0) 0x7fdbe00b43e0 con 0x7fdbe015ea30 2024-09-19T09:42:31.963 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.960+0000 7fdbe54a7640 1 -- 172.21.15.123:0/3771668514 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe0073e60 con 0x7fdbe015ee10 2024-09-19T09:42:31.964 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe54a7640 1 --2- 172.21.15.123:0/3771668514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe015f2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00cdbe0 tx=0x7fdbdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824f97516572819f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:31.964 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe4ca6640 1 -- 172.21.15.123:0/3771668514 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc037070 con 0x7fdbe015ee10 2024-09-19T09:42:31.964 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe4ca6640 1 -- 172.21.15.123:0/3771668514 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc032440 con 0x7fdbe015ee10 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe4ca6640 1 -- 172.21.15.123:0/3771668514 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc032810 con 0x7fdbe015ee10 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3771668514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 msgr2=0x7fdbe015f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3771668514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe015f2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00cdbe0 tx=0x7fdbdc02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3771668514 shutdown_connections 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3771668514 >> v2:172.21.15.194:3300/0 conn(0x7fdbe0073a20 0x7fdbe0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3771668514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe015f2c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3771668514 >> 172.21.15.123:0/3771668514 conn(0x7fdbe006d390 msgr2=0x7fdbe0073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3771668514 shutdown_connections 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.961+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3771668514 wait complete. 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.962+0000 7fdbe7f0c640 1 Processor -- start 2024-09-19T09:42:31.965 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.962+0000 7fdbe7f0c640 1 -- start start 2024-09-19T09:42:31.968 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe7f0c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0073a20 0x7fdbe01f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:31.968 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe7f0c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbe015ea30 0x7fdbe00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:31.968 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe7f0c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe0151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:31.968 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe7f0c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe006bcc0 con 0x7fdbe015ee10 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe7f0c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00cdf90 con 0x7fdbe0073a20 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe7f0c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe006bfa0 con 0x7fdbe015ea30 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe64a9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe64a9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe0151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41948/0 (socket says 172.21.15.123:41948) 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe64a9640 1 -- 172.21.15.123:0/3005945307 learned_addr learned my addr 172.21.15.123:0/3005945307 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe5ca8640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0073a20 0x7fdbe01f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe54a7640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbe015ea30 0x7fdbe00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.963+0000 7fdbe64a9640 1 -- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbe015ea30 msgr2=0x7fdbe00c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe64a9640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbe015ea30 0x7fdbe00c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe64a9640 1 -- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0073a20 msgr2=0x7fdbe01f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe64a9640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0073a20 0x7fdbe01f0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe64a9640 1 -- 172.21.15.123:0/3005945307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe00c8330 con 0x7fdbe015ee10 2024-09-19T09:42:31.969 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe64a9640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe0151190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007e70 tx=0x7fdbd800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8014620 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd8019070 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8014a20 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe00c8610 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.964+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe00c8bd0 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.965+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe006c280 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.965+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7fdbd8014bc0 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.966+0000 7fdbd27fc640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fdbc406c220 0x7fdbc406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.966+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdbd808b6f0 con 0x7fdbe015ee10 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.966+0000 7fdbe5ca8640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fdbc406c220 0x7fdbc406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:31.970 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.966+0000 7fdbe5ca8640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fdbc406c220 0x7fdbc406e6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000f60 tx=0x7fdbd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:31.972 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:31.971+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdbd8059cd0 con 0x7fdbe015ee10 2024-09-19T09:42:32.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.140+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbe00cf730 con 0x7fdbe015ee10 2024-09-19T09:42:32.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.141+0000 7fdbd27fc640 1 -- 172.21.15.123:0/3005945307 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7fdbd805dfd0 con 0x7fdbe015ee10 2024-09-19T09:42:32.143 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-19T09:42:32.143 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":19,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:31.462449+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:32.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fdbc406c220 msgr2=0x7fdbc406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fdbc406c220 0x7fdbc406e6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000f60 tx=0x7fdbd4009040 comp rx=0 tx=0).stop 2024-09-19T09:42:32.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 msgr2=0x7fdbe0151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe0151190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007e70 tx=0x7fdbd800e4b0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 shutdown_connections 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe015ee10 0x7fdbe0151190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fdbc406c220 0x7fdbc406e6e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbe015ea30 0x7fdbe00c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 --2- 172.21.15.123:0/3005945307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbe0073a20 0x7fdbe01f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 >> 172.21.15.123:0/3005945307 conn(0x7fdbe006d390 msgr2=0x7fdbe0150100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 shutdown_connections 2024-09-19T09:42:32.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-19T09:42:32.143+0000 7fdbe7f0c640 1 -- 172.21.15.123:0/3005945307 wait complete. 2024-09-19T09:42:32.155 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T09:42:32.155 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T09:42:32.155 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:42:32.155 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:42:32.157 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:42:32.158 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:42:32.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:42:32.160 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:42:32.160 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-19T09:42:32.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-19T09:42:32.162 INFO:tasks.ceph.mds.e:Started 2024-09-19T09:42:32.162 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:42:32.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:42:32.164 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:42:32.165 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:42:32.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:42:32.167 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:42:32.167 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-19T09:42:32.167 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-19T09:42:32.169 INFO:tasks.ceph.mds.f:Started 2024-09-19T09:42:32.169 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-19T09:42:32.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:42:32.234 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-19T09:42:32.235 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-19T09:42:32.235 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-19T09:42:32.233+0000 7f24eea9c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-19T09:42:32.238 INFO:tasks.ceph.mds.e.smithi123.stdout:starting mds.e at 2024-09-19T09:42:32.240 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-19T09:42:32.240 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-19T09:42:32.241 INFO:tasks.ceph.mds.f.smithi194.stdout:starting mds.f at 2024-09-19T09:42:32.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.273+0000 7f5e39b59640 1 Processor -- start 2024-09-19T09:42:32.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.273+0000 7f5e39b59640 1 -- start start 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e39b59640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e340cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e39b59640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5e340c8400 0x7f5e340cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e39b59640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3415c240 con 0x7f5e34155650 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e39b59640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f5e34155a30 con 0x7f5e340c8400 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e39b59640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3415b3e0 con 0x7f5e340c7f40 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e337fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5e34155650 0x7f5e340cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56512/0 (socket says 172.21.15.123:56512) 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e337fe640 1 -- 172.21.15.123:0/1457210555 learned_addr learned my addr 172.21.15.123:0/1457210555 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e33fff640 1 --2- 172.21.15.123:0/1457210555 >> v2:172.21.15.194:3300/0 conn(0x7f5e340c8400 0x7f5e340cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e32ffd640 1 --2- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e340cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e327fc640 1 -- 172.21.15.123:0/1457210555 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634448780 0 0) 0x7f5e3415c240 con 0x7f5e34155650 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e327fc640 1 -- 172.21.15.123:0/1457210555 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e1c003520 con 0x7f5e34155650 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e327fc640 1 -- 172.21.15.123:0/1457210555 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3359734439 0 0) 0x7f5e1c003520 con 0x7f5e34155650 2024-09-19T09:42:32.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e33fff640 1 -- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 msgr2=0x7f5e340cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e33fff640 1 --2- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e340cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e33fff640 1 -- 172.21.15.123:0/1457210555 >> v1:172.21.15.123:6789/0 conn(0x7f5e34155650 legacy=0x7f5e340cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.274+0000 7f5e33fff640 1 -- 172.21.15.123:0/1457210555 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3415b6c0 con 0x7f5e340c8400 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.275+0000 7f5e33fff640 1 --2- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e340c8400 0x7f5e340cbd30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009d90 tx=0x7f5e2c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a321c5d3702753d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.275+0000 7f5e327fc640 1 -- 172.21.15.123:0/1457210555 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24001670 con 0x7f5e340c8400 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.275+0000 7f5e327fc640 1 -- 172.21.15.123:0/1457210555 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c007540 con 0x7f5e340c8400 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.275+0000 7f5e327fc640 1 -- 172.21.15.123:0/1457210555 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0078f0 con 0x7f5e340c8400 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 -- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e340c8400 msgr2=0x7f5e340cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 --2- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e340c8400 0x7f5e340cbd30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009d90 tx=0x7f5e2c02a5f0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 -- 172.21.15.123:0/1457210555 shutdown_connections 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 --2- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e340c8400 0x7f5e340cbd30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 --2- 172.21.15.123:0/1457210555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e340cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 -- 172.21.15.123:0/1457210555 >> 172.21.15.123:0/1457210555 conn(0x7f5e340cd5c0 msgr2=0x7f5e340cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:32.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 -- 172.21.15.123:0/1457210555 shutdown_connections 2024-09-19T09:42:32.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.276+0000 7f5e39b59640 1 -- 172.21.15.123:0/1457210555 wait complete. 2024-09-19T09:42:32.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.277+0000 7f5e39b59640 1 Processor -- start 2024-09-19T09:42:32.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.277+0000 7f5e39b59640 1 -- start start 2024-09-19T09:42:32.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e39b59640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e341e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:32.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e39b59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 0x7f5e341e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:32.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e39b59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e34155650 0x7f5e340c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e39b59640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3415bf60 con 0x7f5e340c8400 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e39b59640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3415bc80 con 0x7f5e34155650 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e39b59640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5e340ce430 con 0x7f5e340c7f40 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e32ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 0x7f5e341e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e32ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 0x7f5e341e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42010/0 (socket says 172.21.15.123:42010) 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e32ffd640 1 -- 172.21.15.123:0/774650978 learned_addr learned my addr 172.21.15.123:0/774650978 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e337fe640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e341e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.278+0000 7f5e33fff640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e34155650 0x7f5e340c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e32ffd640 1 -- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 msgr2=0x7f5e341e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e32ffd640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e341e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e32ffd640 1 -- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e34155650 msgr2=0x7f5e340c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e32ffd640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e34155650 0x7f5e340c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e32ffd640 1 -- 172.21.15.123:0/774650978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e341e58d0 con 0x7f5e340c8400 2024-09-19T09:42:32.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e32ffd640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 0x7f5e341e7d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800e840 tx=0x7f5e2800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28017070 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2800c940 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e341e5bb0 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800cd10 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.279+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e340caa20 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.280+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3415c430 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.280+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f5e2801a070 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.281+0000 7f5e1bfff640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5e2006c220 0x7f5e2006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.281+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f5e2808b0c0 con 0x7f5e340c8400 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.281+0000 7f5e337fe640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5e2006c220 0x7f5e2006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:32.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.281+0000 7f5e337fe640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5e2006c220 0x7f5e2006e6e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005880 tx=0x7f5e240057f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:32.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.285+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5e3415c430 con 0x7f5e340c8400 2024-09-19T09:42:32.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.483+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e340b6690 con 0x7f5e340c8400 2024-09-19T09:42:32.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.484+0000 7f5e1bfff640 1 -- 172.21.15.123:0/774650978 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f5e280596a0 con 0x7f5e340c8400 2024-09-19T09:42:32.486 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:32.486 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"btime":"2024-09-19T09:42:32:238926+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:42:32.486 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-09-19T09:42:32.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5e2006c220 msgr2=0x7f5e2006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5e2006c220 0x7f5e2006e6e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005880 tx=0x7f5e240057f0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 msgr2=0x7f5e341e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:32.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 0x7f5e341e7d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800e840 tx=0x7f5e2800ed00 comp rx=0 tx=0).stop 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 shutdown_connections 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e34155650 0x7f5e340c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e340c8400 0x7f5e341e7d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5e2006c220 0x7f5e2006e6e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 --2- 172.21.15.123:0/774650978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e340c7f40 0x7f5e341e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 >> 172.21.15.123:0/774650978 conn(0x7f5e340cd5c0 msgr2=0x7f5e34152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:32.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 shutdown_connections 2024-09-19T09:42:32.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:32.486+0000 7f5e39b59640 1 -- 172.21.15.123:0/774650978 wait complete. 2024-09-19T09:42:34.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:42:34.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.611+0000 7f6a06d2a640 1 Processor -- start 2024-09-19T09:42:34.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.611+0000 7f6a06d2a640 1 -- start start 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a06d2a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a000c4660 0x7f6a000706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a06d2a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 0x7f6a001598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a06d2a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a000735c0 con 0x7f6a001530f0 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a06d2a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f6a00068870 con 0x7f6a000c4660 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a06d2a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6a000740e0 con 0x7f6a00159460 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a04ac6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6a001530f0 0x7f6a000c6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58634/0 (socket says 172.21.15.123:58634) 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.612+0000 7f6a04ac6640 1 -- 172.21.15.123:0/847479976 learned_addr learned my addr 172.21.15.123:0/847479976 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69fffff640 1 --2- 172.21.15.123:0/847479976 >> v2:172.21.15.194:3300/0 conn(0x7f6a000c4660 0x7f6a000706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278701686 0 0) 0x7f69f0001110 con 0x7f6a001530f0 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f6a052c7640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 0x7f6a001598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e8003520 con 0x7f6a001530f0 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132750431 0 0) 0x7f69e8003520 con 0x7f6a001530f0 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 msgr2=0x7f6a001598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 0x7f6a001598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 >> v2:172.21.15.194:3300/0 conn(0x7f6a000c4660 msgr2=0x7f6a000706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 --2- 172.21.15.123:0/847479976 >> v2:172.21.15.194:3300/0 conn(0x7f6a000c4660 0x7f6a000706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00073840 con 0x7f6a001530f0 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f69f0001840 con 0x7f6a001530f0 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 >> v1:172.21.15.123:6789/0 conn(0x7f6a001530f0 legacy=0x7f6a000c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69e80039b0 0x7f69e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f69e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 0x7f69e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00068870 con 0x7f69e8004800 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a000740e0 con 0x7f69e80039b0 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f69e800b9c0 con 0x7f6a00159460 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f69fffff640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f69e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f6a04ac6640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69e80039b0 0x7f69e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.613+0000 7f6a052c7640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 0x7f69e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69fffff640 1 -- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 msgr2=0x7f69e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69fffff640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a00159460 0x7f69e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69fffff640 1 -- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69e80039b0 msgr2=0x7f69e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69fffff640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69e80039b0 0x7f69e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69fffff640 1 -- 172.21.15.123:0/847479976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e8003520 con 0x7f69e8004800 2024-09-19T09:42:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f6a04ac6640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69e80039b0 0x7f69e8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69fffff640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f69e8004c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009ac0 tx=0x7f69e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3925a549487721aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4036070 con 0x7f69e8004800 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f4031400 con 0x7f69e8004800 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.614+0000 7f69ff7fe640 1 -- 172.21.15.123:0/847479976 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4009690 con 0x7f69e8004800 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a06d2a640 1 -- 172.21.15.123:0/847479976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 msgr2=0x7f69e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/847479976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f69e8004c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009ac0 tx=0x7f69e8005830 comp rx=0 tx=0).stop 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a052c7640 1 -- 172.21.15.123:0/847479976 reap_dead start 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a06d2a640 1 -- 172.21.15.123:0/847479976 shutdown_connections 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a06d2a640 1 -- 172.21.15.123:0/847479976 >> 172.21.15.123:0/847479976 conn(0x7f6a0006fb90 msgr2=0x7f6a0006ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a06d2a640 1 -- 172.21.15.123:0/847479976 shutdown_connections 2024-09-19T09:42:34.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.615+0000 7f6a06d2a640 1 -- 172.21.15.123:0/847479976 wait complete. 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.616+0000 7f6a06d2a640 1 Processor -- start 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.616+0000 7f6a06d2a640 1 -- start start 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.617+0000 7f6a06d2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f6a000c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.617+0000 7f6a06d2a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0006d6c0 0x7f6a00156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.617+0000 7f6a06d2a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a001e1380 0x7f6a00148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.617+0000 7f6a06d2a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00158f40 con 0x7f69e8004800 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.617+0000 7f6a06d2a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00073e00 con 0x7f6a0006d6c0 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.617+0000 7f6a06d2a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6a001534d0 con 0x7f6a001e1380 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f6a000c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f6a000c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53754/0 (socket says 172.21.15.123:53754) 2024-09-19T09:42:34.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 -- 172.21.15.123:0/1590951486 learned_addr learned my addr 172.21.15.123:0/1590951486 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f69fffff640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0006d6c0 0x7f6a00156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a052c7640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a001e1380 0x7f6a00148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 -- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a001e1380 msgr2=0x7f6a00148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a001e1380 0x7f6a00148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 -- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0006d6c0 msgr2=0x7f6a00156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0006d6c0 0x7f6a00156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 -- 172.21.15.123:0/1590951486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a000c4eb0 con 0x7f69e8004800 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a04ac6640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f6a000c68c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69f0007340 tx=0x7f69f0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f000ca70 con 0x7f69e8004800 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f0018070 con 0x7f69e8004800 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a000c5190 con 0x7f69e8004800 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f000ce30 con 0x7f69e8004800 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.618+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a001f4b40 con 0x7f69e8004800 2024-09-19T09:42:34.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.619+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a00068f50 con 0x7f69e8004800 2024-09-19T09:42:34.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.620+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69f001d460 con 0x7f69e8004800 2024-09-19T09:42:34.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.620+0000 7f69fd7fa640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f69ec06c2b0 0x7f69ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.620+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f69f008b2c0 con 0x7f69e8004800 2024-09-19T09:42:34.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.620+0000 7f69fffff640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f69ec06c2b0 0x7f69ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.621+0000 7f69fffff640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f69ec06c2b0 0x7f69ec06e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69f4033000 tx=0x7f69f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:34.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.625+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6a00068f50 con 0x7f69e8004800 2024-09-19T09:42:34.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.827+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a000685c0 con 0x7f69e8004800 2024-09-19T09:42:34.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.828+0000 7f69fd7fa640 1 -- 172.21.15.123:0/1590951486 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5566 (secure 0 0 0) 0x7f6a000735c0 con 0x7f69e8004800 2024-09-19T09:42:34.831 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:34.831 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"btime":"2024-09-19T09:42:33:239971+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4308,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:42:34.831 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f69ec06c2b0 msgr2=0x7f69ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f69ec06c2b0 0x7f69ec06e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69f4033000 tx=0x7f69f4008030 comp rx=0 tx=0).stop 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 msgr2=0x7f6a000c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f6a000c68c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69f0007340 tx=0x7f69f0007800 comp rx=0 tx=0).stop 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 shutdown_connections 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f69ec06c2b0 0x7f69ec06e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a001e1380 0x7f6a00148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0006d6c0 0x7f6a00156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 --2- 172.21.15.123:0/1590951486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e8004800 0x7f6a000c68c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 >> 172.21.15.123:0/1590951486 conn(0x7f6a0006fb90 msgr2=0x7f6a000c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 shutdown_connections 2024-09-19T09:42:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.830+0000 7f6a06d2a640 1 -- 172.21.15.123:0/1590951486 wait complete. 2024-09-19T09:42:34.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:42:34.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.938+0000 7f399c74b640 1 Processor -- start 2024-09-19T09:42:34.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.938+0000 7f399c74b640 1 -- start start 2024-09-19T09:42:34.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399c74b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39941523a0 0x7f39940c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399c74b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3994072770 0x7f39941588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399c74b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3994157e20 con 0x7f3994151fc0 2024-09-19T09:42:34.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399c74b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3994158e20 con 0x7f3994072770 2024-09-19T09:42:34.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399c74b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3994072100 con 0x7f39941523a0 2024-09-19T09:42:34.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399ace8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3994072770 0x7f39941588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399a4e7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3994151fc0 0x7f39940710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58650/0 (socket says 172.21.15.123:58650) 2024-09-19T09:42:34.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399a4e7640 1 -- 172.21.15.123:0/2828202774 learned_addr learned my addr 172.21.15.123:0/2828202774 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:34.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f3999ce6640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39941523a0 0x7f39940c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.939+0000 7f399ace8640 1 -- 172.21.15.123:0/2828202774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39941523a0 msgr2=0x7f39940c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:34.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f399ace8640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39941523a0 0x7f39940c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f399ace8640 1 -- 172.21.15.123:0/2828202774 >> v1:172.21.15.123:6789/0 conn(0x7f3994151fc0 legacy=0x7f39940710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f399ace8640 1 -- 172.21.15.123:0/2828202774 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39940723e0 con 0x7f3994072770 2024-09-19T09:42:34.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f3999ce6640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39941523a0 0x7f39940c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f399ace8640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f39941588e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f398c0097a0 tx=0x7f398c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b1d852551d1f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f39994e5640 1 -- 172.21.15.123:0/2828202774 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c037070 con 0x7f3994072770 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f39994e5640 1 -- 172.21.15.123:0/2828202774 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c032440 con 0x7f3994072770 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.940+0000 7f39994e5640 1 -- 172.21.15.123:0/2828202774 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c032810 con 0x7f3994072770 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 -- 172.21.15.123:0/2828202774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 msgr2=0x7f39941588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f39941588e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f398c0097a0 tx=0x7f398c02a180 comp rx=0 tx=0).stop 2024-09-19T09:42:34.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 -- 172.21.15.123:0/2828202774 shutdown_connections 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f39941588e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 --2- 172.21.15.123:0/2828202774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39941523a0 0x7f39940c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 -- 172.21.15.123:0/2828202774 >> 172.21.15.123:0/2828202774 conn(0x7f399406ec90 msgr2=0x7f399406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 -- 172.21.15.123:0/2828202774 shutdown_connections 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.941+0000 7f399c74b640 1 -- 172.21.15.123:0/2828202774 wait complete. 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.942+0000 7f399c74b640 1 Processor -- start 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.942+0000 7f399c74b640 1 -- start start 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f3994155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3994151fc0 0x7f399415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3994162bb0 0x7f3994163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3994071800 con 0x7f3994072770 2024-09-19T09:42:34.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39941583c0 con 0x7f3994151fc0 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3994071980 con 0x7f3994162bb0 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f3994155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f3994155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53772/0 (socket says 172.21.15.123:53772) 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 -- 172.21.15.123:0/3326044473 learned_addr learned my addr 172.21.15.123:0/3326044473 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f3999ce6640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3994151fc0 0x7f399415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399ace8640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3994162bb0 0x7f3994163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 -- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3994162bb0 msgr2=0x7f3994163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3994162bb0 0x7f3994163040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 -- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3994151fc0 msgr2=0x7f399415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3994151fc0 0x7f399415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 -- 172.21.15.123:0/3326044473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39941f2e70 con 0x7f3994072770 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399ace8640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3994162bb0 0x7f3994163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399a4e7640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f3994155c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f398400cb40 tx=0x7f398400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984017070 con 0x7f3994072770 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398400ac40 con 0x7f3994072770 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3994155600 con 0x7f3994072770 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.943+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984012620 con 0x7f3994072770 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.944+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3994151910 con 0x7f3994072770 2024-09-19T09:42:34.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.944+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39941568b0 con 0x7f3994072770 2024-09-19T09:42:34.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.945+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f398401a070 con 0x7f3994072770 2024-09-19T09:42:34.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.945+0000 7f3992ffd640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f398006c2b0 0x7f398006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:34.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.945+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f398408ad40 con 0x7f3994072770 2024-09-19T09:42:34.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.945+0000 7f3999ce6640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f398006c2b0 0x7f398006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:34.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.946+0000 7f3999ce6640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f398006c2b0 0x7f398006e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f399415e2e0 tx=0x7f3988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:34.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:34.949+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3984059240 con 0x7f3994072770 2024-09-19T09:42:35.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.115+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f399415b3d0 con 0x7f3994072770 2024-09-19T09:42:35.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.116+0000 7f3992ffd640 1 -- 172.21.15.123:0/3326044473 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f398405d540 con 0x7f3994072770 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:42:35.119 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f398006c2b0 msgr2=0x7f398006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f398006c2b0 0x7f398006e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f399415e2e0 tx=0x7f3988008040 comp rx=0 tx=0).stop 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 msgr2=0x7f3994155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f3994155c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f398400cb40 tx=0x7f398400a060 comp rx=0 tx=0).stop 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 shutdown_connections 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f398006c2b0 0x7f398006e770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3994162bb0 0x7f3994163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3994151fc0 0x7f399415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 --2- 172.21.15.123:0/3326044473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3994072770 0x7f3994155c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 >> 172.21.15.123:0/3326044473 conn(0x7f399406ec90 msgr2=0x7f399406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 shutdown_connections 2024-09-19T09:42:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.118+0000 7f399c74b640 1 -- 172.21.15.123:0/3326044473 wait complete. 2024-09-19T09:42:35.131 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:42:35.131 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:42:35.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.230+0000 7f44ea5e4640 1 Processor -- start 2024-09-19T09:42:35.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.230+0000 7f44ea5e4640 1 -- start start 2024-09-19T09:42:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44ea5e4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f44e4155380 0x7f44e415f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44ea5e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44e40cce70 0x7f44e40cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44ea5e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e4155760 con 0x7f44e40cdb30 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44ea5e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f44e415be90 con 0x7f44e40cce70 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44ea5e4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f44e415b280 con 0x7f44e4155380 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44e40cce70 0x7f44e40cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e8b81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f44e40cdb30 0x7f44e40c6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58664/0 (socket says 172.21.15.123:58664) 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e8b81640 1 -- 172.21.15.123:0/2339479800 learned_addr learned my addr 172.21.15.123:0/2339479800 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e3fff640 1 --2- 172.21.15.123:0/2339479800 >> v2:172.21.15.194:3300/0 conn(0x7f44e4155380 0x7f44e415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e37fe640 1 -- 172.21.15.123:0/2339479800 >> v2:172.21.15.194:3300/0 conn(0x7f44e4155380 msgr2=0x7f44e415f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e37fe640 1 --2- 172.21.15.123:0/2339479800 >> v2:172.21.15.194:3300/0 conn(0x7f44e4155380 0x7f44e415f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e37fe640 1 -- 172.21.15.123:0/2339479800 >> v1:172.21.15.123:6789/0 conn(0x7f44e40cdb30 legacy=0x7f44e40c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e37fe640 1 -- 172.21.15.123:0/2339479800 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e415b560 con 0x7f44e40cce70 2024-09-19T09:42:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.231+0000 7f44e2ffd640 1 -- 172.21.15.123:0/2339479800 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037012504 0 0) 0x7f44e4155760 con 0x7f44e40cdb30 2024-09-19T09:42:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.232+0000 7f44e37fe640 1 --2- 172.21.15.123:0/2339479800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e40cd5f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44e40d1c10 tx=0x7f44d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49071449bba984c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.232+0000 7f44e2ffd640 1 -- 172.21.15.123:0/2339479800 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8037070 con 0x7f44e40cce70 2024-09-19T09:42:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.232+0000 7f44e2ffd640 1 -- 172.21.15.123:0/2339479800 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d8032440 con 0x7f44e40cce70 2024-09-19T09:42:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.232+0000 7f44e2ffd640 1 -- 172.21.15.123:0/2339479800 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8032810 con 0x7f44e40cce70 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 -- 172.21.15.123:0/2339479800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 msgr2=0x7f44e40cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/2339479800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e40cd5f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44e40d1c10 tx=0x7f44d802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 -- 172.21.15.123:0/2339479800 shutdown_connections 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/2339479800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e40cd5f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/2339479800 >> v2:172.21.15.194:3300/0 conn(0x7f44e4155380 0x7f44e415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 -- 172.21.15.123:0/2339479800 >> 172.21.15.123:0/2339479800 conn(0x7f44e4073ea0 msgr2=0x7f44e406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 -- 172.21.15.123:0/2339479800 shutdown_connections 2024-09-19T09:42:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.233+0000 7f44ea5e4640 1 -- 172.21.15.123:0/2339479800 wait complete. 2024-09-19T09:42:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.234+0000 7f44ea5e4640 1 Processor -- start 2024-09-19T09:42:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.234+0000 7f44ea5e4640 1 -- start start 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e41f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44e40cdb30 0x7f44e4150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44e4155380 0x7f44e414e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44e40cd2a0 con 0x7f44e40cce70 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f44e415bb20 con 0x7f44e4155380 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f44e40c5e20 con 0x7f44e40cdb30 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e41f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e41f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53794/0 (socket says 172.21.15.123:53794) 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 -- 172.21.15.123:0/1628940737 learned_addr learned my addr 172.21.15.123:0/1628940737 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e8b81640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44e4155380 0x7f44e414e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e37fe640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44e40cdb30 0x7f44e4150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 -- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44e40cdb30 msgr2=0x7f44e4150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44e40cdb30 0x7f44e4150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 -- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44e4155380 msgr2=0x7f44e414e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44e4155380 0x7f44e414e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 -- 172.21.15.123:0/1628940737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e40d05a0 con 0x7f44e40cce70 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e37fe640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44e40cdb30 0x7f44e4150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e3fff640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e41f1910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f44d400d620 tx=0x7f44d400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d400b620 con 0x7f44e40cce70 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d4019070 con 0x7f44e40cce70 2024-09-19T09:42:35.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e41f53c0 con 0x7f44e40cce70 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.235+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d400ba00 con 0x7f44e40cce70 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.236+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e41f1110 con 0x7f44e40cce70 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.236+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e40ccc60 con 0x7f44e40cce70 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.237+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44d400bba0 con 0x7f44e40cce70 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.237+0000 7f44e0ff9640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f44d006c2b0 0x7f44d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.237+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f44d408b4c0 con 0x7f44e40cce70 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.237+0000 7f44e37fe640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f44d006c2b0 0x7f44d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.238+0000 7f44e37fe640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f44d006c2b0 0x7f44d006e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44d8034000 tx=0x7f44d802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:35.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.242+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f44e40ccc60 con 0x7f44e40cce70 2024-09-19T09:42:35.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.407+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f44e40c7170 con 0x7f44e40cce70 2024-09-19T09:42:35.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.476+0000 7f44e0ff9640 1 -- 172.21.15.123:0/1628940737 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f44d4059ef0 con 0x7f44e40cce70 2024-09-19T09:42:35.479 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-19T09:42:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f44d006c2b0 msgr2=0x7f44d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f44d006c2b0 0x7f44d006e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44d8034000 tx=0x7f44d802e000 comp rx=0 tx=0).stop 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 msgr2=0x7f44e41f1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e41f1910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f44d400d620 tx=0x7f44d400dae0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 shutdown_connections 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44e4155380 0x7f44e414e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f44d006c2b0 0x7f44d006e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44e40cdb30 0x7f44e4150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 --2- 172.21.15.123:0/1628940737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44e40cce70 0x7f44e41f1910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.478+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 >> 172.21.15.123:0/1628940737 conn(0x7f44e4073ea0 msgr2=0x7f44e41537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.479+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 shutdown_connections 2024-09-19T09:42:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.479+0000 7f44ea5e4640 1 -- 172.21.15.123:0/1628940737 wait complete. 2024-09-19T09:42:35.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:42:35.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.596+0000 7f676ceba640 1 Processor -- start 2024-09-19T09:42:35.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.596+0000 7f676ceba640 1 -- start start 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f676ceba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680ced00 0x7f67680ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f676ceba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67680cf0e0 0x7f6768154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f676ceba640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f67680c48b0 0x7f67681554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f676ceba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f67680ca790 con 0x7f67680cf0e0 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f676ceba640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f676815e770 con 0x7f67680c48b0 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f676ceba640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f676815ea50 con 0x7f67680ced00 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67680cf0e0 0x7f6768154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67680cf0e0 0x7f6768154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53802/0 (socket says 172.21.15.123:53802) 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 -- 172.21.15.123:0/1179933097 learned_addr learned my addr 172.21.15.123:0/1179933097 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 -- 172.21.15.123:0/1179933097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680ced00 msgr2=0x7f67680ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:35.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 --2- 172.21.15.123:0/1179933097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680ced00 0x7f67680ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 -- 172.21.15.123:0/1179933097 >> v2:172.21.15.194:3300/0 conn(0x7f67680c48b0 msgr2=0x7f67681554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 --2- 172.21.15.123:0/1179933097 >> v2:172.21.15.194:3300/0 conn(0x7f67680c48b0 0x7f67681554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.597+0000 7f675dd9b640 1 -- 172.21.15.123:0/1179933097 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676815ed30 con 0x7f67680cf0e0 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f675dd9b640 1 --2- 172.21.15.123:0/1179933097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f6768154f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6750009870 tx=0x7f675002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b5b7225940b017 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f6765d9b640 1 -- 172.21.15.123:0/1179933097 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750037070 con 0x7f67680cf0e0 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f6765d9b640 1 -- 172.21.15.123:0/1179933097 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6750032440 con 0x7f67680cf0e0 2024-09-19T09:42:35.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f6765d9b640 1 -- 172.21.15.123:0/1179933097 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750032810 con 0x7f67680cf0e0 2024-09-19T09:42:35.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 -- 172.21.15.123:0/1179933097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 msgr2=0x7f6768154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 --2- 172.21.15.123:0/1179933097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f6768154f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6750009870 tx=0x7f675002a2a0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 -- 172.21.15.123:0/1179933097 shutdown_connections 2024-09-19T09:42:35.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 --2- 172.21.15.123:0/1179933097 >> v2:172.21.15.194:3300/0 conn(0x7f67680c48b0 0x7f67681554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 --2- 172.21.15.123:0/1179933097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f6768154f90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 --2- 172.21.15.123:0/1179933097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680ced00 0x7f67680ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.598+0000 7f676ceba640 1 -- 172.21.15.123:0/1179933097 >> 172.21.15.123:0/1179933097 conn(0x7f6768070f00 msgr2=0x7f6768071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.599+0000 7f676ceba640 1 -- 172.21.15.123:0/1179933097 shutdown_connections 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.599+0000 7f676ceba640 1 -- 172.21.15.123:0/1179933097 wait complete. 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.600+0000 7f676ceba640 1 Processor -- start 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.600+0000 7f676ceba640 1 -- start start 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680c48b0 0x7f6768153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67680ced00 0x7f67681f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f67681f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f676815b2e0 con 0x7f67680cf0e0 2024-09-19T09:42:35.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f676815b160 con 0x7f67680ced00 2024-09-19T09:42:35.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f676815b460 con 0x7f67680c48b0 2024-09-19T09:42:35.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f67681f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f67681f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53816/0 (socket says 172.21.15.123:53816) 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 -- 172.21.15.123:0/2371679239 learned_addr learned my addr 172.21.15.123:0/2371679239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676659c640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680c48b0 0x7f6768153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f675dd9b640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67680ced00 0x7f67681f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 -- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680c48b0 msgr2=0x7f6768153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680c48b0 0x7f6768153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 -- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67680ced00 msgr2=0x7f67681f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67680ced00 0x7f67681f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 -- 172.21.15.123:0/2371679239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676815dfe0 con 0x7f67680cf0e0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f6766d9d640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f67681f4e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f676000b9e0 tx=0x7f676000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760019070 con 0x7f67680cf0e0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676000ca80 con 0x7f67680cf0e0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676815ced0 con 0x7f67680cf0e0 2024-09-19T09:42:35.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760014440 con 0x7f67680cf0e0 2024-09-19T09:42:35.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.601+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681f15d0 con 0x7f67680cf0e0 2024-09-19T09:42:35.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.602+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f676815b890 con 0x7f67680cf0e0 2024-09-19T09:42:35.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.603+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f676001c070 con 0x7f67680cf0e0 2024-09-19T09:42:35.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.603+0000 7f675f7fe640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f674806c2b0 0x7f674806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:35.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.603+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f676008ae10 con 0x7f67680cf0e0 2024-09-19T09:42:35.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.603+0000 7f676659c640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f674806c2b0 0x7f674806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:35.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.604+0000 7f676659c640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f674806c2b0 0x7f674806e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6758009990 tx=0x7f6758009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:35.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.608+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6760059120 con 0x7f67680cf0e0 2024-09-19T09:42:35.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:35.777+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f676815e360 con 0x7f67680cf0e0 2024-09-19T09:42:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.478+0000 7f675f7fe640 1 -- 172.21.15.123:0/2371679239 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f676005d420 con 0x7f67680cf0e0 2024-09-19T09:42:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f674806c2b0 msgr2=0x7f674806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f674806c2b0 0x7f674806e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6758009990 tx=0x7f6758009110 comp rx=0 tx=0).stop 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 msgr2=0x7f67681f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f67681f4e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f676000b9e0 tx=0x7f676000bde0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 shutdown_connections 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67680cf0e0 0x7f67681f4e20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67680ced00 0x7f67681f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f674806c2b0 0x7f674806e770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 --2- 172.21.15.123:0/2371679239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67680c48b0 0x7f6768153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 >> 172.21.15.123:0/2371679239 conn(0x7f6768070f00 msgr2=0x7f6768158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 shutdown_connections 2024-09-19T09:42:36.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.481+0000 7f676ceba640 1 -- 172.21.15.123:0/2371679239 wait complete. 2024-09-19T09:42:36.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:42:36.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 Processor -- start 2024-09-19T09:42:36.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 -- start start 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb6201581d0 0x7fb620071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb62006c9c0 0x7fb620071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62006c050 con 0x7fb6200c5e30 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb62006c330 con 0x7fb62006c9c0 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.609+0000 7fb62798d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb6201576f0 con 0x7fb6201581d0 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb62006c9c0 0x7fb620071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb62006c9c0 0x7fb620071650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53818/0 (socket says 172.21.15.123:53818) 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 -- 172.21.15.123:0/657929391 learned_addr learned my addr 172.21.15.123:0/657929391 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb624f28640 1 --2- 172.21.15.123:0/657929391 >> v2:172.21.15.194:3300/0 conn(0x7fb6201581d0 0x7fb620071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 -- 172.21.15.123:0/657929391 >> v2:172.21.15.194:3300/0 conn(0x7fb6201581d0 msgr2=0x7fb620071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 --2- 172.21.15.123:0/657929391 >> v2:172.21.15.194:3300/0 conn(0x7fb6201581d0 0x7fb620071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 -- 172.21.15.123:0/657929391 >> v1:172.21.15.194:6789/0 conn(0x7fb6200c5e30 legacy=0x7fb62015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb625f2a640 1 -- 172.21.15.123:0/657929391 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6201579d0 con 0x7fb62006c9c0 2024-09-19T09:42:36.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.610+0000 7fb624f28640 1 --2- 172.21.15.123:0/657929391 >> v2:172.21.15.194:3300/0 conn(0x7fb6201581d0 0x7fb620071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:36.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb625f2a640 1 --2- 172.21.15.123:0/657929391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb62006c9c0 0x7fb620071650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb62015bb90 tx=0x7fb61802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf63b0c8b674414 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb617fff640 1 -- 172.21.15.123:0/657929391 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618036070 con 0x7fb62006c9c0 2024-09-19T09:42:36.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb617fff640 1 -- 172.21.15.123:0/657929391 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb618031600 con 0x7fb62006c9c0 2024-09-19T09:42:36.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb617fff640 1 -- 172.21.15.123:0/657929391 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6180319d0 con 0x7fb62006c9c0 2024-09-19T09:42:36.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 -- 172.21.15.123:0/657929391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb62006c9c0 msgr2=0x7fb620071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 --2- 172.21.15.123:0/657929391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb62006c9c0 0x7fb620071650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb62015bb90 tx=0x7fb61802a780 comp rx=0 tx=0).stop 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 -- 172.21.15.123:0/657929391 shutdown_connections 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 --2- 172.21.15.123:0/657929391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb62006c9c0 0x7fb620071650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 --2- 172.21.15.123:0/657929391 >> v2:172.21.15.194:3300/0 conn(0x7fb6201581d0 0x7fb620071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 -- 172.21.15.123:0/657929391 >> 172.21.15.123:0/657929391 conn(0x7fb62006ed00 msgr2=0x7fb62006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 -- 172.21.15.123:0/657929391 shutdown_connections 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.611+0000 7fb62798d640 1 -- 172.21.15.123:0/657929391 wait complete. 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.612+0000 7fb62798d640 1 Processor -- start 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.612+0000 7fb62798d640 1 -- start start 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb62798d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb62006c9c0 0x7fb6200bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb62798d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 0x7fb620150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb62798d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6201581d0 0x7fb6200caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb62798d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb62006bc10 con 0x7fb6200c5e30 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb62798d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb6200c4110 con 0x7fb6201581d0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb62798d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb62006bd90 con 0x7fb62006c9c0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb624f28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 0x7fb620150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb624f28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 0x7fb620150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53834/0 (socket says 172.21.15.123:53834) 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb624f28640 1 -- 172.21.15.123:0/1433851415 learned_addr learned my addr 172.21.15.123:0/1433851415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb625729640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb62006c9c0 0x7fb6200bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.613+0000 7fb625f2a640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6201581d0 0x7fb6200caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb624f28640 1 -- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb62006c9c0 msgr2=0x7fb6200bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb624f28640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb62006c9c0 0x7fb6200bb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb624f28640 1 -- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6201581d0 msgr2=0x7fb6200caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb624f28640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6201581d0 0x7fb6200caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb624f28640 1 -- 172.21.15.123:0/1433851415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6200bba10 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb624f28640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 0x7fb620150e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c7f0 tx=0x7fb61000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610015070 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb610007820 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610007bd0 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6200ba380 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.614+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6200ba900 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.615+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6200c6210 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.615+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb610018070 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.616+0000 7fb615ffb640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb60406c2b0 0x7fb60406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.616+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fb61008b370 con 0x7fb6200c5e30 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.616+0000 7fb625729640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb60406c2b0 0x7fb60406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.616+0000 7fb625729640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb60406c2b0 0x7fb60406e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb61c004f60 tx=0x7fb61c007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.621+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb610059580 con 0x7fb6200c5e30 2024-09-19T09:42:36.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:36.821+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb6200c8a80 con 0x7fb6200c5e30 2024-09-19T09:42:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.507+0000 7fb615ffb640 1 -- 172.21.15.123:0/1433851415 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb61005d880 con 0x7fb6200c5e30 2024-09-19T09:42:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:42:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.512+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb60406c2b0 msgr2=0x7fb60406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.512+0000 7fb62798d640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb60406c2b0 0x7fb60406e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb61c004f60 tx=0x7fb61c007e30 comp rx=0 tx=0).stop 2024-09-19T09:42:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.512+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 msgr2=0x7fb620150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.512+0000 7fb62798d640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 0x7fb620150e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c7f0 tx=0x7fb61000ccb0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 shutdown_connections 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6201581d0 0x7fb6200caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6200c5e30 0x7fb620150e00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb60406c2b0 0x7fb60406e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 --2- 172.21.15.123:0/1433851415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb62006c9c0 0x7fb6200bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 >> 172.21.15.123:0/1433851415 conn(0x7fb62006ed00 msgr2=0x7fb620071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 shutdown_connections 2024-09-19T09:42:37.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.515+0000 7fb62798d640 1 -- 172.21.15.123:0/1433851415 wait complete. 2024-09-19T09:42:37.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:37.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.629+0000 7fb1ed5bd640 1 Processor -- start 2024-09-19T09:42:37.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.629+0000 7fb1ed5bd640 1 -- start start 2024-09-19T09:42:37.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1ed5bd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 0x7fb1e80cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1ed5bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e815c240 con 0x7fb1e80cbf00 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1ed5bd640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e8155a30 con 0x7fb1e80c7f40 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1ed5bd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e815b3e0 con 0x7fb1e8155650 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e77fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb1e80cbf00 0x7fb1e8165b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58676/0 (socket says 172.21.15.123:58676) 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e77fe640 1 -- 172.21.15.123:0/930044853 learned_addr learned my addr 172.21.15.123:0/930044853 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e6ffd640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 0x7fb1e80cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154974296 0 0) 0x7fb1e815c240 con 0x7fb1e80cbf00 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d4003520 con 0x7fb1e80cbf00 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3534740583 0 0) 0x7fb1d4003520 con 0x7fb1e80cbf00 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 msgr2=0x7fb1e80cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 0x7fb1e80cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 >> v1:172.21.15.194:6789/0 conn(0x7fb1e80c7f40 legacy=0x7fb1e80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e815b6c0 con 0x7fb1e80cbf00 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fb1e00019f0 con 0x7fb1e80cbf00 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 >> v1:172.21.15.123:6789/0 conn(0x7fb1e80cbf00 legacy=0x7fb1e8165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 0x7fb1d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1d4003f20 0x7fb1d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d4004d40 0x7fb1d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e815b3e0 con 0x7fb1d4003f20 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d400ba20 con 0x7fb1d4004d40 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.630+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d400bc20 con 0x7fb1e8155650 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1de7fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1d4003f20 0x7fb1d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1e6ffd640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 0x7fb1d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1e77fe640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d4004d40 0x7fb1d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1de7fc640 1 -- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 msgr2=0x7fb1d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1de7fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e8155650 0x7fb1d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1de7fc640 1 -- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d4004d40 msgr2=0x7fb1d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1de7fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d4004d40 0x7fb1d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1de7fc640 1 -- 172.21.15.123:0/930044853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d4003520 con 0x7fb1d4003f20 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.631+0000 7fb1e77fe640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d4004d40 0x7fb1d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1de7fc640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1d4003f20 0x7fb1d4004800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00018e0 tx=0x7fb1d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622fa484c2f708c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0037070 con 0x7fb1d4003f20 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d002ab50 con 0x7fb1d4003f20 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1e67fc640 1 -- 172.21.15.123:0/930044853 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00014e0 con 0x7fb1d4003f20 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/930044853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1d4003f20 msgr2=0x7fb1d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/930044853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1d4003f20 0x7fb1d4004800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00018e0 tx=0x7fb1d4005830 comp rx=0 tx=0).stop 2024-09-19T09:42:37.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1e77fe640 1 -- 172.21.15.123:0/930044853 reap_dead start 2024-09-19T09:42:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/930044853 shutdown_connections 2024-09-19T09:42:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/930044853 >> 172.21.15.123:0/930044853 conn(0x7fb1e80cd5c0 msgr2=0x7fb1e80cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/930044853 shutdown_connections 2024-09-19T09:42:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.632+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/930044853 wait complete. 2024-09-19T09:42:37.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.633+0000 7fb1ed5bd640 1 Processor -- start 2024-09-19T09:42:37.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 -- start start 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d4003f20 0x7fb1e814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e81e6d20 0x7fb1e81f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 0x7fb1e81457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e815bf60 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e815bc80 con 0x7fb1e81e6d20 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1ed5bd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e80ce430 con 0x7fb1d4003f20 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1e77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 0x7fb1e81457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1e77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 0x7fb1e81457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53856/0 (socket says 172.21.15.123:53856) 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1e77fe640 1 -- 172.21.15.123:0/2257632377 learned_addr learned my addr 172.21.15.123:0/2257632377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1de7fc640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e81e6d20 0x7fb1e81f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.634+0000 7fb1e6ffd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d4003f20 0x7fb1e814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1e77fe640 1 -- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d4003f20 msgr2=0x7fb1e814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1e77fe640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d4003f20 0x7fb1e814ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1e77fe640 1 -- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e81e6d20 msgr2=0x7fb1e81f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1e77fe640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e81e6d20 0x7fb1e81f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1e77fe640 1 -- 172.21.15.123:0/2257632377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e81e5560 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1e77fe640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 0x7fb1e81457c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007960 tx=0x7fb1e000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000eb60 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e000ed00 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0014650 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e814ba20 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.635+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e81f1030 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.636+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e80d0460 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.636+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1e00147f0 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.637+0000 7fb1dffff640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb1c806c2b0 0x7fb1c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.637+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb1e008b090 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.637+0000 7fb1e6ffd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb1c806c2b0 0x7fb1c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.637+0000 7fb1e6ffd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb1c806c2b0 0x7fb1c806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009bc0 tx=0x7fb1d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.641+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb1e0059300 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.810+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1e80b6ae0 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.811+0000 7fb1dffff640 1 -- 172.21.15.123:0/2257632377 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16714 (secure 0 0 0) 0x7fb1e005d600 con 0x7fb1e81e3fa0 2024-09-19T09:42:37.813 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:37.814 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:36.824127+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:37.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.813+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb1c806c2b0 msgr2=0x7fb1c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.813+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb1c806c2b0 0x7fb1c806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009bc0 tx=0x7fb1d8009190 comp rx=0 tx=0).stop 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.813+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 msgr2=0x7fb1e81457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.813+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 0x7fb1e81457c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007960 tx=0x7fb1e000e530 comp rx=0 tx=0).stop 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 shutdown_connections 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e81e3fa0 0x7fb1e81457c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e81e6d20 0x7fb1e81f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb1c806c2b0 0x7fb1c806e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 --2- 172.21.15.123:0/2257632377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d4003f20 0x7fb1e814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 >> 172.21.15.123:0/2257632377 conn(0x7fb1e80cd5c0 msgr2=0x7fb1e8072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 shutdown_connections 2024-09-19T09:42:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.814+0000 7fb1ed5bd640 1 -- 172.21.15.123:0/2257632377 wait complete. 2024-09-19T09:42:37.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.922+0000 7f32f041e640 1 Processor -- start 2024-09-19T09:42:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.922+0000 7f32f041e640 1 -- start start 2024-09-19T09:42:37.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32f041e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cb910 0x7f32e80cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32f041e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32e80cc5e0 0x7f32e80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32f041e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f32e815b610 0x7f32e815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32f041e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f32e815b180 con 0x7f32e815b610 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32f041e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f32e815bfe0 con 0x7f32e80cc5e0 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32f041e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f32e80b3830 con 0x7f32e80cb910 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32ee9bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f32e815b610 0x7f32e815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32ee9bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f32e815b610 0x7f32e815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53866/0 (socket says 172.21.15.123:53866) 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.923+0000 7f32ee9bb640 1 -- 172.21.15.123:0/1891087564 learned_addr learned my addr 172.21.15.123:0/1891087564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee1ba640 1 --2- 172.21.15.123:0/1891087564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cb910 0x7f32e80cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ed9b9640 1 --2- 172.21.15.123:0/1891087564 >> v2:172.21.15.194:3300/0 conn(0x7f32e80cc5e0 0x7f32e80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee9bb640 1 -- 172.21.15.123:0/1891087564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cb910 msgr2=0x7f32e80cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee9bb640 1 --2- 172.21.15.123:0/1891087564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cb910 0x7f32e80cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee9bb640 1 -- 172.21.15.123:0/1891087564 >> v2:172.21.15.194:3300/0 conn(0x7f32e80cc5e0 msgr2=0x7f32e80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:37.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee9bb640 1 --2- 172.21.15.123:0/1891087564 >> v2:172.21.15.194:3300/0 conn(0x7f32e80cc5e0 0x7f32e80cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee9bb640 1 -- 172.21.15.123:0/1891087564 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e815f500 con 0x7f32e815b610 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.924+0000 7f32ee9bb640 1 --2- 172.21.15.123:0/1891087564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e815b610 0x7f32e815baa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32e80cd4b0 tx=0x7f32e002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38941a722493b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32ed1b8640 1 -- 172.21.15.123:0/1891087564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0036070 con 0x7f32e815b610 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32ed1b8640 1 -- 172.21.15.123:0/1891087564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e0031600 con 0x7f32e815b610 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32ed1b8640 1 -- 172.21.15.123:0/1891087564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e00319d0 con 0x7f32e815b610 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 -- 172.21.15.123:0/1891087564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e815b610 msgr2=0x7f32e815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 --2- 172.21.15.123:0/1891087564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e815b610 0x7f32e815baa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32e80cd4b0 tx=0x7f32e002a730 comp rx=0 tx=0).stop 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 -- 172.21.15.123:0/1891087564 shutdown_connections 2024-09-19T09:42:37.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 --2- 172.21.15.123:0/1891087564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e815b610 0x7f32e815baa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 --2- 172.21.15.123:0/1891087564 >> v2:172.21.15.194:3300/0 conn(0x7f32e80cc5e0 0x7f32e80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 --2- 172.21.15.123:0/1891087564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cb910 0x7f32e80cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 -- 172.21.15.123:0/1891087564 >> 172.21.15.123:0/1891087564 conn(0x7f32e806cb60 msgr2=0x7f32e806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 -- 172.21.15.123:0/1891087564 shutdown_connections 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.925+0000 7f32f041e640 1 -- 172.21.15.123:0/1891087564 wait complete. 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.926+0000 7f32f041e640 1 Processor -- start 2024-09-19T09:42:37.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.926+0000 7f32f041e640 1 -- start start 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32f041e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 0x7f32e814a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32f041e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cc5e0 0x7f32e81e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32f041e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e815b610 0x7f32e81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32f041e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815ef40 con 0x7f32e80cb910 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32f041e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815ec60 con 0x7f32e815b610 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32f041e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f32e815f220 con 0x7f32e80cc5e0 2024-09-19T09:42:37.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 0x7f32e814a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 0x7f32e814a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53870/0 (socket says 172.21.15.123:53870) 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 -- 172.21.15.123:0/1682729487 learned_addr learned my addr 172.21.15.123:0/1682729487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ed9b9640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cc5e0 0x7f32e81e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee9bb640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e815b610 0x7f32e81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 -- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cc5e0 msgr2=0x7f32e81e7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cc5e0 0x7f32e81e7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 -- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e815b610 msgr2=0x7f32e81531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e815b610 0x7f32e81531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 -- 172.21.15.123:0/1682729487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e81f58d0 con 0x7f32e80cb910 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.927+0000 7f32ee1ba640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 0x7f32e814a650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00e890 tx=0x7f32dc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.928+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc017070 con 0x7f32e80cb910 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.928+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc00c940 con 0x7f32e80cb910 2024-09-19T09:42:37.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.928+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e814adb0 con 0x7f32e80cb910 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.928+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00cd10 con 0x7f32e80cb910 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.928+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e81f4df0 con 0x7f32e80cb910 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.929+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e815e5d0 con 0x7f32e80cb910 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.929+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32dc01a070 con 0x7f32e80cb910 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.929+0000 7f32daffd640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32cc06c2b0 0x7f32cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.930+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f32dc08b420 con 0x7f32e80cb910 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.930+0000 7f32ed9b9640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32cc06c2b0 0x7f32cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.930+0000 7f32ed9b9640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32cc06c2b0 0x7f32cc06e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32e81f25a0 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:37.934+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f32dc059b90 con 0x7f32e80cb910 2024-09-19T09:42:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.101+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32e80ccc00 con 0x7f32e80cb910 2024-09-19T09:42:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.103+0000 7f32daffd640 1 -- 172.21.15.123:0/1682729487 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16714 (secure 0 0 0) 0x7f32dc059490 con 0x7f32e80cb910 2024-09-19T09:42:38.105 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:38.105 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:36.824127+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.104+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32cc06c2b0 msgr2=0x7f32cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.104+0000 7f32f041e640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32cc06c2b0 0x7f32cc06e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32e81f25a0 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.104+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 msgr2=0x7f32e814a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.104+0000 7f32f041e640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 0x7f32e814a650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00e890 tx=0x7f32dc00ed50 comp rx=0 tx=0).stop 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 shutdown_connections 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e815b610 0x7f32e81531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32cc06c2b0 0x7f32cc06e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32e80cc5e0 0x7f32e81e7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 --2- 172.21.15.123:0/1682729487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e80cb910 0x7f32e814a650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 >> 172.21.15.123:0/1682729487 conn(0x7f32e806cb60 msgr2=0x7f32e8152180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 shutdown_connections 2024-09-19T09:42:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.105+0000 7f32f041e640 1 -- 172.21.15.123:0/1682729487 wait complete. 2024-09-19T09:42:38.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:42:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.216+0000 7f0b886ae640 1 Processor -- start 2024-09-19T09:42:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.216+0000 7f0b886ae640 1 -- start start 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b886ae640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b80155360 0x7f0b800cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b886ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cd040 0x7f0b800cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b886ae640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b8015b580 con 0x7f0b800cdbb0 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b886ae640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0b8015c100 con 0x7f0b80155360 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b886ae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8015e910 con 0x7f0b800cd040 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b8644a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b80155360 0x7f0b800cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b86c4b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0b800cdbb0 0x7f0b8015eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58680/0 (socket says 172.21.15.123:58680) 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b86c4b640 1 -- 172.21.15.123:0/1119900844 learned_addr learned my addr 172.21.15.123:0/1119900844 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b85c49640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cd040 0x7f0b800cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b8644a640 1 -- 172.21.15.123:0/1119900844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cd040 msgr2=0x7f0b800cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b8644a640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cd040 0x7f0b800cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b8644a640 1 -- 172.21.15.123:0/1119900844 >> v1:172.21.15.123:6789/0 conn(0x7f0b800cdbb0 legacy=0x7f0b8015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b8644a640 1 -- 172.21.15.123:0/1119900844 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8015b860 con 0x7f0b80155360 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.217+0000 7f0b85448640 1 -- 172.21.15.123:0/1119900844 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247779490 0 0) 0x7f0b8015b580 con 0x7f0b800cdbb0 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.218+0000 7f0b85c49640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cd040 0x7f0b800cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.218+0000 7f0b8644a640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80155360 0x7f0b800cb900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009d90 tx=0x7f0b7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9fd6be651a5f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.218+0000 7f0b85448640 1 -- 172.21.15.123:0/1119900844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70007740 con 0x7f0b80155360 2024-09-19T09:42:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.218+0000 7f0b85448640 1 -- 172.21.15.123:0/1119900844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b700078e0 con 0x7f0b80155360 2024-09-19T09:42:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.218+0000 7f0b85448640 1 -- 172.21.15.123:0/1119900844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70007cb0 con 0x7f0b80155360 2024-09-19T09:42:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 -- 172.21.15.123:0/1119900844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80155360 msgr2=0x7f0b800cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80155360 0x7f0b800cb900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009d90 tx=0x7f0b7002a660 comp rx=0 tx=0).stop 2024-09-19T09:42:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 -- 172.21.15.123:0/1119900844 shutdown_connections 2024-09-19T09:42:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cd040 0x7f0b800cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 --2- 172.21.15.123:0/1119900844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b80155360 0x7f0b800cb900 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 -- 172.21.15.123:0/1119900844 >> 172.21.15.123:0/1119900844 conn(0x7f0b8006cb60 msgr2=0x7f0b8006cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 -- 172.21.15.123:0/1119900844 shutdown_connections 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.219+0000 7f0b886ae640 1 -- 172.21.15.123:0/1119900844 wait complete. 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.220+0000 7f0b886ae640 1 Processor -- start 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.220+0000 7f0b886ae640 1 -- start start 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 0x7f0b8015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cdbb0 0x7f0b801f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b80155360 0x7f0b80156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0b800cbe40 con 0x7f0b800cd040 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8015be20 con 0x7f0b80155360 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80155740 con 0x7f0b800cdbb0 2024-09-19T09:42:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 0x7f0b8015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 0x7f0b8015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53884/0 (socket says 172.21.15.123:53884) 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 -- 172.21.15.123:0/3319792823 learned_addr learned my addr 172.21.15.123:0/3319792823 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 -- 172.21.15.123:0/3319792823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cdbb0 msgr2=0x7f0b801f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cdbb0 0x7f0b801f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 -- 172.21.15.123:0/3319792823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b80155360 msgr2=0x7f0b80156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b80155360 0x7f0b80156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 -- 172.21.15.123:0/3319792823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b800cfc60 con 0x7f0b800cd040 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b8644a640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 0x7f0b8015db70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009d90 tx=0x7f0b70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7003f070 con 0x7f0b800cd040 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b70031c40 con 0x7f0b800cd040 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b801f0b80 con 0x7f0b800cd040 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70009450 con 0x7f0b800cd040 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.221+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b801f1140 con 0x7f0b800cd040 2024-09-19T09:42:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.222+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8015b160 con 0x7f0b800cd040 2024-09-19T09:42:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.223+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0b70003990 con 0x7f0b800cd040 2024-09-19T09:42:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.223+0000 7f0b7effd640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b6c06c2e0 0x7f0b6c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.223+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0b700ac580 con 0x7f0b800cd040 2024-09-19T09:42:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.223+0000 7f0b85c49640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b6c06c2e0 0x7f0b6c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.224+0000 7f0b85c49640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b6c06c2e0 0x7f0b6c06e7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b74006fd0 tx=0x7f0b74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.227+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0b7007ad80 con 0x7f0b800cd040 2024-09-19T09:42:38.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.427+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0b800cc460 con 0x7f0b800cd040 2024-09-19T09:42:38.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.512+0000 7f0b7effd640 1 -- 172.21.15.123:0/3319792823 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f0b7007a680 con 0x7f0b800cd040 2024-09-19T09:42:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.514+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b6c06c2e0 msgr2=0x7f0b6c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.514+0000 7f0b886ae640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b6c06c2e0 0x7f0b6c06e7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b74006fd0 tx=0x7f0b74008040 comp rx=0 tx=0).stop 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 msgr2=0x7f0b8015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 0x7f0b8015db70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009d90 tx=0x7f0b70004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 shutdown_connections 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b80155360 0x7f0b80156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b6c06c2e0 0x7f0b6c06e7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b800cdbb0 0x7f0b801f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 --2- 172.21.15.123:0/3319792823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b800cd040 0x7f0b8015db70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 >> 172.21.15.123:0/3319792823 conn(0x7f0b8006cb60 msgr2=0x7f0b80158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 shutdown_connections 2024-09-19T09:42:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.515+0000 7f0b886ae640 1 -- 172.21.15.123:0/3319792823 wait complete. 2024-09-19T09:42:38.527 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-19T09:42:38.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:42:38.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.627+0000 7ffa4cc1e640 1 Processor -- start 2024-09-19T09:42:38.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.627+0000 7ffa4cc1e640 1 -- start start 2024-09-19T09:42:38.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4cc1e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa481552a0 0x7ffa480cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4cc1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa48155680 0x7ffa480cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4cc1e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffa480ccdc0 0x7ffa480cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4cc1e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffa480ccbb0 con 0x7ffa481552a0 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4cc1e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4815b2a0 con 0x7ffa480ccdc0 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4cc1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4815b540 con 0x7ffa48155680 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa481552a0 0x7ffa480cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa481552a0 0x7ffa480cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53896/0 (socket says 172.21.15.123:53896) 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 -- 172.21.15.123:0/4264902861 learned_addr learned my addr 172.21.15.123:0/4264902861 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa46d9d640 1 --2- 172.21.15.123:0/4264902861 >> v2:172.21.15.194:3300/0 conn(0x7ffa480ccdc0 0x7ffa480cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa3dd9b640 1 --2- 172.21.15.123:0/4264902861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa48155680 0x7ffa480cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 -- 172.21.15.123:0/4264902861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa48155680 msgr2=0x7ffa480cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 --2- 172.21.15.123:0/4264902861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa48155680 0x7ffa480cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 -- 172.21.15.123:0/4264902861 >> v2:172.21.15.194:3300/0 conn(0x7ffa480ccdc0 msgr2=0x7ffa480cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 --2- 172.21.15.123:0/4264902861 >> v2:172.21.15.194:3300/0 conn(0x7ffa480ccdc0 0x7ffa480cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa4659c640 1 -- 172.21.15.123:0/4264902861 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4815b820 con 0x7ffa481552a0 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.628+0000 7ffa46d9d640 1 --2- 172.21.15.123:0/4264902861 >> v2:172.21.15.194:3300/0 conn(0x7ffa480ccdc0 0x7ffa480cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.629+0000 7ffa4659c640 1 --2- 172.21.15.123:0/4264902861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa480cb520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa480b46b0 tx=0x7ffa3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21089746f22239c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.629+0000 7ffa45d9b640 1 -- 172.21.15.123:0/4264902861 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38037070 con 0x7ffa481552a0 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.629+0000 7ffa45d9b640 1 -- 172.21.15.123:0/4264902861 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa38032440 con 0x7ffa481552a0 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.629+0000 7ffa45d9b640 1 -- 172.21.15.123:0/4264902861 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38032810 con 0x7ffa481552a0 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/4264902861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 msgr2=0x7ffa480cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/4264902861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa480cb520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa480b46b0 tx=0x7ffa3802a270 comp rx=0 tx=0).stop 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/4264902861 shutdown_connections 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/4264902861 >> v2:172.21.15.194:3300/0 conn(0x7ffa480ccdc0 0x7ffa480cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/4264902861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa48155680 0x7ffa480cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/4264902861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa480cb520 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/4264902861 >> 172.21.15.123:0/4264902861 conn(0x7ffa4806cd70 msgr2=0x7ffa4806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/4264902861 shutdown_connections 2024-09-19T09:42:38.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.630+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/4264902861 wait complete. 2024-09-19T09:42:38.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.631+0000 7ffa4cc1e640 1 Processor -- start 2024-09-19T09:42:38.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.631+0000 7ffa4cc1e640 1 -- start start 2024-09-19T09:42:38.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4cc1e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa480ccdc0 0x7ffa481f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4cc1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa481f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4cc1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480cf000 0x7ffa4814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4cc1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480cc560 con 0x7ffa481552a0 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4cc1e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4815bde0 con 0x7ffa480ccdc0 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4cc1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ffa480cc6e0 con 0x7ffa480cf000 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa481f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa481f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53912/0 (socket says 172.21.15.123:53912) 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 -- 172.21.15.123:0/2897299358 learned_addr learned my addr 172.21.15.123:0/2897299358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa46d9d640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480cf000 0x7ffa4814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa4659c640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa480ccdc0 0x7ffa481f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 -- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480cf000 msgr2=0x7ffa4814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480cf000 0x7ffa4814d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 -- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa480ccdc0 msgr2=0x7ffa481f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa480ccdc0 0x7ffa481f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 -- 172.21.15.123:0/2897299358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa480d0420 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.632+0000 7ffa3dd9b640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa481f0c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000d620 tx=0x7ffa3000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.633+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa300125f0 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.633+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa30019070 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.633+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa480ceb20 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.633+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa300129d0 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.633+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4814e5e0 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.634+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa480cc020 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.634+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa30012b70 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.634+0000 7ffa3f7fe640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa2806c2e0 0x7ffa2806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.635+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffa3008b5d0 con 0x7ffa481552a0 2024-09-19T09:42:38.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.635+0000 7ffa4659c640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa2806c2e0 0x7ffa2806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.635+0000 7ffa4659c640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa2806c2e0 0x7ffa2806e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa38034000 tx=0x7ffa3802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.639+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ffa300596f0 con 0x7ffa481552a0 2024-09-19T09:42:38.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:38.842+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffa480cafd0 con 0x7ffa481552a0 2024-09-19T09:42:39.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.519+0000 7ffa3f7fe640 1 -- 172.21.15.123:0/2897299358 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7ffa3005d9f0 con 0x7ffa481552a0 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa2806c2e0 msgr2=0x7ffa2806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa2806c2e0 0x7ffa2806e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa38034000 tx=0x7ffa3802e000 comp rx=0 tx=0).stop 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 msgr2=0x7ffa481f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa481f0c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000d620 tx=0x7ffa3000dae0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 shutdown_connections 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa2806c2e0 0x7ffa2806e7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480cf000 0x7ffa4814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa481552a0 0x7ffa481f0c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 --2- 172.21.15.123:0/2897299358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa480ccdc0 0x7ffa481f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 >> 172.21.15.123:0/2897299358 conn(0x7ffa4806cd70 msgr2=0x7ffa480c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 shutdown_connections 2024-09-19T09:42:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.522+0000 7ffa4cc1e640 1 -- 172.21.15.123:0/2897299358 wait complete. 2024-09-19T09:42:39.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-19T09:42:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.638+0000 7f9a47fa1640 1 Processor -- start 2024-09-19T09:42:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.638+0000 7f9a47fa1640 1 -- start start 2024-09-19T09:42:39.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a47fa1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9a400cd040 0x7f9a400cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a47fa1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a400cdbb0 0x7f9a4015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a47fa1640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4015b580 con 0x7f9a40155360 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a47fa1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4015c100 con 0x7f9a400cdbb0 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a47fa1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4015e910 con 0x7f9a400cd040 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a4653e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a400cdbb0 0x7f9a4015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a4653e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a400cdbb0 0x7f9a4015eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53924/0 (socket says 172.21.15.123:53924) 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a4653e640 1 -- 172.21.15.123:0/3526164224 learned_addr learned my addr 172.21.15.123:0/3526164224 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.639+0000 7f9a4553c640 1 --2- 172.21.15.123:0/3526164224 >> v2:172.21.15.194:3300/0 conn(0x7f9a400cd040 0x7f9a400cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a4653e640 1 -- 172.21.15.123:0/3526164224 >> v2:172.21.15.194:3300/0 conn(0x7f9a400cd040 msgr2=0x7f9a400cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a4653e640 1 --2- 172.21.15.123:0/3526164224 >> v2:172.21.15.194:3300/0 conn(0x7f9a400cd040 0x7f9a400cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a4653e640 1 -- 172.21.15.123:0/3526164224 >> v1:172.21.15.194:6789/0 conn(0x7f9a40155360 legacy=0x7f9a400cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a4653e640 1 -- 172.21.15.123:0/3526164224 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4015b860 con 0x7f9a400cdbb0 2024-09-19T09:42:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a4553c640 1 --2- 172.21.15.123:0/3526164224 >> v2:172.21.15.194:3300/0 conn(0x7f9a400cd040 0x7f9a400cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a4653e640 1 --2- 172.21.15.123:0/3526164224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a400cdbb0 0x7f9a4015eda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a400b3e40 tx=0x7f9a3802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47328eb673a5f3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a44d3b640 1 -- 172.21.15.123:0/3526164224 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38036070 con 0x7f9a400cdbb0 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a44d3b640 1 -- 172.21.15.123:0/3526164224 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38031600 con 0x7f9a400cdbb0 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.640+0000 7f9a44d3b640 1 -- 172.21.15.123:0/3526164224 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a380319d0 con 0x7f9a400cdbb0 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 -- 172.21.15.123:0/3526164224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a400cdbb0 msgr2=0x7f9a4015eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/3526164224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a400cdbb0 0x7f9a4015eda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a400b3e40 tx=0x7f9a3802a6f0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 -- 172.21.15.123:0/3526164224 shutdown_connections 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/3526164224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a400cdbb0 0x7f9a4015eda0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/3526164224 >> v2:172.21.15.194:3300/0 conn(0x7f9a400cd040 0x7f9a400cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 -- 172.21.15.123:0/3526164224 >> 172.21.15.123:0/3526164224 conn(0x7f9a4006cb60 msgr2=0x7f9a4006cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 -- 172.21.15.123:0/3526164224 shutdown_connections 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.641+0000 7f9a47fa1640 1 -- 172.21.15.123:0/3526164224 wait complete. 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.642+0000 7f9a47fa1640 1 Processor -- start 2024-09-19T09:42:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.642+0000 7f9a47fa1640 1 -- start start 2024-09-19T09:42:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a47fa1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a400cd040 0x7f9a4015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a47fa1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a400cdbb0 0x7f9a4014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a47fa1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 0x7f9a4015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a47fa1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40155740 con 0x7f9a40155360 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a47fa1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4015be20 con 0x7f9a400cd040 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a47fa1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9a401558c0 con 0x7f9a400cdbb0 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 0x7f9a4015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 0x7f9a4015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53936/0 (socket says 172.21.15.123:53936) 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 -- 172.21.15.123:0/1118528575 learned_addr learned my addr 172.21.15.123:0/1118528575 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4553c640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a400cdbb0 0x7f9a4014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a45d3d640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a400cd040 0x7f9a4015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 -- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a400cdbb0 msgr2=0x7f9a4014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a400cdbb0 0x7f9a4014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 -- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a400cd040 msgr2=0x7f9a4015e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a400cd040 0x7f9a4015e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 -- 172.21.15.123:0/1118528575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a401f0a50 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a4653e640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 0x7f9a4015d030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009f40 tx=0x7f9a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.643+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38036050 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.644+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38042070 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.644+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a401f0d10 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.644+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38009510 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.644+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401f12d0 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.645+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4015b160 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.645+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a38007bf0 con 0x7f9a40155360 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.646+0000 7f9a367fc640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9a2406c2b0 0x7f9a2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.646+0000 7f9a45d3d640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9a2406c2b0 0x7f9a2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.646+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9a380ac230 con 0x7f9a40155360 2024-09-19T09:42:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.646+0000 7f9a45d3d640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9a2406c2b0 0x7f9a2406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006fd0 tx=0x7f9a3c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.650+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9a3807a470 con 0x7f9a40155360 2024-09-19T09:42:39.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:39.850+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9a401f1670 con 0x7f9a40155360 2024-09-19T09:42:40.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.520+0000 7f9a367fc640 1 -- 172.21.15.123:0/1118528575 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7f9a3807e770 con 0x7f9a40155360 2024-09-19T09:42:40.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9a2406c2b0 msgr2=0x7f9a2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9a2406c2b0 0x7f9a2406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006fd0 tx=0x7f9a3c009060 comp rx=0 tx=0).stop 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 msgr2=0x7f9a4015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 0x7f9a4015d030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009f40 tx=0x7f9a38004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 shutdown_connections 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a40155360 0x7f9a4015d030 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9a2406c2b0 0x7f9a2406e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a400cdbb0 0x7f9a4014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 --2- 172.21.15.123:0/1118528575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a400cd040 0x7f9a4015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 >> 172.21.15.123:0/1118528575 conn(0x7f9a4006cb60 msgr2=0x7f9a4006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.523+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 shutdown_connections 2024-09-19T09:42:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.524+0000 7f9a47fa1640 1 -- 172.21.15.123:0/1118528575 wait complete. 2024-09-19T09:42:40.538 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:42:40.538 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:42:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.639+0000 7f315d0e4640 1 Processor -- start 2024-09-19T09:42:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.639+0000 7f315d0e4640 1 -- start start 2024-09-19T09:42:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315d0e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f315806ce90 0x7f31580ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315d0e4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f31581556c0 0x7f315815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315d0e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315815b3f0 con 0x7f315806d270 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315d0e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f315815b6d0 con 0x7f315806ce90 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315d0e4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f315815b9b0 con 0x7f31581556c0 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f3156d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f315806ce90 0x7f31580ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315659c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f315806d270 0x7f3158154fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58688/0 (socket says 172.21.15.123:58688) 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.640+0000 7f315659c640 1 -- 172.21.15.123:0/206584691 learned_addr learned my addr 172.21.15.123:0/206584691 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3155d9b640 1 -- 172.21.15.123:0/206584691 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119913704 0 0) 0x7f315815b3f0 con 0x7f315806d270 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3155d9b640 1 -- 172.21.15.123:0/206584691 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3144003520 con 0x7f315806d270 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3156d9d640 1 -- 172.21.15.123:0/206584691 >> v2:172.21.15.194:3300/0 conn(0x7f31581556c0 msgr2=0x7f315815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f315759e640 1 --2- 172.21.15.123:0/206584691 >> v2:172.21.15.194:3300/0 conn(0x7f31581556c0 0x7f315815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3156d9d640 1 --2- 172.21.15.123:0/206584691 >> v2:172.21.15.194:3300/0 conn(0x7f31581556c0 0x7f315815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3156d9d640 1 -- 172.21.15.123:0/206584691 >> v1:172.21.15.123:6789/0 conn(0x7f315806d270 legacy=0x7f3158154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3156d9d640 1 -- 172.21.15.123:0/206584691 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315815bc90 con 0x7f315806ce90 2024-09-19T09:42:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f315759e640 1 --2- 172.21.15.123:0/206584691 >> v2:172.21.15.194:3300/0 conn(0x7f31581556c0 0x7f315815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.641+0000 7f3156d9d640 1 --2- 172.21.15.123:0/206584691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806ce90 0x7f31580ce3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3158071d30 tx=0x7f314802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e36a14db07d277 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f3155d9b640 1 -- 172.21.15.123:0/206584691 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148037070 con 0x7f315806ce90 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f3155d9b640 1 -- 172.21.15.123:0/206584691 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3148032440 con 0x7f315806ce90 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f3155d9b640 1 -- 172.21.15.123:0/206584691 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148032810 con 0x7f315806ce90 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 -- 172.21.15.123:0/206584691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806ce90 msgr2=0x7f31580ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 --2- 172.21.15.123:0/206584691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806ce90 0x7f31580ce3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3158071d30 tx=0x7f314802a230 comp rx=0 tx=0).stop 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 -- 172.21.15.123:0/206584691 shutdown_connections 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 --2- 172.21.15.123:0/206584691 >> v2:172.21.15.194:3300/0 conn(0x7f31581556c0 0x7f315815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 --2- 172.21.15.123:0/206584691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806ce90 0x7f31580ce3e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 -- 172.21.15.123:0/206584691 >> 172.21.15.123:0/206584691 conn(0x7f31580cd8c0 msgr2=0x7f31580cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 -- 172.21.15.123:0/206584691 shutdown_connections 2024-09-19T09:42:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.642+0000 7f315d0e4640 1 -- 172.21.15.123:0/206584691 wait complete. 2024-09-19T09:42:40.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 Processor -- start 2024-09-19T09:42:40.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 -- start start 2024-09-19T09:42:40.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f315806ce90 0x7f315814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 0x7f315815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31581556c0 0x7f315814b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f31580c9f30 con 0x7f315806d270 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31580c9db0 con 0x7f31581556c0 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315d0e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f31580ca0b0 con 0x7f315806ce90 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.644+0000 7f315659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 0x7f315815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 0x7f315815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53958/0 (socket says 172.21.15.123:53958) 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 -- 172.21.15.123:0/912985216 learned_addr learned my addr 172.21.15.123:0/912985216 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315759e640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31581556c0 0x7f315814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f3156d9d640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f315806ce90 0x7f315814bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 -- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f315806ce90 msgr2=0x7f315814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f315806ce90 0x7f315814bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 -- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31581556c0 msgr2=0x7f315814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31581556c0 0x7f315814b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 -- 172.21.15.123:0/912985216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31581f1c30 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315759e640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31581556c0 0x7f315814b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f3156d9d640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f315806ce90 0x7f315814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315659c640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 0x7f315815df90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f314000c430 tx=0x7f314000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140017070 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3140005d00 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140007310 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31581f1ef0 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.645+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31581f4bc0 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.646+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31580778b0 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.647+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f314001a070 con 0x7f315806d270 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.647+0000 7f314f7fe640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f313806c2b0 0x7f313806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.647+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f314008a870 con 0x7f315806d270 2024-09-19T09:42:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.647+0000 7f3156d9d640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f313806c2b0 0x7f313806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.647+0000 7f3156d9d640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f313806c2b0 0x7f313806e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3148034000 tx=0x7f314802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.651+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f31580778b0 con 0x7f315806d270 2024-09-19T09:42:40.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.850+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f315815b3f0 con 0x7f315806d270 2024-09-19T09:42:40.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.851+0000 7f314f7fe640 1 -- 172.21.15.123:0/912985216 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6873 (secure 0 0 0) 0x7f315815b3f0 con 0x7f315806d270 2024-09-19T09:42:40.853 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:40.853 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"btime":"2024-09-19T09:42:40:520630+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:39.851558+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:42:40.853 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-19T09:42:40.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.852+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f313806c2b0 msgr2=0x7f313806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.852+0000 7f315d0e4640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f313806c2b0 0x7f313806e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3148034000 tx=0x7f314802e000 comp rx=0 tx=0).stop 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.852+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 msgr2=0x7f315815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.852+0000 7f315d0e4640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 0x7f315815df90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f314000c430 tx=0x7f314000c8f0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 shutdown_connections 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31581556c0 0x7f315814b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f315806d270 0x7f315815df90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f313806c2b0 0x7f313806e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 --2- 172.21.15.123:0/912985216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f315806ce90 0x7f315814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 >> 172.21.15.123:0/912985216 conn(0x7f31580cd8c0 msgr2=0x7f31580ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 shutdown_connections 2024-09-19T09:42:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.853+0000 7f315d0e4640 1 -- 172.21.15.123:0/912985216 wait complete. 2024-09-19T09:42:40.865 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:40.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.961+0000 7fa03dc7b640 1 Processor -- start 2024-09-19T09:42:40.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.962+0000 7fa03dc7b640 1 -- start start 2024-09-19T09:42:40.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.962+0000 7fa03dc7b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa03815ebb0 0x7fa03815f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.962+0000 7fa03dc7b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa03815f560 con 0x7fa0380c7740 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.962+0000 7fa03dc7b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0380c8770 con 0x7fa03815bde0 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.962+0000 7fa03dc7b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa038073090 con 0x7fa03815ebb0 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.962+0000 7fa0377fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa0380c7740 0x7fa0380705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58700/0 (socket says 172.21.15.123:58700) 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa0377fe640 1 -- 172.21.15.123:0/4216813679 learned_addr learned my addr 172.21.15.123:0/4216813679 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 --2- 172.21.15.123:0/4216813679 >> v2:172.21.15.194:3300/0 conn(0x7fa03815ebb0 0x7fa03815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160633719 0 0) 0x7fa03815f560 con 0x7fa0380c7740 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa024003520 con 0x7fa0380c7740 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1842505520 0 0) 0x7fa024003520 con 0x7fa0380c7740 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 >> v2:172.21.15.194:3300/0 conn(0x7fa03815ebb0 msgr2=0x7fa03815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:40.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 --2- 172.21.15.123:0/4216813679 >> v2:172.21.15.194:3300/0 conn(0x7fa03815ebb0 0x7fa03815f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 >> v1:172.21.15.194:6789/0 conn(0x7fa03815bde0 legacy=0x7fa03806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0380721a0 con 0x7fa0380c7740 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fa028001670 con 0x7fa0380c7740 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 >> v1:172.21.15.123:6789/0 conn(0x7fa0380c7740 legacy=0x7fa0380705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240039b0 0x7fa024003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa024004800 0x7fa024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0240051c0 0x7fa02400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa038073090 con 0x7fa0240051c0 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa02400c070 con 0x7fa024004800 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa02400c270 con 0x7fa0240039b0 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0240051c0 0x7fa02400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa02ffff640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa024004800 0x7fa024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa0377fe640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240039b0 0x7fa024003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 -- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240039b0 msgr2=0x7fa024003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240039b0 0x7fa024003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 -- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa024004800 msgr2=0x7fa024004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa024004800 0x7fa024004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.963+0000 7fa037fff640 1 -- 172.21.15.123:0/4216813679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa024003520 con 0x7fa0240051c0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.964+0000 7fa037fff640 1 -- 172.21.15.123:0/4216813679 reap_dead start 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.964+0000 7fa037fff640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0240051c0 0x7fa02400b9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fc0 tx=0x7fa024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6080382181cb096a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.964+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030035020 con 0x7fa0240051c0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.964+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa030003b90 con 0x7fa0240051c0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.964+0000 7fa036ffd640 1 -- 172.21.15.123:0/4216813679 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030009c10 con 0x7fa0240051c0 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 -- 172.21.15.123:0/4216813679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0240051c0 msgr2=0x7fa02400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0240051c0 0x7fa02400b9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fc0 tx=0x7fa024005830 comp rx=0 tx=0).stop 2024-09-19T09:42:40.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 -- 172.21.15.123:0/4216813679 shutdown_connections 2024-09-19T09:42:40.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/4216813679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0240051c0 0x7fa02400b9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 -- 172.21.15.123:0/4216813679 >> 172.21.15.123:0/4216813679 conn(0x7fa03806fa90 msgr2=0x7fa03806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:40.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 -- 172.21.15.123:0/4216813679 shutdown_connections 2024-09-19T09:42:40.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.965+0000 7fa03dc7b640 1 -- 172.21.15.123:0/4216813679 wait complete. 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.966+0000 7fa03dc7b640 1 Processor -- start 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.966+0000 7fa03dc7b640 1 -- start start 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240051c0 0x7fa038155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa038156ca0 0x7fa0380cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 0x7fa0381f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa038072a40 con 0x7fa0381f1530 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa038072760 con 0x7fa038156ca0 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa038072d20 con 0x7fa0240051c0 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 0x7fa0381f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 0x7fa0381f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53976/0 (socket says 172.21.15.123:53976) 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 -- 172.21.15.123:0/3199653050 learned_addr learned my addr 172.21.15.123:0/3199653050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:40.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa02ffff640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa038156ca0 0x7fa0380cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa0377fe640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240051c0 0x7fa038155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 -- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240051c0 msgr2=0x7fa038155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240051c0 0x7fa038155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 -- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa038156ca0 msgr2=0x7fa0380cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa038156ca0 0x7fa0380cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 -- 172.21.15.123:0/3199653050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0381f1ef0 con 0x7fa0381f1530 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa037fff640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 0x7fa0381f19b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa03000e200 tx=0x7fa030009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03003f030 con 0x7fa0381f1530 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa030003990 con 0x7fa0381f1530 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0381f47c0 con 0x7fa0381f1530 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.967+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030035070 con 0x7fa0381f1530 2024-09-19T09:42:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.968+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0381f4d60 con 0x7fa0381f1530 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.968+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03815c1c0 con 0x7fa0381f1530 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.969+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa030042030 con 0x7fa0381f1530 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.969+0000 7fa034ff9640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa01806c2b0 0x7fa01806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.970+0000 7fa0377fe640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa01806c2b0 0x7fa01806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.970+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa0300abd40 con 0x7fa0381f1530 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.970+0000 7fa0377fe640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa01806c2b0 0x7fa01806e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa028001cd0 tx=0x7fa028000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:40.974+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa0381f1ef0 con 0x7fa0381f1530 2024-09-19T09:42:41.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.142+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa03806c990 con 0x7fa0381f1530 2024-09-19T09:42:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.143+0000 7fa034ff9640 1 -- 172.21.15.123:0/3199653050 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fa030079e60 con 0x7fa0381f1530 2024-09-19T09:42:41.145 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:41.145 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:38.507234+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa01806c2b0 msgr2=0x7fa01806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa01806c2b0 0x7fa01806e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa028001cd0 tx=0x7fa028000ed0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 msgr2=0x7fa0381f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 0x7fa0381f19b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa03000e200 tx=0x7fa030009750 comp rx=0 tx=0).stop 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 shutdown_connections 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0381f1530 0x7fa0381f19b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa038156ca0 0x7fa0380cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa01806c2b0 0x7fa01806e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 --2- 172.21.15.123:0/3199653050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0240051c0 0x7fa038155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 >> 172.21.15.123:0/3199653050 conn(0x7fa03806fa90 msgr2=0x7fa03815b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 shutdown_connections 2024-09-19T09:42:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.145+0000 7fa03dc7b640 1 -- 172.21.15.123:0/3199653050 wait complete. 2024-09-19T09:42:41.158 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:42:41.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:41.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.254+0000 7fbb6cbbd640 1 Processor -- start 2024-09-19T09:42:41.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.254+0000 7fbb6cbbd640 1 -- start start 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.255+0000 7fbb6cbbd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbb68072b30 0x7fbb68159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.255+0000 7fbb6cbbd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6806e6f0 con 0x7fbb68153370 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.255+0000 7fbb6cbbd640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6806d8b0 con 0x7fbb68152f90 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.255+0000 7fbb6cbbd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6806ec70 con 0x7fbb68072b30 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbb68153370 0x7fbb68072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58712/0 (socket says 172.21.15.123:58712) 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 -- 172.21.15.123:0/3713749182 learned_addr learned my addr 172.21.15.123:0/3713749182 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683281585 0 0) 0x7fbb6806e6f0 con 0x7fbb68153370 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb54003520 con 0x7fbb68153370 2024-09-19T09:42:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb66d9d640 1 --2- 172.21.15.123:0/3713749182 >> v2:172.21.15.194:3300/0 conn(0x7fbb68072b30 0x7fbb68159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3476080825 0 0) 0x7fbb54003520 con 0x7fbb68153370 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 >> v2:172.21.15.194:3300/0 conn(0x7fbb68072b30 msgr2=0x7fbb68159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 --2- 172.21.15.123:0/3713749182 >> v2:172.21.15.194:3300/0 conn(0x7fbb68072b30 0x7fbb68159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 >> v1:172.21.15.194:6789/0 conn(0x7fbb68152f90 legacy=0x7fbb680c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6806e990 con 0x7fbb68153370 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fbb50001670 con 0x7fbb68153370 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 >> v1:172.21.15.123:6789/0 conn(0x7fbb68153370 legacy=0x7fbb68072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb540039b0 0x7fbb54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb540051c0 0x7fbb5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6806ec70 con 0x7fbb54004800 2024-09-19T09:42:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5400c060 con 0x7fbb540051c0 2024-09-19T09:42:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5400c260 con 0x7fbb540039b0 2024-09-19T09:42:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb66d9d640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb540051c0 0x7fbb5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb6659c640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb540039b0 0x7fbb54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 -- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb540039b0 msgr2=0x7fbb54003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb540039b0 0x7fbb54003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 -- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb540051c0 msgr2=0x7fbb5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb540051c0 0x7fbb5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb65d9b640 1 -- 172.21.15.123:0/3713749182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb54003520 con 0x7fbb54004800 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb66d9d640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb540051c0 0x7fbb5400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.256+0000 7fbb66d9d640 1 -- 172.21.15.123:0/3713749182 reap_dead start 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.257+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb54004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c240 tx=0x7fbb54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8de35a285b16979 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.257+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50007cf0 con 0x7fbb54004800 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.257+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb50005af0 con 0x7fbb54004800 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.257+0000 7fbb6559a640 1 -- 172.21.15.123:0/3713749182 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50007070 con 0x7fbb54004800 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/3713749182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 msgr2=0x7fbb54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb54004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c240 tx=0x7fbb54005830 comp rx=0 tx=0).stop 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/3713749182 shutdown_connections 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/3713749182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb54004c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/3713749182 >> 172.21.15.123:0/3713749182 conn(0x7fbb6806fb00 msgr2=0x7fbb6806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/3713749182 shutdown_connections 2024-09-19T09:42:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.258+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/3713749182 wait complete. 2024-09-19T09:42:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.259+0000 7fbb6cbbd640 1 Processor -- start 2024-09-19T09:42:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.259+0000 7fbb6cbbd640 1 -- start start 2024-09-19T09:42:41.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6cbbd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb68154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6cbbd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb68144ba0 0x7fbb68156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6cbbd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb681558f0 0x7fbb68155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6cbbd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68159890 con 0x7fbb54004800 2024-09-19T09:42:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6cbbd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6806e220 con 0x7fbb681558f0 2024-09-19T09:42:41.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6cbbd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fbb68159a10 con 0x7fbb68144ba0 2024-09-19T09:42:41.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb68154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb68154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53986/0 (socket says 172.21.15.123:53986) 2024-09-19T09:42:41.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 -- 172.21.15.123:0/2457440019 learned_addr learned my addr 172.21.15.123:0/2457440019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:41.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb68144ba0 0x7fbb68156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb66d9d640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb681558f0 0x7fbb68155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 -- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb68144ba0 msgr2=0x7fbb68156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb68144ba0 0x7fbb68156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 -- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb681558f0 msgr2=0x7fbb68155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb681558f0 0x7fbb68155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 -- 172.21.15.123:0/2457440019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb681562b0 con 0x7fbb54004800 2024-09-19T09:42:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb6659c640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb68154090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800e4c0 tx=0x7fbb5800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.260+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb580052e0 con 0x7fbb54004800 2024-09-19T09:42:41.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.261+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb58018070 con 0x7fbb54004800 2024-09-19T09:42:41.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.261+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb680c6180 con 0x7fbb54004800 2024-09-19T09:42:41.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.261+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58003830 con 0x7fbb54004800 2024-09-19T09:42:41.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.261+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb68154e10 con 0x7fbb54004800 2024-09-19T09:42:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.262+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6806c520 con 0x7fbb54004800 2024-09-19T09:42:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.262+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb580039d0 con 0x7fbb54004800 2024-09-19T09:42:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.262+0000 7fbb5effd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fbb4806c2b0 0x7fbb4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.263+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fbb4806c2b0 0x7fbb4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.263+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbb5808b010 con 0x7fbb54004800 2024-09-19T09:42:41.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.263+0000 7fbb65d9b640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fbb4806c2b0 0x7fbb4806e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb50032000 tx=0x7fbb50009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.267+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbb681562b0 con 0x7fbb54004800 2024-09-19T09:42:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.429+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb68155510 con 0x7fbb4806c2b0 2024-09-19T09:42:41.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.436+0000 7fbb5effd640 1 -- 172.21.15.123:0/2457440019 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251007 (secure 0 0 0) 0x7fbb68155510 con 0x7fbb4806c2b0 2024-09-19T09:42:41.442 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:41.444 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:41.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fbb4806c2b0 msgr2=0x7fbb4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fbb4806c2b0 0x7fbb4806e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb50032000 tx=0x7fbb50009030 comp rx=0 tx=0).stop 2024-09-19T09:42:41.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 msgr2=0x7fbb68154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb68154090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800e4c0 tx=0x7fbb5800e980 comp rx=0 tx=0).stop 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 shutdown_connections 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb681558f0 0x7fbb68155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fbb4806c2b0 0x7fbb4806e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb68144ba0 0x7fbb68156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 --2- 172.21.15.123:0/2457440019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb54004800 0x7fbb68154090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 >> 172.21.15.123:0/2457440019 conn(0x7fbb6806fb00 msgr2=0x7fbb68150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 shutdown_connections 2024-09-19T09:42:41.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.439+0000 7fbb6cbbd640 1 -- 172.21.15.123:0/2457440019 wait complete. 2024-09-19T09:42:41.451 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-19T09:42:40.697243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219028,"kb_used_data":2780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755692,"statfs":{"total":773094113280,"available":772869828608,"internally_reserved":0,"allocated":2846720,"data_stored":1719741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.218314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529577+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:37.529577+0000","last_peered":"2024-09-19T09:42:37.529577+0000","last_clean":"2024-09-19T09:42:37.529577+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:37.529577+0000","last_undegraded":"2024-09-19T09:42:37.529577+0000","last_fullsized":"2024-09-19T09:42:37.529577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:10.159162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523191+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:37.523191+0000","last_peered":"2024-09-19T09:42:37.523191+0000","last_clean":"2024-09-19T09:42:37.523191+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:37.523191+0000","last_undegraded":"2024-09-19T09:42:37.523191+0000","last_fullsized":"2024-09-19T09:42:37.523191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.777780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523616+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:37.523616+0000","last_peered":"2024-09-19T09:42:37.523616+0000","last_clean":"2024-09-19T09:42:37.523616+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:37.523616+0000","last_undegraded":"2024-09-19T09:42:37.523616+0000","last_fullsized":"2024-09-19T09:42:37.523616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:51.494981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526042+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:37.526042+0000","last_peered":"2024-09-19T09:42:37.526042+0000","last_clean":"2024-09-19T09:42:37.526042+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:37.526042+0000","last_undegraded":"2024-09-19T09:42:37.526042+0000","last_fullsized":"2024-09-19T09:42:37.526042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:25.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529624+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:37.529624+0000","last_peered":"2024-09-19T09:42:37.529624+0000","last_clean":"2024-09-19T09:42:37.529624+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:37.529624+0000","last_undegraded":"2024-09-19T09:42:37.529624+0000","last_fullsized":"2024-09-19T09:42:37.529624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:24.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524376+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:37.524376+0000","last_peered":"2024-09-19T09:42:37.524376+0000","last_clean":"2024-09-19T09:42:37.524376+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:37.524376+0000","last_undegraded":"2024-09-19T09:42:37.524376+0000","last_fullsized":"2024-09-19T09:42:37.524376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:40.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529109+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:37.529109+0000","last_peered":"2024-09-19T09:42:37.529109+0000","last_clean":"2024-09-19T09:42:37.529109+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:37.529109+0000","last_undegraded":"2024-09-19T09:42:37.529109+0000","last_fullsized":"2024-09-19T09:42:37.529109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:44.704108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520920+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:37.520920+0000","last_peered":"2024-09-19T09:42:37.520920+0000","last_clean":"2024-09-19T09:42:37.520920+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:37.520920+0000","last_undegraded":"2024-09-19T09:42:37.520920+0000","last_fullsized":"2024-09-19T09:42:37.520920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:46.803436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529710+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:37.529710+0000","last_peered":"2024-09-19T09:42:37.529710+0000","last_clean":"2024-09-19T09:42:37.529710+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:37.529710+0000","last_undegraded":"2024-09-19T09:42:37.529710+0000","last_fullsized":"2024-09-19T09:42:37.529710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:45.955881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524134+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:37.524134+0000","last_peered":"2024-09-19T09:42:37.524134+0000","last_clean":"2024-09-19T09:42:37.524134+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:37.524134+0000","last_undegraded":"2024-09-19T09:42:37.524134+0000","last_fullsized":"2024-09-19T09:42:37.524134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:10.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525755+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:37.525755+0000","last_peered":"2024-09-19T09:42:37.525755+0000","last_clean":"2024-09-19T09:42:37.525755+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:37.525755+0000","last_undegraded":"2024-09-19T09:42:37.525755+0000","last_fullsized":"2024-09-19T09:42:37.525755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:07.412836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520319+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:37.520319+0000","last_peered":"2024-09-19T09:42:37.520319+0000","last_clean":"2024-09-19T09:42:37.520319+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:37.520319+0000","last_undegraded":"2024-09-19T09:42:37.520319+0000","last_fullsized":"2024-09-19T09:42:37.520319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:45.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520948+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:37.520948+0000","last_peered":"2024-09-19T09:42:37.520948+0000","last_clean":"2024-09-19T09:42:37.520948+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:37.520948+0000","last_undegraded":"2024-09-19T09:42:37.520948+0000","last_fullsized":"2024-09-19T09:42:37.520948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:02.040571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520757+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:37.520757+0000","last_peered":"2024-09-19T09:42:37.520757+0000","last_clean":"2024-09-19T09:42:37.520757+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:37.520757+0000","last_undegraded":"2024-09-19T09:42:37.520757+0000","last_fullsized":"2024-09-19T09:42:37.520757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:50.287624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:37.521650+0000","last_peered":"2024-09-19T09:42:37.521650+0000","last_clean":"2024-09-19T09:42:37.521650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:37.521650+0000","last_undegraded":"2024-09-19T09:42:37.521650+0000","last_fullsized":"2024-09-19T09:42:37.521650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:14.066276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523708+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:37.523708+0000","last_peered":"2024-09-19T09:42:37.523708+0000","last_clean":"2024-09-19T09:42:37.523708+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:37.523708+0000","last_undegraded":"2024-09-19T09:42:37.523708+0000","last_fullsized":"2024-09-19T09:42:37.523708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:52.065555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526078+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:37.526078+0000","last_peered":"2024-09-19T09:42:37.526078+0000","last_clean":"2024-09-19T09:42:37.526078+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:37.526078+0000","last_undegraded":"2024-09-19T09:42:37.526078+0000","last_fullsized":"2024-09-19T09:42:37.526078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:39.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:42:36.478070+0000","last_change":"2024-09-19T09:42:36.478070+0000","last_active":"2024-09-19T09:42:36.478070+0000","last_peered":"2024-09-19T09:42:36.478070+0000","last_clean":"2024-09-19T09:42:36.478070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:36.478070+0000","last_undegraded":"2024-09-19T09:42:36.478070+0000","last_fullsized":"2024-09-19T09:42:36.478070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529641+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:37.529641+0000","last_peered":"2024-09-19T09:42:37.529641+0000","last_clean":"2024-09-19T09:42:37.529641+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:37.529641+0000","last_undegraded":"2024-09-19T09:42:37.529641+0000","last_fullsized":"2024-09-19T09:42:37.529641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:22.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516538+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:37.516538+0000","last_peered":"2024-09-19T09:42:37.516538+0000","last_clean":"2024-09-19T09:42:37.516538+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:37.516538+0000","last_undegraded":"2024-09-19T09:42:37.516538+0000","last_fullsized":"2024-09-19T09:42:37.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:05.295037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525935+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:37.525935+0000","last_peered":"2024-09-19T09:42:37.525935+0000","last_clean":"2024-09-19T09:42:37.525935+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:37.525935+0000","last_undegraded":"2024-09-19T09:42:37.525935+0000","last_fullsized":"2024-09-19T09:42:37.525935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:34.313085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527336+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:37.527336+0000","last_peered":"2024-09-19T09:42:37.527336+0000","last_clean":"2024-09-19T09:42:37.527336+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:37.527336+0000","last_undegraded":"2024-09-19T09:42:37.527336+0000","last_fullsized":"2024-09-19T09:42:37.527336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:47.771515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520871+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:37.520871+0000","last_peered":"2024-09-19T09:42:37.520871+0000","last_clean":"2024-09-19T09:42:37.520871+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:37.520871+0000","last_undegraded":"2024-09-19T09:42:37.520871+0000","last_fullsized":"2024-09-19T09:42:37.520871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:59.689786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517517+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:37.517517+0000","last_peered":"2024-09-19T09:42:37.517517+0000","last_clean":"2024-09-19T09:42:37.517517+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:37.517517+0000","last_undegraded":"2024-09-19T09:42:37.517517+0000","last_fullsized":"2024-09-19T09:42:37.517517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:08.090159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520818+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:37.520818+0000","last_peered":"2024-09-19T09:42:37.520818+0000","last_clean":"2024-09-19T09:42:37.520818+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:37.520818+0000","last_undegraded":"2024-09-19T09:42:37.520818+0000","last_fullsized":"2024-09-19T09:42:37.520818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.323217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524154+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:37.524154+0000","last_peered":"2024-09-19T09:42:37.524154+0000","last_clean":"2024-09-19T09:42:37.524154+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:37.524154+0000","last_undegraded":"2024-09-19T09:42:37.524154+0000","last_fullsized":"2024-09-19T09:42:37.524154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515438+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:37.515438+0000","last_peered":"2024-09-19T09:42:37.515438+0000","last_clean":"2024-09-19T09:42:37.515438+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:37.515438+0000","last_undegraded":"2024-09-19T09:42:37.515438+0000","last_fullsized":"2024-09-19T09:42:37.515438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520798+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:37.520798+0000","last_peered":"2024-09-19T09:42:37.520798+0000","last_clean":"2024-09-19T09:42:37.520798+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:37.520798+0000","last_undegraded":"2024-09-19T09:42:37.520798+0000","last_fullsized":"2024-09-19T09:42:37.520798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520942+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:37.520942+0000","last_peered":"2024-09-19T09:42:37.520942+0000","last_clean":"2024-09-19T09:42:37.520942+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:37.520942+0000","last_undegraded":"2024-09-19T09:42:37.520942+0000","last_fullsized":"2024-09-19T09:42:37.520942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:13.898264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524356+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:37.524356+0000","last_peered":"2024-09-19T09:42:37.524356+0000","last_clean":"2024-09-19T09:42:37.524356+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:37.524356+0000","last_undegraded":"2024-09-19T09:42:37.524356+0000","last_fullsized":"2024-09-19T09:42:37.524356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:39.510007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:42:36.478070+0000","last_change":"2024-09-19T09:42:36.478070+0000","last_active":"2024-09-19T09:42:36.478070+0000","last_peered":"2024-09-19T09:42:36.478070+0000","last_clean":"2024-09-19T09:42:36.478070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:36.478070+0000","last_undegraded":"2024-09-19T09:42:36.478070+0000","last_fullsized":"2024-09-19T09:42:36.478070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521393+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:37.521393+0000","last_peered":"2024-09-19T09:42:37.521393+0000","last_clean":"2024-09-19T09:42:37.521393+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:37.521393+0000","last_undegraded":"2024-09-19T09:42:37.521393+0000","last_fullsized":"2024-09-19T09:42:37.521393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.944545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521400+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:37.521400+0000","last_peered":"2024-09-19T09:42:37.521400+0000","last_clean":"2024-09-19T09:42:37.521400+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:37.521400+0000","last_undegraded":"2024-09-19T09:42:37.521400+0000","last_fullsized":"2024-09-19T09:42:37.521400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.057699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507486+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:37.507486+0000","last_peered":"2024-09-19T09:42:37.507486+0000","last_clean":"2024-09-19T09:42:37.507486+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:37.507486+0000","last_undegraded":"2024-09-19T09:42:37.507486+0000","last_fullsized":"2024-09-19T09:42:37.507486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520917+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:37.520917+0000","last_peered":"2024-09-19T09:42:37.520917+0000","last_clean":"2024-09-19T09:42:37.520917+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:37.520917+0000","last_undegraded":"2024-09-19T09:42:37.520917+0000","last_fullsized":"2024-09-19T09:42:37.520917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:51.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505395+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:37.505395+0000","last_peered":"2024-09-19T09:42:37.505395+0000","last_clean":"2024-09-19T09:42:37.505395+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:37.505395+0000","last_undegraded":"2024-09-19T09:42:37.505395+0000","last_fullsized":"2024-09-19T09:42:37.505395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507659+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:37.507659+0000","last_peered":"2024-09-19T09:42:37.507659+0000","last_clean":"2024-09-19T09:42:37.507659+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:37.507659+0000","last_undegraded":"2024-09-19T09:42:37.507659+0000","last_fullsized":"2024-09-19T09:42:37.507659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523337+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:37.523337+0000","last_peered":"2024-09-19T09:42:37.523337+0000","last_clean":"2024-09-19T09:42:37.523337+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:37.523337+0000","last_undegraded":"2024-09-19T09:42:37.523337+0000","last_fullsized":"2024-09-19T09:42:37.523337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:20.911082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512065+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:37.512065+0000","last_peered":"2024-09-19T09:42:37.512065+0000","last_clean":"2024-09-19T09:42:37.512065+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:37.512065+0000","last_undegraded":"2024-09-19T09:42:37.512065+0000","last_fullsized":"2024-09-19T09:42:37.512065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521678+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:37.521678+0000","last_peered":"2024-09-19T09:42:37.521678+0000","last_clean":"2024-09-19T09:42:37.521678+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:37.521678+0000","last_undegraded":"2024-09-19T09:42:37.521678+0000","last_fullsized":"2024-09-19T09:42:37.521678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:14.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506024+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:37.506024+0000","last_peered":"2024-09-19T09:42:37.506024+0000","last_clean":"2024-09-19T09:42:37.506024+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:37.506024+0000","last_undegraded":"2024-09-19T09:42:37.506024+0000","last_fullsized":"2024-09-19T09:42:37.506024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527680+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:37.527680+0000","last_peered":"2024-09-19T09:42:37.527680+0000","last_clean":"2024-09-19T09:42:37.527680+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:37.527680+0000","last_undegraded":"2024-09-19T09:42:37.527680+0000","last_fullsized":"2024-09-19T09:42:37.527680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:17.246201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.511783+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:37.511783+0000","last_peered":"2024-09-19T09:42:37.511783+0000","last_clean":"2024-09-19T09:42:37.511783+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:37.511783+0000","last_undegraded":"2024-09-19T09:42:37.511783+0000","last_fullsized":"2024-09-19T09:42:37.511783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525925+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:37.525925+0000","last_peered":"2024-09-19T09:42:37.525925+0000","last_clean":"2024-09-19T09:42:37.525925+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:37.525925+0000","last_undegraded":"2024-09-19T09:42:37.525925+0000","last_fullsized":"2024-09-19T09:42:37.525925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:59.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504525+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:37.504525+0000","last_peered":"2024-09-19T09:42:37.504525+0000","last_clean":"2024-09-19T09:42:37.504525+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:37.504525+0000","last_undegraded":"2024-09-19T09:42:37.504525+0000","last_fullsized":"2024-09-19T09:42:37.504525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526780+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:37.526780+0000","last_peered":"2024-09-19T09:42:37.526780+0000","last_clean":"2024-09-19T09:42:37.526780+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:37.526780+0000","last_undegraded":"2024-09-19T09:42:37.526780+0000","last_fullsized":"2024-09-19T09:42:37.526780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:27.841112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505747+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:37.505747+0000","last_peered":"2024-09-19T09:42:37.505747+0000","last_clean":"2024-09-19T09:42:37.505747+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:37.505747+0000","last_undegraded":"2024-09-19T09:42:37.505747+0000","last_fullsized":"2024-09-19T09:42:37.505747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529045+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:37.529045+0000","last_peered":"2024-09-19T09:42:37.529045+0000","last_clean":"2024-09-19T09:42:37.529045+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:37.529045+0000","last_undegraded":"2024-09-19T09:42:37.529045+0000","last_fullsized":"2024-09-19T09:42:37.529045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.641481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506728+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:37.506728+0000","last_peered":"2024-09-19T09:42:37.506728+0000","last_clean":"2024-09-19T09:42:37.506728+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:37.506728+0000","last_undegraded":"2024-09-19T09:42:37.506728+0000","last_fullsized":"2024-09-19T09:42:37.506728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528358+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:37.528358+0000","last_peered":"2024-09-19T09:42:37.528358+0000","last_clean":"2024-09-19T09:42:37.528358+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:37.528358+0000","last_undegraded":"2024-09-19T09:42:37.528358+0000","last_fullsized":"2024-09-19T09:42:37.528358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.218733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512692+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:37.512692+0000","last_peered":"2024-09-19T09:42:37.512692+0000","last_clean":"2024-09-19T09:42:37.512692+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:37.512692+0000","last_undegraded":"2024-09-19T09:42:37.512692+0000","last_fullsized":"2024-09-19T09:42:37.512692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529678+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:37.529678+0000","last_peered":"2024-09-19T09:42:37.529678+0000","last_clean":"2024-09-19T09:42:37.529678+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:37.529678+0000","last_undegraded":"2024-09-19T09:42:37.529678+0000","last_fullsized":"2024-09-19T09:42:37.529678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.537917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505904+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:37.505904+0000","last_peered":"2024-09-19T09:42:37.505904+0000","last_clean":"2024-09-19T09:42:37.505904+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:37.505904+0000","last_undegraded":"2024-09-19T09:42:37.505904+0000","last_fullsized":"2024-09-19T09:42:37.505904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:37.521415+0000","last_peered":"2024-09-19T09:42:37.521415+0000","last_clean":"2024-09-19T09:42:37.521415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:37.521415+0000","last_undegraded":"2024-09-19T09:42:37.521415+0000","last_fullsized":"2024-09-19T09:42:37.521415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:43.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488432+0000","last_change":"2024-09-19T09:42:35.488432+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488432+0000","last_undegraded":"2024-09-19T09:42:35.488432+0000","last_fullsized":"2024-09-19T09:42:35.488432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528927+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:37.528927+0000","last_peered":"2024-09-19T09:42:37.528927+0000","last_clean":"2024-09-19T09:42:37.528927+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:37.528927+0000","last_undegraded":"2024-09-19T09:42:37.528927+0000","last_fullsized":"2024-09-19T09:42:37.528927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:58.084932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505607+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:37.505607+0000","last_peered":"2024-09-19T09:42:37.505607+0000","last_clean":"2024-09-19T09:42:37.505607+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:37.505607+0000","last_undegraded":"2024-09-19T09:42:37.505607+0000","last_fullsized":"2024-09-19T09:42:37.505607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529704+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:37.529704+0000","last_peered":"2024-09-19T09:42:37.529704+0000","last_clean":"2024-09-19T09:42:37.529704+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:37.529704+0000","last_undegraded":"2024-09-19T09:42:37.529704+0000","last_fullsized":"2024-09-19T09:42:37.529704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:51.417176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488491+0000","last_change":"2024-09-19T09:42:35.488491+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488491+0000","last_undegraded":"2024-09-19T09:42:35.488491+0000","last_fullsized":"2024-09-19T09:42:35.488491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529677+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:37.529677+0000","last_peered":"2024-09-19T09:42:37.529677+0000","last_clean":"2024-09-19T09:42:37.529677+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:37.529677+0000","last_undegraded":"2024-09-19T09:42:37.529677+0000","last_fullsized":"2024-09-19T09:42:37.529677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:30.350852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504671+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:37.504671+0000","last_peered":"2024-09-19T09:42:37.504671+0000","last_clean":"2024-09-19T09:42:37.504671+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:37.504671+0000","last_undegraded":"2024-09-19T09:42:37.504671+0000","last_fullsized":"2024-09-19T09:42:37.504671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526017+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:37.526017+0000","last_peered":"2024-09-19T09:42:37.526017+0000","last_clean":"2024-09-19T09:42:37.526017+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:37.526017+0000","last_undegraded":"2024-09-19T09:42:37.526017+0000","last_fullsized":"2024-09-19T09:42:37.526017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:12.483808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488374+0000","last_change":"2024-09-19T09:42:35.488374+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488374+0000","last_undegraded":"2024-09-19T09:42:35.488374+0000","last_fullsized":"2024-09-19T09:42:35.488374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529579+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:37.529579+0000","last_peered":"2024-09-19T09:42:37.529579+0000","last_clean":"2024-09-19T09:42:37.529579+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:37.529579+0000","last_undegraded":"2024-09-19T09:42:37.529579+0000","last_fullsized":"2024-09-19T09:42:37.529579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:22.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517484+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:37.517484+0000","last_peered":"2024-09-19T09:42:37.517484+0000","last_clean":"2024-09-19T09:42:37.517484+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:37.517484+0000","last_undegraded":"2024-09-19T09:42:37.517484+0000","last_fullsized":"2024-09-19T09:42:37.517484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.510554+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:37.510554+0000","last_peered":"2024-09-19T09:42:37.510554+0000","last_clean":"2024-09-19T09:42:37.510554+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:37.510554+0000","last_undegraded":"2024-09-19T09:42:37.510554+0000","last_fullsized":"2024-09-19T09:42:37.510554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525865+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:37.525865+0000","last_peered":"2024-09-19T09:42:37.525865+0000","last_clean":"2024-09-19T09:42:37.525865+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:37.525865+0000","last_undegraded":"2024-09-19T09:42:37.525865+0000","last_fullsized":"2024-09-19T09:42:37.525865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:02.766622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517823+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:37.517823+0000","last_peered":"2024-09-19T09:42:37.517823+0000","last_clean":"2024-09-19T09:42:37.517823+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:37.517823+0000","last_undegraded":"2024-09-19T09:42:37.517823+0000","last_fullsized":"2024-09-19T09:42:37.517823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520670+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:37.520670+0000","last_peered":"2024-09-19T09:42:37.520670+0000","last_clean":"2024-09-19T09:42:37.520670+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:37.520670+0000","last_undegraded":"2024-09-19T09:42:37.520670+0000","last_fullsized":"2024-09-19T09:42:37.520670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488376+0000","last_change":"2024-09-19T09:42:35.488376+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488376+0000","last_undegraded":"2024-09-19T09:42:35.488376+0000","last_fullsized":"2024-09-19T09:42:35.488376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515746+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:37.515746+0000","last_peered":"2024-09-19T09:42:37.515746+0000","last_clean":"2024-09-19T09:42:37.515746+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:37.515746+0000","last_undegraded":"2024-09-19T09:42:37.515746+0000","last_fullsized":"2024-09-19T09:42:37.515746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512835+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:37.512835+0000","last_peered":"2024-09-19T09:42:37.512835+0000","last_clean":"2024-09-19T09:42:37.512835+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:37.512835+0000","last_undegraded":"2024-09-19T09:42:37.512835+0000","last_fullsized":"2024-09-19T09:42:37.512835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.522538+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:37.522538+0000","last_peered":"2024-09-19T09:42:37.522538+0000","last_clean":"2024-09-19T09:42:37.522538+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:37.522538+0000","last_undegraded":"2024-09-19T09:42:37.522538+0000","last_fullsized":"2024-09-19T09:42:37.522538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:36.990463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504431+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:37.504431+0000","last_peered":"2024-09-19T09:42:37.504431+0000","last_clean":"2024-09-19T09:42:37.504431+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:37.504431+0000","last_undegraded":"2024-09-19T09:42:37.504431+0000","last_fullsized":"2024-09-19T09:42:37.504431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527661+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:37.527661+0000","last_peered":"2024-09-19T09:42:37.527661+0000","last_clean":"2024-09-19T09:42:37.527661+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:37.527661+0000","last_undegraded":"2024-09-19T09:42:37.527661+0000","last_fullsized":"2024-09-19T09:42:37.527661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:46.760134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519991+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:37.519991+0000","last_peered":"2024-09-19T09:42:37.519991+0000","last_clean":"2024-09-19T09:42:37.519991+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:37.519991+0000","last_undegraded":"2024-09-19T09:42:37.519991+0000","last_fullsized":"2024-09-19T09:42:37.519991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516012+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:37.516012+0000","last_peered":"2024-09-19T09:42:37.516012+0000","last_clean":"2024-09-19T09:42:37.516012+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:37.516012+0000","last_undegraded":"2024-09-19T09:42:37.516012+0000","last_fullsized":"2024-09-19T09:42:37.516012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:49.909733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504564+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:37.504564+0000","last_peered":"2024-09-19T09:42:37.504564+0000","last_clean":"2024-09-19T09:42:37.504564+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:37.504564+0000","last_undegraded":"2024-09-19T09:42:37.504564+0000","last_fullsized":"2024-09-19T09:42:37.504564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528430+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:37.528430+0000","last_peered":"2024-09-19T09:42:37.528430+0000","last_clean":"2024-09-19T09:42:37.528430+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:37.528430+0000","last_undegraded":"2024-09-19T09:42:37.528430+0000","last_fullsized":"2024-09-19T09:42:37.528430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:18.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506210+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:37.506210+0000","last_peered":"2024-09-19T09:42:37.506210+0000","last_clean":"2024-09-19T09:42:37.506210+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:37.506210+0000","last_undegraded":"2024-09-19T09:42:37.506210+0000","last_fullsized":"2024-09-19T09:42:37.506210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520831+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:37.520831+0000","last_peered":"2024-09-19T09:42:37.520831+0000","last_clean":"2024-09-19T09:42:37.520831+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:37.520831+0000","last_undegraded":"2024-09-19T09:42:37.520831+0000","last_fullsized":"2024-09-19T09:42:37.520831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:11.793665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517432+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:37.517432+0000","last_peered":"2024-09-19T09:42:37.517432+0000","last_clean":"2024-09-19T09:42:37.517432+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:37.517432+0000","last_undegraded":"2024-09-19T09:42:37.517432+0000","last_fullsized":"2024-09-19T09:42:37.517432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512844+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:37.512844+0000","last_peered":"2024-09-19T09:42:37.512844+0000","last_clean":"2024-09-19T09:42:37.512844+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:37.512844+0000","last_undegraded":"2024-09-19T09:42:37.512844+0000","last_fullsized":"2024-09-19T09:42:37.512844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:25.197598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504951+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:37.504951+0000","last_peered":"2024-09-19T09:42:37.504951+0000","last_clean":"2024-09-19T09:42:37.504951+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:37.504951+0000","last_undegraded":"2024-09-19T09:42:37.504951+0000","last_fullsized":"2024-09-19T09:42:37.504951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523317+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:37.523317+0000","last_peered":"2024-09-19T09:42:37.523317+0000","last_clean":"2024-09-19T09:42:37.523317+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:37.523317+0000","last_undegraded":"2024-09-19T09:42:37.523317+0000","last_fullsized":"2024-09-19T09:42:37.523317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:32.907310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504328+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:37.504328+0000","last_peered":"2024-09-19T09:42:37.504328+0000","last_clean":"2024-09-19T09:42:37.504328+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:37.504328+0000","last_undegraded":"2024-09-19T09:42:37.504328+0000","last_fullsized":"2024-09-19T09:42:37.504328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523363+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:37.523363+0000","last_peered":"2024-09-19T09:42:37.523363+0000","last_clean":"2024-09-19T09:42:37.523363+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:37.523363+0000","last_undegraded":"2024-09-19T09:42:37.523363+0000","last_fullsized":"2024-09-19T09:42:37.523363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:18.634777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518619+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:37.518619+0000","last_peered":"2024-09-19T09:42:37.518619+0000","last_clean":"2024-09-19T09:42:37.518619+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:37.518619+0000","last_undegraded":"2024-09-19T09:42:37.518619+0000","last_fullsized":"2024-09-19T09:42:37.518619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521363+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:37.521363+0000","last_peered":"2024-09-19T09:42:37.521363+0000","last_clean":"2024-09-19T09:42:37.521363+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:37.521363+0000","last_undegraded":"2024-09-19T09:42:37.521363+0000","last_fullsized":"2024-09-19T09:42:37.521363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:14.796097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524033+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:37.524033+0000","last_peered":"2024-09-19T09:42:37.524033+0000","last_clean":"2024-09-19T09:42:37.524033+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:37.524033+0000","last_undegraded":"2024-09-19T09:42:37.524033+0000","last_fullsized":"2024-09-19T09:42:37.524033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518495+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:37.518495+0000","last_peered":"2024-09-19T09:42:37.518495+0000","last_clean":"2024-09-19T09:42:37.518495+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:37.518495+0000","last_undegraded":"2024-09-19T09:42:37.518495+0000","last_fullsized":"2024-09-19T09:42:37.518495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524588+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:37.524588+0000","last_peered":"2024-09-19T09:42:37.524588+0000","last_clean":"2024-09-19T09:42:37.524588+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:37.524588+0000","last_undegraded":"2024-09-19T09:42:37.524588+0000","last_fullsized":"2024-09-19T09:42:37.524588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:38.753135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519528+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:37.519528+0000","last_peered":"2024-09-19T09:42:37.519528+0000","last_clean":"2024-09-19T09:42:37.519528+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:37.519528+0000","last_undegraded":"2024-09-19T09:42:37.519528+0000","last_fullsized":"2024-09-19T09:42:37.519528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525904+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:37.525904+0000","last_peered":"2024-09-19T09:42:37.525904+0000","last_clean":"2024-09-19T09:42:37.525904+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:37.525904+0000","last_undegraded":"2024-09-19T09:42:37.525904+0000","last_fullsized":"2024-09-19T09:42:37.525904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:23.577488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507762+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:37.507762+0000","last_peered":"2024-09-19T09:42:37.507762+0000","last_clean":"2024-09-19T09:42:37.507762+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:37.507762+0000","last_undegraded":"2024-09-19T09:42:37.507762+0000","last_fullsized":"2024-09-19T09:42:37.507762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521745+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:37.521745+0000","last_peered":"2024-09-19T09:42:37.521745+0000","last_clean":"2024-09-19T09:42:37.521745+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:37.521745+0000","last_undegraded":"2024-09-19T09:42:37.521745+0000","last_fullsized":"2024-09-19T09:42:37.521745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:13.952632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506615+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:37.506615+0000","last_peered":"2024-09-19T09:42:37.506615+0000","last_clean":"2024-09-19T09:42:37.506615+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:37.506615+0000","last_undegraded":"2024-09-19T09:42:37.506615+0000","last_fullsized":"2024-09-19T09:42:37.506615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":124,"acting":124,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:41.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:41.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.589+0000 7f244c22e640 1 Processor -- start 2024-09-19T09:42:41.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.589+0000 7f244c22e640 1 -- start start 2024-09-19T09:42:41.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f244c22e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f24440c95e0 0x7f244415f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f244c22e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f244c22e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24440c9ce0 con 0x7f24441588e0 2024-09-19T09:42:41.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f244c22e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f244415f650 con 0x7f24440c95e0 2024-09-19T09:42:41.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f244c22e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f24440c9a10 con 0x7f24440cb670 2024-09-19T09:42:41.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f244a7cb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f24497c9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f24440c95e0 0x7f244415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f2449fca640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f24441588e0 0x7f24440ca3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:41322/0 (socket says 172.21.15.123:41322) 2024-09-19T09:42:41.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.590+0000 7f2449fca640 1 -- 172.21.15.123:0/4265165301 learned_addr learned my addr 172.21.15.123:0/4265165301 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:41.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.591+0000 7f244a7cb640 1 -- 172.21.15.123:0/4265165301 >> v2:172.21.15.194:3300/0 conn(0x7f24440c95e0 msgr2=0x7f244415f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.591+0000 7f2448fc8640 1 -- 172.21.15.123:0/4265165301 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574359381 0 0) 0x7f24440c9ce0 con 0x7f24441588e0 2024-09-19T09:42:41.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.591+0000 7f244a7cb640 1 --2- 172.21.15.123:0/4265165301 >> v2:172.21.15.194:3300/0 conn(0x7f24440c95e0 0x7f244415f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.591+0000 7f244a7cb640 1 -- 172.21.15.123:0/4265165301 >> v1:172.21.15.194:6789/0 conn(0x7f24441588e0 legacy=0x7f24440ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.591+0000 7f244a7cb640 1 -- 172.21.15.123:0/4265165301 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440c9f80 con 0x7f24440cb670 2024-09-19T09:42:41.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.591+0000 7f24497c9640 1 --2- 172.21.15.123:0/4265165301 >> v2:172.21.15.194:3300/0 conn(0x7f24440c95e0 0x7f244415f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:41.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244a7cb640 1 --2- 172.21.15.123:0/4265165301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440cba80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f243c009d90 tx=0x7f243c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942d2bbdf2734275 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f2448fc8640 1 -- 172.21.15.123:0/4265165301 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c007740 con 0x7f24440cb670 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f2448fc8640 1 -- 172.21.15.123:0/4265165301 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0078e0 con 0x7f24440cb670 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f2448fc8640 1 -- 172.21.15.123:0/4265165301 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c007cb0 con 0x7f24440cb670 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 -- 172.21.15.123:0/4265165301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 msgr2=0x7f24440cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 --2- 172.21.15.123:0/4265165301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440cba80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f243c009d90 tx=0x7f243c02a6f0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 -- 172.21.15.123:0/4265165301 shutdown_connections 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 --2- 172.21.15.123:0/4265165301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440cba80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 --2- 172.21.15.123:0/4265165301 >> v2:172.21.15.194:3300/0 conn(0x7f24440c95e0 0x7f244415f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 -- 172.21.15.123:0/4265165301 >> 172.21.15.123:0/4265165301 conn(0x7f2444073950 msgr2=0x7f2444070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 -- 172.21.15.123:0/4265165301 shutdown_connections 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.592+0000 7f244c22e640 1 -- 172.21.15.123:0/4265165301 wait complete. 2024-09-19T09:42:41.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 Processor -- start 2024-09-19T09:42:41.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 -- start start 2024-09-19T09:42:41.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24440c95e0 0x7f2444151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 0x7f24441f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f244415b860 con 0x7f24441588e0 2024-09-19T09:42:41.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f244415b580 con 0x7f24440c95e0 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244c22e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f24440caae0 con 0x7f24440cb670 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244a7cb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 0x7f24441f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244a7cb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 0x7f24441f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53988/0 (socket says 172.21.15.123:53988) 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f244a7cb640 1 -- 172.21.15.123:0/976588777 learned_addr learned my addr 172.21.15.123:0/976588777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f2449fca640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24440c95e0 0x7f2444151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.594+0000 7f24497c9640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244a7cb640 1 -- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 msgr2=0x7f24440c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244a7cb640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244a7cb640 1 -- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24440c95e0 msgr2=0x7f2444151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244a7cb640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24440c95e0 0x7f2444151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244a7cb640 1 -- 172.21.15.123:0/976588777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440cdf40 con 0x7f24441588e0 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244a7cb640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 0x7f24441f4520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f243c009eb0 tx=0x7f243c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c041070 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c031c40 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24440ce220 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c009450 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.595+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24440ce7e0 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.596+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244415c040 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.596+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f243c039040 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.597+0000 7f243a7fc640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f242806c2b0 0x7f242806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.597+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f243c0ac1e0 con 0x7f24441588e0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.597+0000 7f2449fca640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f242806c2b0 0x7f242806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.597+0000 7f2449fca640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f242806c2b0 0x7f242806e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2440007fd0 tx=0x7f2440007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.601+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f243c07a1f0 con 0x7f24441588e0 2024-09-19T09:42:41.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.765+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2444154d90 con 0x7f242806c2b0 2024-09-19T09:42:41.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.771+0000 7f243a7fc640 1 -- 172.21.15.123:0/976588777 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251007 (secure 0 0 0) 0x7f2444154d90 con 0x7f242806c2b0 2024-09-19T09:42:41.776 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:41.777 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:41.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f242806c2b0 msgr2=0x7f242806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f242806c2b0 0x7f242806e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2440007fd0 tx=0x7f2440007de0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 msgr2=0x7f24441f4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 0x7f24441f4520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f243c009eb0 tx=0x7f243c004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:41.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 shutdown_connections 2024-09-19T09:42:41.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24441588e0 0x7f24441f4520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f242806c2b0 0x7f242806e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24440cb670 0x7f24440c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 --2- 172.21.15.123:0/976588777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24440c95e0 0x7f2444151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 >> 172.21.15.123:0/976588777 conn(0x7f2444073950 msgr2=0x7f24440c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 shutdown_connections 2024-09-19T09:42:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.774+0000 7f244c22e640 1 -- 172.21.15.123:0/976588777 wait complete. 2024-09-19T09:42:41.786 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-19T09:42:40.697243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219028,"kb_used_data":2780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755692,"statfs":{"total":773094113280,"available":772869828608,"internally_reserved":0,"allocated":2846720,"data_stored":1719741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.218314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529577+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:37.529577+0000","last_peered":"2024-09-19T09:42:37.529577+0000","last_clean":"2024-09-19T09:42:37.529577+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:37.529577+0000","last_undegraded":"2024-09-19T09:42:37.529577+0000","last_fullsized":"2024-09-19T09:42:37.529577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:10.159162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523191+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:37.523191+0000","last_peered":"2024-09-19T09:42:37.523191+0000","last_clean":"2024-09-19T09:42:37.523191+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:37.523191+0000","last_undegraded":"2024-09-19T09:42:37.523191+0000","last_fullsized":"2024-09-19T09:42:37.523191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.777780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523616+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:37.523616+0000","last_peered":"2024-09-19T09:42:37.523616+0000","last_clean":"2024-09-19T09:42:37.523616+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:37.523616+0000","last_undegraded":"2024-09-19T09:42:37.523616+0000","last_fullsized":"2024-09-19T09:42:37.523616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:51.494981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526042+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:37.526042+0000","last_peered":"2024-09-19T09:42:37.526042+0000","last_clean":"2024-09-19T09:42:37.526042+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:37.526042+0000","last_undegraded":"2024-09-19T09:42:37.526042+0000","last_fullsized":"2024-09-19T09:42:37.526042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:25.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529624+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:37.529624+0000","last_peered":"2024-09-19T09:42:37.529624+0000","last_clean":"2024-09-19T09:42:37.529624+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:37.529624+0000","last_undegraded":"2024-09-19T09:42:37.529624+0000","last_fullsized":"2024-09-19T09:42:37.529624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:24.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524376+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:37.524376+0000","last_peered":"2024-09-19T09:42:37.524376+0000","last_clean":"2024-09-19T09:42:37.524376+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:37.524376+0000","last_undegraded":"2024-09-19T09:42:37.524376+0000","last_fullsized":"2024-09-19T09:42:37.524376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:40.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529109+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:37.529109+0000","last_peered":"2024-09-19T09:42:37.529109+0000","last_clean":"2024-09-19T09:42:37.529109+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:37.529109+0000","last_undegraded":"2024-09-19T09:42:37.529109+0000","last_fullsized":"2024-09-19T09:42:37.529109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:44.704108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520920+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:37.520920+0000","last_peered":"2024-09-19T09:42:37.520920+0000","last_clean":"2024-09-19T09:42:37.520920+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:37.520920+0000","last_undegraded":"2024-09-19T09:42:37.520920+0000","last_fullsized":"2024-09-19T09:42:37.520920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:46.803436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529710+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:37.529710+0000","last_peered":"2024-09-19T09:42:37.529710+0000","last_clean":"2024-09-19T09:42:37.529710+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:37.529710+0000","last_undegraded":"2024-09-19T09:42:37.529710+0000","last_fullsized":"2024-09-19T09:42:37.529710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:45.955881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524134+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:37.524134+0000","last_peered":"2024-09-19T09:42:37.524134+0000","last_clean":"2024-09-19T09:42:37.524134+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:37.524134+0000","last_undegraded":"2024-09-19T09:42:37.524134+0000","last_fullsized":"2024-09-19T09:42:37.524134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:10.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525755+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:37.525755+0000","last_peered":"2024-09-19T09:42:37.525755+0000","last_clean":"2024-09-19T09:42:37.525755+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:37.525755+0000","last_undegraded":"2024-09-19T09:42:37.525755+0000","last_fullsized":"2024-09-19T09:42:37.525755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:07.412836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520319+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:37.520319+0000","last_peered":"2024-09-19T09:42:37.520319+0000","last_clean":"2024-09-19T09:42:37.520319+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:37.520319+0000","last_undegraded":"2024-09-19T09:42:37.520319+0000","last_fullsized":"2024-09-19T09:42:37.520319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:45.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520948+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:37.520948+0000","last_peered":"2024-09-19T09:42:37.520948+0000","last_clean":"2024-09-19T09:42:37.520948+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:37.520948+0000","last_undegraded":"2024-09-19T09:42:37.520948+0000","last_fullsized":"2024-09-19T09:42:37.520948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:02.040571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520757+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:37.520757+0000","last_peered":"2024-09-19T09:42:37.520757+0000","last_clean":"2024-09-19T09:42:37.520757+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:37.520757+0000","last_undegraded":"2024-09-19T09:42:37.520757+0000","last_fullsized":"2024-09-19T09:42:37.520757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:50.287624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:37.521650+0000","last_peered":"2024-09-19T09:42:37.521650+0000","last_clean":"2024-09-19T09:42:37.521650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:37.521650+0000","last_undegraded":"2024-09-19T09:42:37.521650+0000","last_fullsized":"2024-09-19T09:42:37.521650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:14.066276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523708+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:37.523708+0000","last_peered":"2024-09-19T09:42:37.523708+0000","last_clean":"2024-09-19T09:42:37.523708+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:37.523708+0000","last_undegraded":"2024-09-19T09:42:37.523708+0000","last_fullsized":"2024-09-19T09:42:37.523708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:52.065555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526078+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:37.526078+0000","last_peered":"2024-09-19T09:42:37.526078+0000","last_clean":"2024-09-19T09:42:37.526078+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:37.526078+0000","last_undegraded":"2024-09-19T09:42:37.526078+0000","last_fullsized":"2024-09-19T09:42:37.526078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:39.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:42:36.478070+0000","last_change":"2024-09-19T09:42:36.478070+0000","last_active":"2024-09-19T09:42:36.478070+0000","last_peered":"2024-09-19T09:42:36.478070+0000","last_clean":"2024-09-19T09:42:36.478070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:36.478070+0000","last_undegraded":"2024-09-19T09:42:36.478070+0000","last_fullsized":"2024-09-19T09:42:36.478070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529641+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:37.529641+0000","last_peered":"2024-09-19T09:42:37.529641+0000","last_clean":"2024-09-19T09:42:37.529641+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:37.529641+0000","last_undegraded":"2024-09-19T09:42:37.529641+0000","last_fullsized":"2024-09-19T09:42:37.529641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:22.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516538+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:37.516538+0000","last_peered":"2024-09-19T09:42:37.516538+0000","last_clean":"2024-09-19T09:42:37.516538+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:37.516538+0000","last_undegraded":"2024-09-19T09:42:37.516538+0000","last_fullsized":"2024-09-19T09:42:37.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:05.295037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525935+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:37.525935+0000","last_peered":"2024-09-19T09:42:37.525935+0000","last_clean":"2024-09-19T09:42:37.525935+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:37.525935+0000","last_undegraded":"2024-09-19T09:42:37.525935+0000","last_fullsized":"2024-09-19T09:42:37.525935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:34.313085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527336+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:37.527336+0000","last_peered":"2024-09-19T09:42:37.527336+0000","last_clean":"2024-09-19T09:42:37.527336+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:37.527336+0000","last_undegraded":"2024-09-19T09:42:37.527336+0000","last_fullsized":"2024-09-19T09:42:37.527336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:47.771515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520871+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:37.520871+0000","last_peered":"2024-09-19T09:42:37.520871+0000","last_clean":"2024-09-19T09:42:37.520871+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:37.520871+0000","last_undegraded":"2024-09-19T09:42:37.520871+0000","last_fullsized":"2024-09-19T09:42:37.520871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:59.689786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517517+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:37.517517+0000","last_peered":"2024-09-19T09:42:37.517517+0000","last_clean":"2024-09-19T09:42:37.517517+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:37.517517+0000","last_undegraded":"2024-09-19T09:42:37.517517+0000","last_fullsized":"2024-09-19T09:42:37.517517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:08.090159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520818+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:37.520818+0000","last_peered":"2024-09-19T09:42:37.520818+0000","last_clean":"2024-09-19T09:42:37.520818+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:37.520818+0000","last_undegraded":"2024-09-19T09:42:37.520818+0000","last_fullsized":"2024-09-19T09:42:37.520818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.323217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524154+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:37.524154+0000","last_peered":"2024-09-19T09:42:37.524154+0000","last_clean":"2024-09-19T09:42:37.524154+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:37.524154+0000","last_undegraded":"2024-09-19T09:42:37.524154+0000","last_fullsized":"2024-09-19T09:42:37.524154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515438+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:37.515438+0000","last_peered":"2024-09-19T09:42:37.515438+0000","last_clean":"2024-09-19T09:42:37.515438+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:37.515438+0000","last_undegraded":"2024-09-19T09:42:37.515438+0000","last_fullsized":"2024-09-19T09:42:37.515438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520798+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:37.520798+0000","last_peered":"2024-09-19T09:42:37.520798+0000","last_clean":"2024-09-19T09:42:37.520798+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:37.520798+0000","last_undegraded":"2024-09-19T09:42:37.520798+0000","last_fullsized":"2024-09-19T09:42:37.520798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520942+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:37.520942+0000","last_peered":"2024-09-19T09:42:37.520942+0000","last_clean":"2024-09-19T09:42:37.520942+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:37.520942+0000","last_undegraded":"2024-09-19T09:42:37.520942+0000","last_fullsized":"2024-09-19T09:42:37.520942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:13.898264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524356+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:37.524356+0000","last_peered":"2024-09-19T09:42:37.524356+0000","last_clean":"2024-09-19T09:42:37.524356+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:37.524356+0000","last_undegraded":"2024-09-19T09:42:37.524356+0000","last_fullsized":"2024-09-19T09:42:37.524356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:39.510007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:42:36.478070+0000","last_change":"2024-09-19T09:42:36.478070+0000","last_active":"2024-09-19T09:42:36.478070+0000","last_peered":"2024-09-19T09:42:36.478070+0000","last_clean":"2024-09-19T09:42:36.478070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:36.478070+0000","last_undegraded":"2024-09-19T09:42:36.478070+0000","last_fullsized":"2024-09-19T09:42:36.478070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521393+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:37.521393+0000","last_peered":"2024-09-19T09:42:37.521393+0000","last_clean":"2024-09-19T09:42:37.521393+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:37.521393+0000","last_undegraded":"2024-09-19T09:42:37.521393+0000","last_fullsized":"2024-09-19T09:42:37.521393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.944545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521400+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:37.521400+0000","last_peered":"2024-09-19T09:42:37.521400+0000","last_clean":"2024-09-19T09:42:37.521400+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:37.521400+0000","last_undegraded":"2024-09-19T09:42:37.521400+0000","last_fullsized":"2024-09-19T09:42:37.521400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.057699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507486+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:37.507486+0000","last_peered":"2024-09-19T09:42:37.507486+0000","last_clean":"2024-09-19T09:42:37.507486+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:37.507486+0000","last_undegraded":"2024-09-19T09:42:37.507486+0000","last_fullsized":"2024-09-19T09:42:37.507486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520917+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:37.520917+0000","last_peered":"2024-09-19T09:42:37.520917+0000","last_clean":"2024-09-19T09:42:37.520917+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:37.520917+0000","last_undegraded":"2024-09-19T09:42:37.520917+0000","last_fullsized":"2024-09-19T09:42:37.520917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:51.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505395+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:37.505395+0000","last_peered":"2024-09-19T09:42:37.505395+0000","last_clean":"2024-09-19T09:42:37.505395+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:37.505395+0000","last_undegraded":"2024-09-19T09:42:37.505395+0000","last_fullsized":"2024-09-19T09:42:37.505395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507659+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:37.507659+0000","last_peered":"2024-09-19T09:42:37.507659+0000","last_clean":"2024-09-19T09:42:37.507659+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:37.507659+0000","last_undegraded":"2024-09-19T09:42:37.507659+0000","last_fullsized":"2024-09-19T09:42:37.507659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523337+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:37.523337+0000","last_peered":"2024-09-19T09:42:37.523337+0000","last_clean":"2024-09-19T09:42:37.523337+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:37.523337+0000","last_undegraded":"2024-09-19T09:42:37.523337+0000","last_fullsized":"2024-09-19T09:42:37.523337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:20.911082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512065+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:37.512065+0000","last_peered":"2024-09-19T09:42:37.512065+0000","last_clean":"2024-09-19T09:42:37.512065+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:37.512065+0000","last_undegraded":"2024-09-19T09:42:37.512065+0000","last_fullsized":"2024-09-19T09:42:37.512065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521678+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:37.521678+0000","last_peered":"2024-09-19T09:42:37.521678+0000","last_clean":"2024-09-19T09:42:37.521678+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:37.521678+0000","last_undegraded":"2024-09-19T09:42:37.521678+0000","last_fullsized":"2024-09-19T09:42:37.521678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:14.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506024+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:37.506024+0000","last_peered":"2024-09-19T09:42:37.506024+0000","last_clean":"2024-09-19T09:42:37.506024+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:37.506024+0000","last_undegraded":"2024-09-19T09:42:37.506024+0000","last_fullsized":"2024-09-19T09:42:37.506024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527680+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:37.527680+0000","last_peered":"2024-09-19T09:42:37.527680+0000","last_clean":"2024-09-19T09:42:37.527680+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:37.527680+0000","last_undegraded":"2024-09-19T09:42:37.527680+0000","last_fullsized":"2024-09-19T09:42:37.527680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:17.246201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.511783+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:37.511783+0000","last_peered":"2024-09-19T09:42:37.511783+0000","last_clean":"2024-09-19T09:42:37.511783+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:37.511783+0000","last_undegraded":"2024-09-19T09:42:37.511783+0000","last_fullsized":"2024-09-19T09:42:37.511783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525925+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:37.525925+0000","last_peered":"2024-09-19T09:42:37.525925+0000","last_clean":"2024-09-19T09:42:37.525925+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:37.525925+0000","last_undegraded":"2024-09-19T09:42:37.525925+0000","last_fullsized":"2024-09-19T09:42:37.525925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:59.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504525+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:37.504525+0000","last_peered":"2024-09-19T09:42:37.504525+0000","last_clean":"2024-09-19T09:42:37.504525+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:37.504525+0000","last_undegraded":"2024-09-19T09:42:37.504525+0000","last_fullsized":"2024-09-19T09:42:37.504525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526780+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:37.526780+0000","last_peered":"2024-09-19T09:42:37.526780+0000","last_clean":"2024-09-19T09:42:37.526780+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:37.526780+0000","last_undegraded":"2024-09-19T09:42:37.526780+0000","last_fullsized":"2024-09-19T09:42:37.526780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:27.841112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505747+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:37.505747+0000","last_peered":"2024-09-19T09:42:37.505747+0000","last_clean":"2024-09-19T09:42:37.505747+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:37.505747+0000","last_undegraded":"2024-09-19T09:42:37.505747+0000","last_fullsized":"2024-09-19T09:42:37.505747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529045+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:37.529045+0000","last_peered":"2024-09-19T09:42:37.529045+0000","last_clean":"2024-09-19T09:42:37.529045+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:37.529045+0000","last_undegraded":"2024-09-19T09:42:37.529045+0000","last_fullsized":"2024-09-19T09:42:37.529045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.641481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506728+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:37.506728+0000","last_peered":"2024-09-19T09:42:37.506728+0000","last_clean":"2024-09-19T09:42:37.506728+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:37.506728+0000","last_undegraded":"2024-09-19T09:42:37.506728+0000","last_fullsized":"2024-09-19T09:42:37.506728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528358+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:37.528358+0000","last_peered":"2024-09-19T09:42:37.528358+0000","last_clean":"2024-09-19T09:42:37.528358+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:37.528358+0000","last_undegraded":"2024-09-19T09:42:37.528358+0000","last_fullsized":"2024-09-19T09:42:37.528358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.218733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512692+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:37.512692+0000","last_peered":"2024-09-19T09:42:37.512692+0000","last_clean":"2024-09-19T09:42:37.512692+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:37.512692+0000","last_undegraded":"2024-09-19T09:42:37.512692+0000","last_fullsized":"2024-09-19T09:42:37.512692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529678+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:37.529678+0000","last_peered":"2024-09-19T09:42:37.529678+0000","last_clean":"2024-09-19T09:42:37.529678+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:37.529678+0000","last_undegraded":"2024-09-19T09:42:37.529678+0000","last_fullsized":"2024-09-19T09:42:37.529678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.537917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505904+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:37.505904+0000","last_peered":"2024-09-19T09:42:37.505904+0000","last_clean":"2024-09-19T09:42:37.505904+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:37.505904+0000","last_undegraded":"2024-09-19T09:42:37.505904+0000","last_fullsized":"2024-09-19T09:42:37.505904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:37.521415+0000","last_peered":"2024-09-19T09:42:37.521415+0000","last_clean":"2024-09-19T09:42:37.521415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:37.521415+0000","last_undegraded":"2024-09-19T09:42:37.521415+0000","last_fullsized":"2024-09-19T09:42:37.521415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:43.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488432+0000","last_change":"2024-09-19T09:42:35.488432+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488432+0000","last_undegraded":"2024-09-19T09:42:35.488432+0000","last_fullsized":"2024-09-19T09:42:35.488432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528927+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:37.528927+0000","last_peered":"2024-09-19T09:42:37.528927+0000","last_clean":"2024-09-19T09:42:37.528927+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:37.528927+0000","last_undegraded":"2024-09-19T09:42:37.528927+0000","last_fullsized":"2024-09-19T09:42:37.528927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:58.084932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505607+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:37.505607+0000","last_peered":"2024-09-19T09:42:37.505607+0000","last_clean":"2024-09-19T09:42:37.505607+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:37.505607+0000","last_undegraded":"2024-09-19T09:42:37.505607+0000","last_fullsized":"2024-09-19T09:42:37.505607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529704+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:37.529704+0000","last_peered":"2024-09-19T09:42:37.529704+0000","last_clean":"2024-09-19T09:42:37.529704+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:37.529704+0000","last_undegraded":"2024-09-19T09:42:37.529704+0000","last_fullsized":"2024-09-19T09:42:37.529704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:51.417176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488491+0000","last_change":"2024-09-19T09:42:35.488491+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488491+0000","last_undegraded":"2024-09-19T09:42:35.488491+0000","last_fullsized":"2024-09-19T09:42:35.488491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529677+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:37.529677+0000","last_peered":"2024-09-19T09:42:37.529677+0000","last_clean":"2024-09-19T09:42:37.529677+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:37.529677+0000","last_undegraded":"2024-09-19T09:42:37.529677+0000","last_fullsized":"2024-09-19T09:42:37.529677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:30.350852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504671+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:37.504671+0000","last_peered":"2024-09-19T09:42:37.504671+0000","last_clean":"2024-09-19T09:42:37.504671+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:37.504671+0000","last_undegraded":"2024-09-19T09:42:37.504671+0000","last_fullsized":"2024-09-19T09:42:37.504671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526017+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:37.526017+0000","last_peered":"2024-09-19T09:42:37.526017+0000","last_clean":"2024-09-19T09:42:37.526017+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:37.526017+0000","last_undegraded":"2024-09-19T09:42:37.526017+0000","last_fullsized":"2024-09-19T09:42:37.526017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:12.483808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488374+0000","last_change":"2024-09-19T09:42:35.488374+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488374+0000","last_undegraded":"2024-09-19T09:42:35.488374+0000","last_fullsized":"2024-09-19T09:42:35.488374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529579+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:37.529579+0000","last_peered":"2024-09-19T09:42:37.529579+0000","last_clean":"2024-09-19T09:42:37.529579+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:37.529579+0000","last_undegraded":"2024-09-19T09:42:37.529579+0000","last_fullsized":"2024-09-19T09:42:37.529579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:22.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517484+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:37.517484+0000","last_peered":"2024-09-19T09:42:37.517484+0000","last_clean":"2024-09-19T09:42:37.517484+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:37.517484+0000","last_undegraded":"2024-09-19T09:42:37.517484+0000","last_fullsized":"2024-09-19T09:42:37.517484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.510554+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:37.510554+0000","last_peered":"2024-09-19T09:42:37.510554+0000","last_clean":"2024-09-19T09:42:37.510554+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:37.510554+0000","last_undegraded":"2024-09-19T09:42:37.510554+0000","last_fullsized":"2024-09-19T09:42:37.510554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525865+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:37.525865+0000","last_peered":"2024-09-19T09:42:37.525865+0000","last_clean":"2024-09-19T09:42:37.525865+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:37.525865+0000","last_undegraded":"2024-09-19T09:42:37.525865+0000","last_fullsized":"2024-09-19T09:42:37.525865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:02.766622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517823+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:37.517823+0000","last_peered":"2024-09-19T09:42:37.517823+0000","last_clean":"2024-09-19T09:42:37.517823+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:37.517823+0000","last_undegraded":"2024-09-19T09:42:37.517823+0000","last_fullsized":"2024-09-19T09:42:37.517823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520670+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:37.520670+0000","last_peered":"2024-09-19T09:42:37.520670+0000","last_clean":"2024-09-19T09:42:37.520670+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:37.520670+0000","last_undegraded":"2024-09-19T09:42:37.520670+0000","last_fullsized":"2024-09-19T09:42:37.520670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488376+0000","last_change":"2024-09-19T09:42:35.488376+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488376+0000","last_undegraded":"2024-09-19T09:42:35.488376+0000","last_fullsized":"2024-09-19T09:42:35.488376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515746+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:37.515746+0000","last_peered":"2024-09-19T09:42:37.515746+0000","last_clean":"2024-09-19T09:42:37.515746+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:37.515746+0000","last_undegraded":"2024-09-19T09:42:37.515746+0000","last_fullsized":"2024-09-19T09:42:37.515746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512835+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:37.512835+0000","last_peered":"2024-09-19T09:42:37.512835+0000","last_clean":"2024-09-19T09:42:37.512835+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:37.512835+0000","last_undegraded":"2024-09-19T09:42:37.512835+0000","last_fullsized":"2024-09-19T09:42:37.512835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.522538+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:37.522538+0000","last_peered":"2024-09-19T09:42:37.522538+0000","last_clean":"2024-09-19T09:42:37.522538+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:37.522538+0000","last_undegraded":"2024-09-19T09:42:37.522538+0000","last_fullsized":"2024-09-19T09:42:37.522538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:36.990463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504431+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:37.504431+0000","last_peered":"2024-09-19T09:42:37.504431+0000","last_clean":"2024-09-19T09:42:37.504431+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:37.504431+0000","last_undegraded":"2024-09-19T09:42:37.504431+0000","last_fullsized":"2024-09-19T09:42:37.504431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527661+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:37.527661+0000","last_peered":"2024-09-19T09:42:37.527661+0000","last_clean":"2024-09-19T09:42:37.527661+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:37.527661+0000","last_undegraded":"2024-09-19T09:42:37.527661+0000","last_fullsized":"2024-09-19T09:42:37.527661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:46.760134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519991+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:37.519991+0000","last_peered":"2024-09-19T09:42:37.519991+0000","last_clean":"2024-09-19T09:42:37.519991+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:37.519991+0000","last_undegraded":"2024-09-19T09:42:37.519991+0000","last_fullsized":"2024-09-19T09:42:37.519991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516012+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:37.516012+0000","last_peered":"2024-09-19T09:42:37.516012+0000","last_clean":"2024-09-19T09:42:37.516012+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:37.516012+0000","last_undegraded":"2024-09-19T09:42:37.516012+0000","last_fullsized":"2024-09-19T09:42:37.516012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:49.909733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504564+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:37.504564+0000","last_peered":"2024-09-19T09:42:37.504564+0000","last_clean":"2024-09-19T09:42:37.504564+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:37.504564+0000","last_undegraded":"2024-09-19T09:42:37.504564+0000","last_fullsized":"2024-09-19T09:42:37.504564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528430+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:37.528430+0000","last_peered":"2024-09-19T09:42:37.528430+0000","last_clean":"2024-09-19T09:42:37.528430+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:37.528430+0000","last_undegraded":"2024-09-19T09:42:37.528430+0000","last_fullsized":"2024-09-19T09:42:37.528430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:18.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506210+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:37.506210+0000","last_peered":"2024-09-19T09:42:37.506210+0000","last_clean":"2024-09-19T09:42:37.506210+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:37.506210+0000","last_undegraded":"2024-09-19T09:42:37.506210+0000","last_fullsized":"2024-09-19T09:42:37.506210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520831+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:37.520831+0000","last_peered":"2024-09-19T09:42:37.520831+0000","last_clean":"2024-09-19T09:42:37.520831+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:37.520831+0000","last_undegraded":"2024-09-19T09:42:37.520831+0000","last_fullsized":"2024-09-19T09:42:37.520831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:11.793665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517432+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:37.517432+0000","last_peered":"2024-09-19T09:42:37.517432+0000","last_clean":"2024-09-19T09:42:37.517432+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:37.517432+0000","last_undegraded":"2024-09-19T09:42:37.517432+0000","last_fullsized":"2024-09-19T09:42:37.517432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512844+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:37.512844+0000","last_peered":"2024-09-19T09:42:37.512844+0000","last_clean":"2024-09-19T09:42:37.512844+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:37.512844+0000","last_undegraded":"2024-09-19T09:42:37.512844+0000","last_fullsized":"2024-09-19T09:42:37.512844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:25.197598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504951+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:37.504951+0000","last_peered":"2024-09-19T09:42:37.504951+0000","last_clean":"2024-09-19T09:42:37.504951+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:37.504951+0000","last_undegraded":"2024-09-19T09:42:37.504951+0000","last_fullsized":"2024-09-19T09:42:37.504951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523317+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:37.523317+0000","last_peered":"2024-09-19T09:42:37.523317+0000","last_clean":"2024-09-19T09:42:37.523317+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:37.523317+0000","last_undegraded":"2024-09-19T09:42:37.523317+0000","last_fullsized":"2024-09-19T09:42:37.523317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:32.907310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504328+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:37.504328+0000","last_peered":"2024-09-19T09:42:37.504328+0000","last_clean":"2024-09-19T09:42:37.504328+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:37.504328+0000","last_undegraded":"2024-09-19T09:42:37.504328+0000","last_fullsized":"2024-09-19T09:42:37.504328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523363+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:37.523363+0000","last_peered":"2024-09-19T09:42:37.523363+0000","last_clean":"2024-09-19T09:42:37.523363+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:37.523363+0000","last_undegraded":"2024-09-19T09:42:37.523363+0000","last_fullsized":"2024-09-19T09:42:37.523363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:18.634777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518619+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:37.518619+0000","last_peered":"2024-09-19T09:42:37.518619+0000","last_clean":"2024-09-19T09:42:37.518619+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:37.518619+0000","last_undegraded":"2024-09-19T09:42:37.518619+0000","last_fullsized":"2024-09-19T09:42:37.518619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521363+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:37.521363+0000","last_peered":"2024-09-19T09:42:37.521363+0000","last_clean":"2024-09-19T09:42:37.521363+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:37.521363+0000","last_undegraded":"2024-09-19T09:42:37.521363+0000","last_fullsized":"2024-09-19T09:42:37.521363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:14.796097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524033+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:37.524033+0000","last_peered":"2024-09-19T09:42:37.524033+0000","last_clean":"2024-09-19T09:42:37.524033+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:37.524033+0000","last_undegraded":"2024-09-19T09:42:37.524033+0000","last_fullsized":"2024-09-19T09:42:37.524033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518495+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:37.518495+0000","last_peered":"2024-09-19T09:42:37.518495+0000","last_clean":"2024-09-19T09:42:37.518495+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:37.518495+0000","last_undegraded":"2024-09-19T09:42:37.518495+0000","last_fullsized":"2024-09-19T09:42:37.518495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524588+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:37.524588+0000","last_peered":"2024-09-19T09:42:37.524588+0000","last_clean":"2024-09-19T09:42:37.524588+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:37.524588+0000","last_undegraded":"2024-09-19T09:42:37.524588+0000","last_fullsized":"2024-09-19T09:42:37.524588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:38.753135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519528+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:37.519528+0000","last_peered":"2024-09-19T09:42:37.519528+0000","last_clean":"2024-09-19T09:42:37.519528+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:37.519528+0000","last_undegraded":"2024-09-19T09:42:37.519528+0000","last_fullsized":"2024-09-19T09:42:37.519528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525904+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:37.525904+0000","last_peered":"2024-09-19T09:42:37.525904+0000","last_clean":"2024-09-19T09:42:37.525904+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:37.525904+0000","last_undegraded":"2024-09-19T09:42:37.525904+0000","last_fullsized":"2024-09-19T09:42:37.525904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:23.577488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507762+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:37.507762+0000","last_peered":"2024-09-19T09:42:37.507762+0000","last_clean":"2024-09-19T09:42:37.507762+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:37.507762+0000","last_undegraded":"2024-09-19T09:42:37.507762+0000","last_fullsized":"2024-09-19T09:42:37.507762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521745+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:37.521745+0000","last_peered":"2024-09-19T09:42:37.521745+0000","last_clean":"2024-09-19T09:42:37.521745+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:37.521745+0000","last_undegraded":"2024-09-19T09:42:37.521745+0000","last_fullsized":"2024-09-19T09:42:37.521745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:13.952632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506615+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:37.506615+0000","last_peered":"2024-09-19T09:42:37.506615+0000","last_clean":"2024-09-19T09:42:37.506615+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:37.506615+0000","last_undegraded":"2024-09-19T09:42:37.506615+0000","last_fullsized":"2024-09-19T09:42:37.506615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":124,"acting":124,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:41.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:41.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.922+0000 7f7512227640 1 Processor -- start 2024-09-19T09:42:41.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7512227640 1 -- start start 2024-09-19T09:42:41.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7512227640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f750c152e00 0x7f750c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7512227640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f750c06de20 0x7f750c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7512227640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750c159e10 con 0x7f750c073260 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7512227640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f750c15c440 con 0x7f750c06de20 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7512227640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f750c15ca00 con 0x7f750c152e00 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7503fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f750c06de20 0x7f750c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.923+0000 7f7503fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f750c06de20 0x7f750c1598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54000/0 (socket says 172.21.15.123:54000) 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f7503fff640 1 -- 172.21.15.123:0/3581849929 learned_addr learned my addr 172.21.15.123:0/3581849929 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f750b7fe640 1 --2- 172.21.15.123:0/3581849929 >> v2:172.21.15.194:3300/0 conn(0x7f750c152e00 0x7f750c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f7503fff640 1 -- 172.21.15.123:0/3581849929 >> v2:172.21.15.194:3300/0 conn(0x7f750c152e00 msgr2=0x7f750c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f7503fff640 1 --2- 172.21.15.123:0/3581849929 >> v2:172.21.15.194:3300/0 conn(0x7f750c152e00 0x7f750c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f7503fff640 1 -- 172.21.15.123:0/3581849929 >> v1:172.21.15.194:6789/0 conn(0x7f750c073260 legacy=0x7f750c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f7503fff640 1 -- 172.21.15.123:0/3581849929 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0c8700 con 0x7f750c06de20 2024-09-19T09:42:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.924+0000 7f7503fff640 1 --2- 172.21.15.123:0/3581849929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c06de20 0x7f750c1598d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f750c0cc460 tx=0x7f74f402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500b07e5483c118b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f750affd640 1 -- 172.21.15.123:0/3581849929 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4037070 con 0x7f750c06de20 2024-09-19T09:42:41.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f750affd640 1 -- 172.21.15.123:0/3581849929 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4032440 con 0x7f750c06de20 2024-09-19T09:42:41.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f750affd640 1 -- 172.21.15.123:0/3581849929 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4032810 con 0x7f750c06de20 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 -- 172.21.15.123:0/3581849929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c06de20 msgr2=0x7f750c1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 --2- 172.21.15.123:0/3581849929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c06de20 0x7f750c1598d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f750c0cc460 tx=0x7f74f402a2c0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 -- 172.21.15.123:0/3581849929 shutdown_connections 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 --2- 172.21.15.123:0/3581849929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c06de20 0x7f750c1598d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 --2- 172.21.15.123:0/3581849929 >> v2:172.21.15.194:3300/0 conn(0x7f750c152e00 0x7f750c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 -- 172.21.15.123:0/3581849929 >> 172.21.15.123:0/3581849929 conn(0x7f750c0ce9b0 msgr2=0x7f750c0ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 -- 172.21.15.123:0/3581849929 shutdown_connections 2024-09-19T09:42:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.925+0000 7f7512227640 1 -- 172.21.15.123:0/3581849929 wait complete. 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.926+0000 7f7512227640 1 Processor -- start 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.926+0000 7f7512227640 1 -- start start 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7512227640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f750c06de20 0x7f750c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7512227640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f750c073260 0x7f750c147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7512227640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 0x7f750c142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7512227640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f750c0c8cc0 con 0x7f750c152e00 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7512227640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f750c15d3d0 con 0x7f750c06de20 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7512227640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f750c15c690 con 0x7f750c073260 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 0x7f750c142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 0x7f750c142280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54006/0 (socket says 172.21.15.123:54006) 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f750c06de20 0x7f750c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 -- 172.21.15.123:0/2935748960 learned_addr learned my addr 172.21.15.123:0/2935748960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f7503fff640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f750c073260 0x7f750c147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 -- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f750c073260 msgr2=0x7f750c147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f750c073260 0x7f750c147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 -- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f750c06de20 msgr2=0x7f750c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f750c06de20 0x7f750c151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.927+0000 7f750bfff640 1 -- 172.21.15.123:0/2935748960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c146c60 con 0x7f750c152e00 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.928+0000 7f750bfff640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 0x7f750c142280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f750400c780 tx=0x7f750400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.928+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504004b60 con 0x7f750c152e00 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.928+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7504004d00 con 0x7f750c152e00 2024-09-19T09:42:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.928+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750c146f40 con 0x7f750c152e00 2024-09-19T09:42:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.928+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750400aa90 con 0x7f750c152e00 2024-09-19T09:42:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.928+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750c1f2400 con 0x7f750c152e00 2024-09-19T09:42:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.929+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750c1531e0 con 0x7f750c152e00 2024-09-19T09:42:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.929+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f750400ac30 con 0x7f750c152e00 2024-09-19T09:42:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.930+0000 7f7508ff9640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.930+0000 7f750b7fe640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.930+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f750408b660 con 0x7f750c152e00 2024-09-19T09:42:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.930+0000 7f750b7fe640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f74ec06c2b0 0x7f74ec06e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74fc006fd0 tx=0x7f74fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:41.934+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7504020070 con 0x7f750c152e00 2024-09-19T09:42:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.094+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f750c0c9470 con 0x7f74ec06c2b0 2024-09-19T09:42:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.100+0000 7f7508ff9640 1 -- 172.21.15.123:0/2935748960 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251007 (secure 0 0 0) 0x7f750c0c9470 con 0x7f74ec06c2b0 2024-09-19T09:42:42.104 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.102+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f74ec06c2b0 msgr2=0x7f74ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.102+0000 7f7512227640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f74ec06c2b0 0x7f74ec06e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74fc006fd0 tx=0x7f74fc008040 comp rx=0 tx=0).stop 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.102+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 msgr2=0x7f750c142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.102+0000 7f7512227640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 0x7f750c142280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f750400c780 tx=0x7f750400cc40 comp rx=0 tx=0).stop 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 shutdown_connections 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f750c152e00 0x7f750c142280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f750c073260 0x7f750c147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 --2- 172.21.15.123:0/2935748960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f750c06de20 0x7f750c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 >> 172.21.15.123:0/2935748960 conn(0x7f750c0ce9b0 msgr2=0x7f750c0ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 shutdown_connections 2024-09-19T09:42:42.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.103+0000 7f7512227640 1 -- 172.21.15.123:0/2935748960 wait complete. 2024-09-19T09:42:42.115 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-19T09:42:40.697243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219028,"kb_used_data":2780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755692,"statfs":{"total":773094113280,"available":772869828608,"internally_reserved":0,"allocated":2846720,"data_stored":1719741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.218314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529577+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:37.529577+0000","last_peered":"2024-09-19T09:42:37.529577+0000","last_clean":"2024-09-19T09:42:37.529577+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:37.529577+0000","last_undegraded":"2024-09-19T09:42:37.529577+0000","last_fullsized":"2024-09-19T09:42:37.529577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:10.159162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523191+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:37.523191+0000","last_peered":"2024-09-19T09:42:37.523191+0000","last_clean":"2024-09-19T09:42:37.523191+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:37.523191+0000","last_undegraded":"2024-09-19T09:42:37.523191+0000","last_fullsized":"2024-09-19T09:42:37.523191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.777780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523616+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:37.523616+0000","last_peered":"2024-09-19T09:42:37.523616+0000","last_clean":"2024-09-19T09:42:37.523616+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:37.523616+0000","last_undegraded":"2024-09-19T09:42:37.523616+0000","last_fullsized":"2024-09-19T09:42:37.523616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:51.494981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526042+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:37.526042+0000","last_peered":"2024-09-19T09:42:37.526042+0000","last_clean":"2024-09-19T09:42:37.526042+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:37.526042+0000","last_undegraded":"2024-09-19T09:42:37.526042+0000","last_fullsized":"2024-09-19T09:42:37.526042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:25.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529624+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:37.529624+0000","last_peered":"2024-09-19T09:42:37.529624+0000","last_clean":"2024-09-19T09:42:37.529624+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:37.529624+0000","last_undegraded":"2024-09-19T09:42:37.529624+0000","last_fullsized":"2024-09-19T09:42:37.529624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:24.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524376+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:37.524376+0000","last_peered":"2024-09-19T09:42:37.524376+0000","last_clean":"2024-09-19T09:42:37.524376+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:37.524376+0000","last_undegraded":"2024-09-19T09:42:37.524376+0000","last_fullsized":"2024-09-19T09:42:37.524376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:40.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529109+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:37.529109+0000","last_peered":"2024-09-19T09:42:37.529109+0000","last_clean":"2024-09-19T09:42:37.529109+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:37.529109+0000","last_undegraded":"2024-09-19T09:42:37.529109+0000","last_fullsized":"2024-09-19T09:42:37.529109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:44.704108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520920+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:37.520920+0000","last_peered":"2024-09-19T09:42:37.520920+0000","last_clean":"2024-09-19T09:42:37.520920+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:37.520920+0000","last_undegraded":"2024-09-19T09:42:37.520920+0000","last_fullsized":"2024-09-19T09:42:37.520920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:46.803436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529710+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:37.529710+0000","last_peered":"2024-09-19T09:42:37.529710+0000","last_clean":"2024-09-19T09:42:37.529710+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:37.529710+0000","last_undegraded":"2024-09-19T09:42:37.529710+0000","last_fullsized":"2024-09-19T09:42:37.529710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:45.955881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524134+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:37.524134+0000","last_peered":"2024-09-19T09:42:37.524134+0000","last_clean":"2024-09-19T09:42:37.524134+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:37.524134+0000","last_undegraded":"2024-09-19T09:42:37.524134+0000","last_fullsized":"2024-09-19T09:42:37.524134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:10.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525755+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:37.525755+0000","last_peered":"2024-09-19T09:42:37.525755+0000","last_clean":"2024-09-19T09:42:37.525755+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:37.525755+0000","last_undegraded":"2024-09-19T09:42:37.525755+0000","last_fullsized":"2024-09-19T09:42:37.525755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:07.412836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520319+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:37.520319+0000","last_peered":"2024-09-19T09:42:37.520319+0000","last_clean":"2024-09-19T09:42:37.520319+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:37.520319+0000","last_undegraded":"2024-09-19T09:42:37.520319+0000","last_fullsized":"2024-09-19T09:42:37.520319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:45.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520948+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:37.520948+0000","last_peered":"2024-09-19T09:42:37.520948+0000","last_clean":"2024-09-19T09:42:37.520948+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:37.520948+0000","last_undegraded":"2024-09-19T09:42:37.520948+0000","last_fullsized":"2024-09-19T09:42:37.520948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:02.040571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520757+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:37.520757+0000","last_peered":"2024-09-19T09:42:37.520757+0000","last_clean":"2024-09-19T09:42:37.520757+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:37.520757+0000","last_undegraded":"2024-09-19T09:42:37.520757+0000","last_fullsized":"2024-09-19T09:42:37.520757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:50.287624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:37.521650+0000","last_peered":"2024-09-19T09:42:37.521650+0000","last_clean":"2024-09-19T09:42:37.521650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:37.521650+0000","last_undegraded":"2024-09-19T09:42:37.521650+0000","last_fullsized":"2024-09-19T09:42:37.521650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:14.066276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523708+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:37.523708+0000","last_peered":"2024-09-19T09:42:37.523708+0000","last_clean":"2024-09-19T09:42:37.523708+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:37.523708+0000","last_undegraded":"2024-09-19T09:42:37.523708+0000","last_fullsized":"2024-09-19T09:42:37.523708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:52.065555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526078+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:37.526078+0000","last_peered":"2024-09-19T09:42:37.526078+0000","last_clean":"2024-09-19T09:42:37.526078+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:37.526078+0000","last_undegraded":"2024-09-19T09:42:37.526078+0000","last_fullsized":"2024-09-19T09:42:37.526078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:39.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:42:36.478070+0000","last_change":"2024-09-19T09:42:36.478070+0000","last_active":"2024-09-19T09:42:36.478070+0000","last_peered":"2024-09-19T09:42:36.478070+0000","last_clean":"2024-09-19T09:42:36.478070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:36.478070+0000","last_undegraded":"2024-09-19T09:42:36.478070+0000","last_fullsized":"2024-09-19T09:42:36.478070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529641+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:37.529641+0000","last_peered":"2024-09-19T09:42:37.529641+0000","last_clean":"2024-09-19T09:42:37.529641+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:37.529641+0000","last_undegraded":"2024-09-19T09:42:37.529641+0000","last_fullsized":"2024-09-19T09:42:37.529641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:22.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516538+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:37.516538+0000","last_peered":"2024-09-19T09:42:37.516538+0000","last_clean":"2024-09-19T09:42:37.516538+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:37.516538+0000","last_undegraded":"2024-09-19T09:42:37.516538+0000","last_fullsized":"2024-09-19T09:42:37.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:05.295037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525935+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:37.525935+0000","last_peered":"2024-09-19T09:42:37.525935+0000","last_clean":"2024-09-19T09:42:37.525935+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:37.525935+0000","last_undegraded":"2024-09-19T09:42:37.525935+0000","last_fullsized":"2024-09-19T09:42:37.525935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:34.313085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527336+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:37.527336+0000","last_peered":"2024-09-19T09:42:37.527336+0000","last_clean":"2024-09-19T09:42:37.527336+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:37.527336+0000","last_undegraded":"2024-09-19T09:42:37.527336+0000","last_fullsized":"2024-09-19T09:42:37.527336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:47.771515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520871+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:37.520871+0000","last_peered":"2024-09-19T09:42:37.520871+0000","last_clean":"2024-09-19T09:42:37.520871+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:37.520871+0000","last_undegraded":"2024-09-19T09:42:37.520871+0000","last_fullsized":"2024-09-19T09:42:37.520871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:59.689786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517517+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:37.517517+0000","last_peered":"2024-09-19T09:42:37.517517+0000","last_clean":"2024-09-19T09:42:37.517517+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:37.517517+0000","last_undegraded":"2024-09-19T09:42:37.517517+0000","last_fullsized":"2024-09-19T09:42:37.517517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:08.090159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520818+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:37.520818+0000","last_peered":"2024-09-19T09:42:37.520818+0000","last_clean":"2024-09-19T09:42:37.520818+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:37.520818+0000","last_undegraded":"2024-09-19T09:42:37.520818+0000","last_fullsized":"2024-09-19T09:42:37.520818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.323217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524154+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:37.524154+0000","last_peered":"2024-09-19T09:42:37.524154+0000","last_clean":"2024-09-19T09:42:37.524154+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:37.524154+0000","last_undegraded":"2024-09-19T09:42:37.524154+0000","last_fullsized":"2024-09-19T09:42:37.524154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515438+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:37.515438+0000","last_peered":"2024-09-19T09:42:37.515438+0000","last_clean":"2024-09-19T09:42:37.515438+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:37.515438+0000","last_undegraded":"2024-09-19T09:42:37.515438+0000","last_fullsized":"2024-09-19T09:42:37.515438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520798+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:37.520798+0000","last_peered":"2024-09-19T09:42:37.520798+0000","last_clean":"2024-09-19T09:42:37.520798+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:37.520798+0000","last_undegraded":"2024-09-19T09:42:37.520798+0000","last_fullsized":"2024-09-19T09:42:37.520798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520942+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:37.520942+0000","last_peered":"2024-09-19T09:42:37.520942+0000","last_clean":"2024-09-19T09:42:37.520942+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:37.520942+0000","last_undegraded":"2024-09-19T09:42:37.520942+0000","last_fullsized":"2024-09-19T09:42:37.520942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:13.898264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524356+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:37.524356+0000","last_peered":"2024-09-19T09:42:37.524356+0000","last_clean":"2024-09-19T09:42:37.524356+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:37.524356+0000","last_undegraded":"2024-09-19T09:42:37.524356+0000","last_fullsized":"2024-09-19T09:42:37.524356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:39.510007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:42:36.478070+0000","last_change":"2024-09-19T09:42:36.478070+0000","last_active":"2024-09-19T09:42:36.478070+0000","last_peered":"2024-09-19T09:42:36.478070+0000","last_clean":"2024-09-19T09:42:36.478070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:36.478070+0000","last_undegraded":"2024-09-19T09:42:36.478070+0000","last_fullsized":"2024-09-19T09:42:36.478070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521393+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:37.521393+0000","last_peered":"2024-09-19T09:42:37.521393+0000","last_clean":"2024-09-19T09:42:37.521393+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:37.521393+0000","last_undegraded":"2024-09-19T09:42:37.521393+0000","last_fullsized":"2024-09-19T09:42:37.521393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.944545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521400+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:37.521400+0000","last_peered":"2024-09-19T09:42:37.521400+0000","last_clean":"2024-09-19T09:42:37.521400+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:37.521400+0000","last_undegraded":"2024-09-19T09:42:37.521400+0000","last_fullsized":"2024-09-19T09:42:37.521400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.057699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507486+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:37.507486+0000","last_peered":"2024-09-19T09:42:37.507486+0000","last_clean":"2024-09-19T09:42:37.507486+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:37.507486+0000","last_undegraded":"2024-09-19T09:42:37.507486+0000","last_fullsized":"2024-09-19T09:42:37.507486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520917+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:37.520917+0000","last_peered":"2024-09-19T09:42:37.520917+0000","last_clean":"2024-09-19T09:42:37.520917+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:37.520917+0000","last_undegraded":"2024-09-19T09:42:37.520917+0000","last_fullsized":"2024-09-19T09:42:37.520917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:51.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505395+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:37.505395+0000","last_peered":"2024-09-19T09:42:37.505395+0000","last_clean":"2024-09-19T09:42:37.505395+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:37.505395+0000","last_undegraded":"2024-09-19T09:42:37.505395+0000","last_fullsized":"2024-09-19T09:42:37.505395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507659+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:37.507659+0000","last_peered":"2024-09-19T09:42:37.507659+0000","last_clean":"2024-09-19T09:42:37.507659+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:37.507659+0000","last_undegraded":"2024-09-19T09:42:37.507659+0000","last_fullsized":"2024-09-19T09:42:37.507659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523337+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:37.523337+0000","last_peered":"2024-09-19T09:42:37.523337+0000","last_clean":"2024-09-19T09:42:37.523337+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:37.523337+0000","last_undegraded":"2024-09-19T09:42:37.523337+0000","last_fullsized":"2024-09-19T09:42:37.523337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:20.911082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512065+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:37.512065+0000","last_peered":"2024-09-19T09:42:37.512065+0000","last_clean":"2024-09-19T09:42:37.512065+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:37.512065+0000","last_undegraded":"2024-09-19T09:42:37.512065+0000","last_fullsized":"2024-09-19T09:42:37.512065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521678+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:37.521678+0000","last_peered":"2024-09-19T09:42:37.521678+0000","last_clean":"2024-09-19T09:42:37.521678+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:37.521678+0000","last_undegraded":"2024-09-19T09:42:37.521678+0000","last_fullsized":"2024-09-19T09:42:37.521678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:14.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506024+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:37.506024+0000","last_peered":"2024-09-19T09:42:37.506024+0000","last_clean":"2024-09-19T09:42:37.506024+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:37.506024+0000","last_undegraded":"2024-09-19T09:42:37.506024+0000","last_fullsized":"2024-09-19T09:42:37.506024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527680+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:37.527680+0000","last_peered":"2024-09-19T09:42:37.527680+0000","last_clean":"2024-09-19T09:42:37.527680+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:37.527680+0000","last_undegraded":"2024-09-19T09:42:37.527680+0000","last_fullsized":"2024-09-19T09:42:37.527680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:17.246201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.511783+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:37.511783+0000","last_peered":"2024-09-19T09:42:37.511783+0000","last_clean":"2024-09-19T09:42:37.511783+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:37.511783+0000","last_undegraded":"2024-09-19T09:42:37.511783+0000","last_fullsized":"2024-09-19T09:42:37.511783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525925+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:37.525925+0000","last_peered":"2024-09-19T09:42:37.525925+0000","last_clean":"2024-09-19T09:42:37.525925+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:37.525925+0000","last_undegraded":"2024-09-19T09:42:37.525925+0000","last_fullsized":"2024-09-19T09:42:37.525925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:59.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504525+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:37.504525+0000","last_peered":"2024-09-19T09:42:37.504525+0000","last_clean":"2024-09-19T09:42:37.504525+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:37.504525+0000","last_undegraded":"2024-09-19T09:42:37.504525+0000","last_fullsized":"2024-09-19T09:42:37.504525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526780+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:37.526780+0000","last_peered":"2024-09-19T09:42:37.526780+0000","last_clean":"2024-09-19T09:42:37.526780+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:37.526780+0000","last_undegraded":"2024-09-19T09:42:37.526780+0000","last_fullsized":"2024-09-19T09:42:37.526780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:27.841112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505747+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:37.505747+0000","last_peered":"2024-09-19T09:42:37.505747+0000","last_clean":"2024-09-19T09:42:37.505747+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:37.505747+0000","last_undegraded":"2024-09-19T09:42:37.505747+0000","last_fullsized":"2024-09-19T09:42:37.505747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529045+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:37.529045+0000","last_peered":"2024-09-19T09:42:37.529045+0000","last_clean":"2024-09-19T09:42:37.529045+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:37.529045+0000","last_undegraded":"2024-09-19T09:42:37.529045+0000","last_fullsized":"2024-09-19T09:42:37.529045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.641481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506728+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:37.506728+0000","last_peered":"2024-09-19T09:42:37.506728+0000","last_clean":"2024-09-19T09:42:37.506728+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:37.506728+0000","last_undegraded":"2024-09-19T09:42:37.506728+0000","last_fullsized":"2024-09-19T09:42:37.506728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528358+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:37.528358+0000","last_peered":"2024-09-19T09:42:37.528358+0000","last_clean":"2024-09-19T09:42:37.528358+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:37.528358+0000","last_undegraded":"2024-09-19T09:42:37.528358+0000","last_fullsized":"2024-09-19T09:42:37.528358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.218733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512692+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:37.512692+0000","last_peered":"2024-09-19T09:42:37.512692+0000","last_clean":"2024-09-19T09:42:37.512692+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:37.512692+0000","last_undegraded":"2024-09-19T09:42:37.512692+0000","last_fullsized":"2024-09-19T09:42:37.512692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529678+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:37.529678+0000","last_peered":"2024-09-19T09:42:37.529678+0000","last_clean":"2024-09-19T09:42:37.529678+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:37.529678+0000","last_undegraded":"2024-09-19T09:42:37.529678+0000","last_fullsized":"2024-09-19T09:42:37.529678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.537917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505904+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:37.505904+0000","last_peered":"2024-09-19T09:42:37.505904+0000","last_clean":"2024-09-19T09:42:37.505904+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:37.505904+0000","last_undegraded":"2024-09-19T09:42:37.505904+0000","last_fullsized":"2024-09-19T09:42:37.505904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:37.521415+0000","last_peered":"2024-09-19T09:42:37.521415+0000","last_clean":"2024-09-19T09:42:37.521415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:37.521415+0000","last_undegraded":"2024-09-19T09:42:37.521415+0000","last_fullsized":"2024-09-19T09:42:37.521415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:43.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488432+0000","last_change":"2024-09-19T09:42:35.488432+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488432+0000","last_undegraded":"2024-09-19T09:42:35.488432+0000","last_fullsized":"2024-09-19T09:42:35.488432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528927+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:37.528927+0000","last_peered":"2024-09-19T09:42:37.528927+0000","last_clean":"2024-09-19T09:42:37.528927+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:37.528927+0000","last_undegraded":"2024-09-19T09:42:37.528927+0000","last_fullsized":"2024-09-19T09:42:37.528927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:58.084932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505607+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:37.505607+0000","last_peered":"2024-09-19T09:42:37.505607+0000","last_clean":"2024-09-19T09:42:37.505607+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:37.505607+0000","last_undegraded":"2024-09-19T09:42:37.505607+0000","last_fullsized":"2024-09-19T09:42:37.505607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529704+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:37.529704+0000","last_peered":"2024-09-19T09:42:37.529704+0000","last_clean":"2024-09-19T09:42:37.529704+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:37.529704+0000","last_undegraded":"2024-09-19T09:42:37.529704+0000","last_fullsized":"2024-09-19T09:42:37.529704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:51.417176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488491+0000","last_change":"2024-09-19T09:42:35.488491+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488491+0000","last_undegraded":"2024-09-19T09:42:35.488491+0000","last_fullsized":"2024-09-19T09:42:35.488491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529677+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:37.529677+0000","last_peered":"2024-09-19T09:42:37.529677+0000","last_clean":"2024-09-19T09:42:37.529677+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:37.529677+0000","last_undegraded":"2024-09-19T09:42:37.529677+0000","last_fullsized":"2024-09-19T09:42:37.529677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:30.350852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504671+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:37.504671+0000","last_peered":"2024-09-19T09:42:37.504671+0000","last_clean":"2024-09-19T09:42:37.504671+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:37.504671+0000","last_undegraded":"2024-09-19T09:42:37.504671+0000","last_fullsized":"2024-09-19T09:42:37.504671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526017+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:37.526017+0000","last_peered":"2024-09-19T09:42:37.526017+0000","last_clean":"2024-09-19T09:42:37.526017+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:37.526017+0000","last_undegraded":"2024-09-19T09:42:37.526017+0000","last_fullsized":"2024-09-19T09:42:37.526017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:12.483808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488374+0000","last_change":"2024-09-19T09:42:35.488374+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488374+0000","last_undegraded":"2024-09-19T09:42:35.488374+0000","last_fullsized":"2024-09-19T09:42:35.488374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529579+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:37.529579+0000","last_peered":"2024-09-19T09:42:37.529579+0000","last_clean":"2024-09-19T09:42:37.529579+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:37.529579+0000","last_undegraded":"2024-09-19T09:42:37.529579+0000","last_fullsized":"2024-09-19T09:42:37.529579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:22.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517484+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:37.517484+0000","last_peered":"2024-09-19T09:42:37.517484+0000","last_clean":"2024-09-19T09:42:37.517484+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:37.517484+0000","last_undegraded":"2024-09-19T09:42:37.517484+0000","last_fullsized":"2024-09-19T09:42:37.517484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.510554+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:37.510554+0000","last_peered":"2024-09-19T09:42:37.510554+0000","last_clean":"2024-09-19T09:42:37.510554+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:37.510554+0000","last_undegraded":"2024-09-19T09:42:37.510554+0000","last_fullsized":"2024-09-19T09:42:37.510554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525865+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:37.525865+0000","last_peered":"2024-09-19T09:42:37.525865+0000","last_clean":"2024-09-19T09:42:37.525865+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:37.525865+0000","last_undegraded":"2024-09-19T09:42:37.525865+0000","last_fullsized":"2024-09-19T09:42:37.525865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:02.766622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517823+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:37.517823+0000","last_peered":"2024-09-19T09:42:37.517823+0000","last_clean":"2024-09-19T09:42:37.517823+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:37.517823+0000","last_undegraded":"2024-09-19T09:42:37.517823+0000","last_fullsized":"2024-09-19T09:42:37.517823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520670+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:37.520670+0000","last_peered":"2024-09-19T09:42:37.520670+0000","last_clean":"2024-09-19T09:42:37.520670+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:37.520670+0000","last_undegraded":"2024-09-19T09:42:37.520670+0000","last_fullsized":"2024-09-19T09:42:37.520670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-19T09:42:35.488376+0000","last_change":"2024-09-19T09:42:35.488376+0000","last_active":"2024-09-19T09:42:35.474051+0000","last_peered":"2024-09-19T09:42:35.474051+0000","last_clean":"2024-09-19T09:42:35.474051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:42:35.488376+0000","last_undegraded":"2024-09-19T09:42:35.488376+0000","last_fullsized":"2024-09-19T09:42:35.488376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515746+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:37.515746+0000","last_peered":"2024-09-19T09:42:37.515746+0000","last_clean":"2024-09-19T09:42:37.515746+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:37.515746+0000","last_undegraded":"2024-09-19T09:42:37.515746+0000","last_fullsized":"2024-09-19T09:42:37.515746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512835+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:37.512835+0000","last_peered":"2024-09-19T09:42:37.512835+0000","last_clean":"2024-09-19T09:42:37.512835+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:37.512835+0000","last_undegraded":"2024-09-19T09:42:37.512835+0000","last_fullsized":"2024-09-19T09:42:37.512835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.522538+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:37.522538+0000","last_peered":"2024-09-19T09:42:37.522538+0000","last_clean":"2024-09-19T09:42:37.522538+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:37.522538+0000","last_undegraded":"2024-09-19T09:42:37.522538+0000","last_fullsized":"2024-09-19T09:42:37.522538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:36.990463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504431+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:37.504431+0000","last_peered":"2024-09-19T09:42:37.504431+0000","last_clean":"2024-09-19T09:42:37.504431+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:37.504431+0000","last_undegraded":"2024-09-19T09:42:37.504431+0000","last_fullsized":"2024-09-19T09:42:37.504431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527661+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:37.527661+0000","last_peered":"2024-09-19T09:42:37.527661+0000","last_clean":"2024-09-19T09:42:37.527661+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:37.527661+0000","last_undegraded":"2024-09-19T09:42:37.527661+0000","last_fullsized":"2024-09-19T09:42:37.527661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:46.760134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519991+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:37.519991+0000","last_peered":"2024-09-19T09:42:37.519991+0000","last_clean":"2024-09-19T09:42:37.519991+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:37.519991+0000","last_undegraded":"2024-09-19T09:42:37.519991+0000","last_fullsized":"2024-09-19T09:42:37.519991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516012+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:37.516012+0000","last_peered":"2024-09-19T09:42:37.516012+0000","last_clean":"2024-09-19T09:42:37.516012+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:37.516012+0000","last_undegraded":"2024-09-19T09:42:37.516012+0000","last_fullsized":"2024-09-19T09:42:37.516012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:49.909733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504564+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:37.504564+0000","last_peered":"2024-09-19T09:42:37.504564+0000","last_clean":"2024-09-19T09:42:37.504564+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:37.504564+0000","last_undegraded":"2024-09-19T09:42:37.504564+0000","last_fullsized":"2024-09-19T09:42:37.504564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528430+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:37.528430+0000","last_peered":"2024-09-19T09:42:37.528430+0000","last_clean":"2024-09-19T09:42:37.528430+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:37.528430+0000","last_undegraded":"2024-09-19T09:42:37.528430+0000","last_fullsized":"2024-09-19T09:42:37.528430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:18.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506210+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:37.506210+0000","last_peered":"2024-09-19T09:42:37.506210+0000","last_clean":"2024-09-19T09:42:37.506210+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:37.506210+0000","last_undegraded":"2024-09-19T09:42:37.506210+0000","last_fullsized":"2024-09-19T09:42:37.506210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520831+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:37.520831+0000","last_peered":"2024-09-19T09:42:37.520831+0000","last_clean":"2024-09-19T09:42:37.520831+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:37.520831+0000","last_undegraded":"2024-09-19T09:42:37.520831+0000","last_fullsized":"2024-09-19T09:42:37.520831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:11.793665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517432+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:37.517432+0000","last_peered":"2024-09-19T09:42:37.517432+0000","last_clean":"2024-09-19T09:42:37.517432+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:37.517432+0000","last_undegraded":"2024-09-19T09:42:37.517432+0000","last_fullsized":"2024-09-19T09:42:37.517432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512844+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:37.512844+0000","last_peered":"2024-09-19T09:42:37.512844+0000","last_clean":"2024-09-19T09:42:37.512844+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:37.512844+0000","last_undegraded":"2024-09-19T09:42:37.512844+0000","last_fullsized":"2024-09-19T09:42:37.512844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:25.197598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504951+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:37.504951+0000","last_peered":"2024-09-19T09:42:37.504951+0000","last_clean":"2024-09-19T09:42:37.504951+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:37.504951+0000","last_undegraded":"2024-09-19T09:42:37.504951+0000","last_fullsized":"2024-09-19T09:42:37.504951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523317+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:37.523317+0000","last_peered":"2024-09-19T09:42:37.523317+0000","last_clean":"2024-09-19T09:42:37.523317+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:37.523317+0000","last_undegraded":"2024-09-19T09:42:37.523317+0000","last_fullsized":"2024-09-19T09:42:37.523317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:32.907310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504328+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:37.504328+0000","last_peered":"2024-09-19T09:42:37.504328+0000","last_clean":"2024-09-19T09:42:37.504328+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:37.504328+0000","last_undegraded":"2024-09-19T09:42:37.504328+0000","last_fullsized":"2024-09-19T09:42:37.504328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523363+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:37.523363+0000","last_peered":"2024-09-19T09:42:37.523363+0000","last_clean":"2024-09-19T09:42:37.523363+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:37.523363+0000","last_undegraded":"2024-09-19T09:42:37.523363+0000","last_fullsized":"2024-09-19T09:42:37.523363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:18.634777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518619+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:37.518619+0000","last_peered":"2024-09-19T09:42:37.518619+0000","last_clean":"2024-09-19T09:42:37.518619+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:37.518619+0000","last_undegraded":"2024-09-19T09:42:37.518619+0000","last_fullsized":"2024-09-19T09:42:37.518619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521363+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:37.521363+0000","last_peered":"2024-09-19T09:42:37.521363+0000","last_clean":"2024-09-19T09:42:37.521363+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:37.521363+0000","last_undegraded":"2024-09-19T09:42:37.521363+0000","last_fullsized":"2024-09-19T09:42:37.521363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:14.796097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524033+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:37.524033+0000","last_peered":"2024-09-19T09:42:37.524033+0000","last_clean":"2024-09-19T09:42:37.524033+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:37.524033+0000","last_undegraded":"2024-09-19T09:42:37.524033+0000","last_fullsized":"2024-09-19T09:42:37.524033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518495+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:37.518495+0000","last_peered":"2024-09-19T09:42:37.518495+0000","last_clean":"2024-09-19T09:42:37.518495+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:37.518495+0000","last_undegraded":"2024-09-19T09:42:37.518495+0000","last_fullsized":"2024-09-19T09:42:37.518495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524588+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:37.524588+0000","last_peered":"2024-09-19T09:42:37.524588+0000","last_clean":"2024-09-19T09:42:37.524588+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:37.524588+0000","last_undegraded":"2024-09-19T09:42:37.524588+0000","last_fullsized":"2024-09-19T09:42:37.524588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:38.753135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519528+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:37.519528+0000","last_peered":"2024-09-19T09:42:37.519528+0000","last_clean":"2024-09-19T09:42:37.519528+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:37.519528+0000","last_undegraded":"2024-09-19T09:42:37.519528+0000","last_fullsized":"2024-09-19T09:42:37.519528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525904+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:37.525904+0000","last_peered":"2024-09-19T09:42:37.525904+0000","last_clean":"2024-09-19T09:42:37.525904+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:37.525904+0000","last_undegraded":"2024-09-19T09:42:37.525904+0000","last_fullsized":"2024-09-19T09:42:37.525904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:23.577488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507762+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:37.507762+0000","last_peered":"2024-09-19T09:42:37.507762+0000","last_clean":"2024-09-19T09:42:37.507762+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:37.507762+0000","last_undegraded":"2024-09-19T09:42:37.507762+0000","last_fullsized":"2024-09-19T09:42:37.507762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521745+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:37.521745+0000","last_peered":"2024-09-19T09:42:37.521745+0000","last_clean":"2024-09-19T09:42:37.521745+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:37.521745+0000","last_undegraded":"2024-09-19T09:42:37.521745+0000","last_fullsized":"2024-09-19T09:42:37.521745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:13.952632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506615+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:37.506615+0000","last_peered":"2024-09-19T09:42:37.506615+0000","last_clean":"2024-09-19T09:42:37.506615+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:37.506615+0000","last_undegraded":"2024-09-19T09:42:37.506615+0000","last_fullsized":"2024-09-19T09:42:37.506615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":124,"acting":124,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:42:36.478070+0000', 'last_change': '2024-09-19T09:42:36.478070+0000', 'last_active': '2024-09-19T09:42:36.478070+0000', 'last_peered': '2024-09-19T09:42:36.478070+0000', 'last_clean': '2024-09-19T09:42:36.478070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:42:36.478070+0000', 'last_undegraded': '2024-09-19T09:42:36.478070+0000', 'last_fullsized': '2024-09-19T09:42:36.478070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:42:36.478070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:42:36.478070+0000', 'last_clean_scrub_stamp': '2024-09-19T09:42:36.478070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:42:36.478070+0000', 'last_change': '2024-09-19T09:42:36.478070+0000', 'last_active': '2024-09-19T09:42:36.478070+0000', 'last_peered': '2024-09-19T09:42:36.478070+0000', 'last_clean': '2024-09-19T09:42:36.478070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:42:36.478070+0000', 'last_undegraded': '2024-09-19T09:42:36.478070+0000', 'last_fullsized': '2024-09-19T09:42:36.478070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:42:36.478070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:42:36.478070+0000', 'last_clean_scrub_stamp': '2024-09-19T09:42:36.478070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:42:35.488432+0000', 'last_change': '2024-09-19T09:42:35.488432+0000', 'last_active': '2024-09-19T09:42:35.474051+0000', 'last_peered': '2024-09-19T09:42:35.474051+0000', 'last_clean': '2024-09-19T09:42:35.474051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:42:35.488432+0000', 'last_undegraded': '2024-09-19T09:42:35.488432+0000', 'last_fullsized': '2024-09-19T09:42:35.488432+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_clean_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:42:35.488491+0000', 'last_change': '2024-09-19T09:42:35.488491+0000', 'last_active': '2024-09-19T09:42:35.474051+0000', 'last_peered': '2024-09-19T09:42:35.474051+0000', 'last_clean': '2024-09-19T09:42:35.474051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:42:35.488491+0000', 'last_undegraded': '2024-09-19T09:42:35.488491+0000', 'last_fullsized': '2024-09-19T09:42:35.488491+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_clean_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-19T09:42:42.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:42:35.488374+0000', 'last_change': '2024-09-19T09:42:35.488374+0000', 'last_active': '2024-09-19T09:42:35.474051+0000', 'last_peered': '2024-09-19T09:42:35.474051+0000', 'last_clean': '2024-09-19T09:42:35.474051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:42:35.488374+0000', 'last_undegraded': '2024-09-19T09:42:35.488374+0000', 'last_fullsized': '2024-09-19T09:42:35.488374+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_clean_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:42:42.120 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-19T09:42:42.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:42:35.488376+0000', 'last_change': '2024-09-19T09:42:35.488376+0000', 'last_active': '2024-09-19T09:42:35.474051+0000', 'last_peered': '2024-09-19T09:42:35.474051+0000', 'last_clean': '2024-09-19T09:42:35.474051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:42:35.488376+0000', 'last_undegraded': '2024-09-19T09:42:35.488376+0000', 'last_fullsized': '2024-09-19T09:42:35.488376+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'last_clean_scrub_stamp': '2024-09-19T09:42:35.474051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:42:42.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T09:42:42.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.252+0000 7f6fa96e4640 1 Processor -- start 2024-09-19T09:42:42.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 -- start start 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa40cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa40c7f40 0x7f6fa40ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6fa40c8400 0x7f6fa40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa415c240 con 0x7f6fa40c7f40 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa4155a30 con 0x7f6fa40c8400 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa96e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa415b3e0 con 0x7f6fa4155650 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa27fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa40c7f40 0x7f6fa40ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa27fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa40c7f40 0x7f6fa40ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54008/0 (socket says 172.21.15.123:54008) 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.253+0000 7f6fa27fc640 1 -- 172.21.15.123:0/4279851617 learned_addr learned my addr 172.21.15.123:0/4279851617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa2ffd640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa40cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa37fe640 1 --2- 172.21.15.123:0/4279851617 >> v2:172.21.15.194:3300/0 conn(0x7f6fa40c8400 0x7f6fa40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa27fc640 1 -- 172.21.15.123:0/4279851617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 msgr2=0x7f6fa40cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:42.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa40cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa27fc640 1 -- 172.21.15.123:0/4279851617 >> v2:172.21.15.194:3300/0 conn(0x7f6fa40c8400 msgr2=0x7f6fa40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:42.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/4279851617 >> v2:172.21.15.194:3300/0 conn(0x7f6fa40c8400 0x7f6fa40cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa27fc640 1 -- 172.21.15.123:0/4279851617 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa415b6c0 con 0x7f6fa40c7f40 2024-09-19T09:42:42.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa2ffd640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa40cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:42.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.254+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c7f40 0x7f6fa40ccd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fa408e140 tx=0x7f6f8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c09521edfb8fef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:42.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa1ffb640 1 -- 172.21.15.123:0/4279851617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c037070 con 0x7f6fa40c7f40 2024-09-19T09:42:42.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa1ffb640 1 -- 172.21.15.123:0/4279851617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c032440 con 0x7f6fa40c7f40 2024-09-19T09:42:42.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa1ffb640 1 -- 172.21.15.123:0/4279851617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c032810 con 0x7f6fa40c7f40 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 -- 172.21.15.123:0/4279851617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c7f40 msgr2=0x7f6fa40ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c7f40 0x7f6fa40ccd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fa408e140 tx=0x7f6f8c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 -- 172.21.15.123:0/4279851617 shutdown_connections 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/4279851617 >> v2:172.21.15.194:3300/0 conn(0x7f6fa40c8400 0x7f6fa40cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c7f40 0x7f6fa40ccd90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/4279851617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa40cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 -- 172.21.15.123:0/4279851617 >> 172.21.15.123:0/4279851617 conn(0x7f6fa40cd5c0 msgr2=0x7f6fa40cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 -- 172.21.15.123:0/4279851617 shutdown_connections 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.255+0000 7f6fa96e4640 1 -- 172.21.15.123:0/4279851617 wait complete. 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 Processor -- start 2024-09-19T09:42:42.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 -- start start 2024-09-19T09:42:42.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa40c7f40 0x7f6fa415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 0x7f6fa41f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa4158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa415bf60 con 0x7f6fa40c8400 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa415bc80 con 0x7f6fa40c7f40 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa96e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa40ce430 con 0x7f6fa4155650 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 0x7f6fa41f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 0x7f6fa41f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54010/0 (socket says 172.21.15.123:54010) 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3695780050 learned_addr learned my addr 172.21.15.123:0/3695780050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.257+0000 7f6fa2ffd640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa40c7f40 0x7f6fa415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa37fe640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa4158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 msgr2=0x7f6fa4158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa4158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa40c7f40 msgr2=0x7f6fa415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa40c7f40 0x7f6fa415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3695780050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa41f5b50 con 0x7f6fa40c8400 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa37fe640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa4158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:42.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 0x7f6fa41f1780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c041020 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c03d620 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa40c69c0 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c037040 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.258+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa41f4d90 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.259+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa40d0460 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.259+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f8c044020 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.260+0000 7f6f9b7fe640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f8406c2b0 0x7f6f8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.260+0000 7f6fa2ffd640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f8406c2b0 0x7f6f8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.260+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f8c0abd60 con 0x7f6fa40c8400 2024-09-19T09:42:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.260+0000 7f6fa2ffd640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f8406c2b0 0x7f6f8406e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009560 tx=0x7f6f9c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.264+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6f8c04b020 con 0x7f6fa40c8400 2024-09-19T09:42:42.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.493+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6fa40b6ae0 con 0x7f6fa40c8400 2024-09-19T09:42:42.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.493+0000 7f6f9b7fe640 1 -- 172.21.15.123:0/3695780050 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1152 (secure 0 0 0) 0x7f6f8c07a440 con 0x7f6fa40c8400 2024-09-19T09:42:42.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:42.495 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726738947,"num_in_osds":8,"osd_in_since":1726738936,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":4},{"state_name":"unknown","count":2}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224284672,"bytes_avail":772869828608,"bytes_total":773094113280,"unknown_pgs_ratio":0.020618556067347527,"inactive_pgs_ratio":0.041237112134695053},"fsmap":{"epoch":7,"btime":"2024-09-19T09:42:40:520630+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"e","status":"up:creating","gid":4308}],"up:standby":5},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-19T09:42:14.649222+0000","services":{}},"progress_events":{}} 2024-09-19T09:42:42.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f8406c2b0 msgr2=0x7f6f8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f8406c2b0 0x7f6f8406e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009560 tx=0x7f6f9c009190 comp rx=0 tx=0).stop 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 msgr2=0x7f6fa41f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 0x7f6fa41f1780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 shutdown_connections 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f8406c2b0 0x7f6f8406e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fa4155650 0x7f6fa4158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40c8400 0x7f6fa41f1780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 --2- 172.21.15.123:0/3695780050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa40c7f40 0x7f6fa415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 >> 172.21.15.123:0/3695780050 conn(0x7f6fa40cd5c0 msgr2=0x7f6fa41e33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 shutdown_connections 2024-09-19T09:42:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.495+0000 7f6fa96e4640 1 -- 172.21.15.123:0/3695780050 wait complete. 2024-09-19T09:42:42.508 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:42:42.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:42.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 Processor -- start 2024-09-19T09:42:42.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 -- start start 2024-09-19T09:42:42.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa18c0c7f40 0x7fa18c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa18c0c8400 0x7fa18c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c15c240 con 0x7fa18c155650 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa18c155a30 con 0x7fa18c0c7f40 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.609+0000 7fa192ed0640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa18c15b3e0 con 0x7fa18c0c8400 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa18c0c7f40 0x7fa18c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa190c6c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa18c155650 0x7fa18c0cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58728/0 (socket says 172.21.15.123:58728) 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa18c0c7f40 0x7fa18c0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54026/0 (socket says 172.21.15.123:54026) 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa190c6c640 1 -- 172.21.15.123:0/2085023894 learned_addr learned my addr 172.21.15.123:0/2085023894 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa19146d640 1 --2- 172.21.15.123:0/2085023894 >> v2:172.21.15.194:3300/0 conn(0x7fa18c0c8400 0x7fa18c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18bfff640 1 -- 172.21.15.123:0/2085023894 >> v2:172.21.15.194:3300/0 conn(0x7fa18c0c8400 msgr2=0x7fa18c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18bfff640 1 --2- 172.21.15.123:0/2085023894 >> v2:172.21.15.194:3300/0 conn(0x7fa18c0c8400 0x7fa18c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18bfff640 1 -- 172.21.15.123:0/2085023894 >> v1:172.21.15.123:6789/0 conn(0x7fa18c155650 legacy=0x7fa18c0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18bfff640 1 -- 172.21.15.123:0/2085023894 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c15b6c0 con 0x7fa18c0c7f40 2024-09-19T09:42:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa18b7fe640 1 -- 172.21.15.123:0/2085023894 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221374382 0 0) 0x7fa18c15c240 con 0x7fa18c155650 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.610+0000 7fa19146d640 1 --2- 172.21.15.123:0/2085023894 >> v2:172.21.15.194:3300/0 conn(0x7fa18c0c8400 0x7fa18c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa18bfff640 1 --2- 172.21.15.123:0/2085023894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c0c7f40 0x7fa18c0cb7f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0ca480 tx=0x7fa17c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc39954a000d675d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa18b7fe640 1 -- 172.21.15.123:0/2085023894 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c007740 con 0x7fa18c0c7f40 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa18b7fe640 1 -- 172.21.15.123:0/2085023894 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c0078e0 con 0x7fa18c0c7f40 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa18b7fe640 1 -- 172.21.15.123:0/2085023894 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c007cb0 con 0x7fa18c0c7f40 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 -- 172.21.15.123:0/2085023894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c0c7f40 msgr2=0x7fa18c0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 --2- 172.21.15.123:0/2085023894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c0c7f40 0x7fa18c0cb7f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0ca480 tx=0x7fa17c02a680 comp rx=0 tx=0).stop 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 -- 172.21.15.123:0/2085023894 shutdown_connections 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 --2- 172.21.15.123:0/2085023894 >> v2:172.21.15.194:3300/0 conn(0x7fa18c0c8400 0x7fa18c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 --2- 172.21.15.123:0/2085023894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c0c7f40 0x7fa18c0cb7f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 -- 172.21.15.123:0/2085023894 >> 172.21.15.123:0/2085023894 conn(0x7fa18c0cd5c0 msgr2=0x7fa18c0cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 -- 172.21.15.123:0/2085023894 shutdown_connections 2024-09-19T09:42:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.611+0000 7fa192ed0640 1 -- 172.21.15.123:0/2085023894 wait complete. 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.612+0000 7fa192ed0640 1 Processor -- start 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.612+0000 7fa192ed0640 1 -- start start 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa192ed0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa18c0c7f40 0x7fa18c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa192ed0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa18c0c8400 0x7fa18c14a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa192ed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 0x7fa18c14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa192ed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c15bf60 con 0x7fa18c155650 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa192ed0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c15bc80 con 0x7fa18c0c7f40 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa192ed0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa18c0ce430 con 0x7fa18c0c8400 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa19146d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 0x7fa18c14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa19146d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 0x7fa18c14b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54036/0 (socket says 172.21.15.123:54036) 2024-09-19T09:42:42.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.613+0000 7fa19146d640 1 -- 172.21.15.123:0/1501095720 learned_addr learned my addr 172.21.15.123:0/1501095720 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa190c6c640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa18c0c7f40 0x7fa18c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa18bfff640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa18c0c8400 0x7fa18c14a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa19146d640 1 -- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa18c0c8400 msgr2=0x7fa18c14a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa19146d640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa18c0c8400 0x7fa18c14a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa19146d640 1 -- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa18c0c7f40 msgr2=0x7fa18c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa19146d640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa18c0c7f40 0x7fa18c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa19146d640 1 -- 172.21.15.123:0/1501095720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c153290 con 0x7fa18c155650 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa190c6c640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa18c0c7f40 0x7fa18c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa18bfff640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa18c0c8400 0x7fa18c14a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa19146d640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 0x7fa18c14b9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c7f0 tx=0x7fa17400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174015020 con 0x7fa18c155650 2024-09-19T09:42:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174004230 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c159a20 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174007620 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.614+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c153bb0 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.615+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18c0d0460 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.615+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa174018020 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.616+0000 7fa1897fa640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa16c06c2b0 0x7fa16c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.616+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa17408b6f0 con 0x7fa18c155650 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.616+0000 7fa190c6c640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa16c06c2b0 0x7fa16c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.616+0000 7fa190c6c640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa16c06c2b0 0x7fa16c06e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa184000f60 tx=0x7fa184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:42.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.620+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa17401f020 con 0x7fa18c155650 2024-09-19T09:42:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.787+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa18c0b6690 con 0x7fa16c06c2b0 2024-09-19T09:42:42.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.792+0000 7fa1897fa640 1 -- 172.21.15.123:0/1501095720 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251783 (secure 0 0 0) 0x7fa18c0b6690 con 0x7fa16c06c2b0 2024-09-19T09:42:42.797 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:42.798 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa16c06c2b0 msgr2=0x7fa16c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa16c06c2b0 0x7fa16c06e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa184000f60 tx=0x7fa184009040 comp rx=0 tx=0).stop 2024-09-19T09:42:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 msgr2=0x7fa18c14b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 0x7fa18c14b9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c7f0 tx=0x7fa17400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 shutdown_connections 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa18c155650 0x7fa18c14b9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa16c06c2b0 0x7fa16c06e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa18c0c8400 0x7fa18c14a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 --2- 172.21.15.123:0/1501095720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa18c0c7f40 0x7fa18c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 >> 172.21.15.123:0/1501095720 conn(0x7fa18c0cd5c0 msgr2=0x7fa18c0c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 shutdown_connections 2024-09-19T09:42:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:42.795+0000 7fa192ed0640 1 -- 172.21.15.123:0/1501095720 wait complete. 2024-09-19T09:42:42.808 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-19T09:42:42.697546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219068,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755652,"statfs":{"total":773094113280,"available":772869787648,"internally_reserved":0,"allocated":2883584,"data_stored":1739091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.213943"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529577+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:37.529577+0000","last_peered":"2024-09-19T09:42:37.529577+0000","last_clean":"2024-09-19T09:42:37.529577+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:37.529577+0000","last_undegraded":"2024-09-19T09:42:37.529577+0000","last_fullsized":"2024-09-19T09:42:37.529577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:10.159162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523191+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:37.523191+0000","last_peered":"2024-09-19T09:42:37.523191+0000","last_clean":"2024-09-19T09:42:37.523191+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:37.523191+0000","last_undegraded":"2024-09-19T09:42:37.523191+0000","last_fullsized":"2024-09-19T09:42:37.523191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:34.777780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523616+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:37.523616+0000","last_peered":"2024-09-19T09:42:37.523616+0000","last_clean":"2024-09-19T09:42:37.523616+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:37.523616+0000","last_undegraded":"2024-09-19T09:42:37.523616+0000","last_fullsized":"2024-09-19T09:42:37.523616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:51.494981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526042+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:37.526042+0000","last_peered":"2024-09-19T09:42:37.526042+0000","last_clean":"2024-09-19T09:42:37.526042+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:37.526042+0000","last_undegraded":"2024-09-19T09:42:37.526042+0000","last_fullsized":"2024-09-19T09:42:37.526042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:25.886030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529624+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:37.529624+0000","last_peered":"2024-09-19T09:42:37.529624+0000","last_clean":"2024-09-19T09:42:37.529624+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:37.529624+0000","last_undegraded":"2024-09-19T09:42:37.529624+0000","last_fullsized":"2024-09-19T09:42:37.529624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:24.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524376+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:37.524376+0000","last_peered":"2024-09-19T09:42:37.524376+0000","last_clean":"2024-09-19T09:42:37.524376+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:37.524376+0000","last_undegraded":"2024-09-19T09:42:37.524376+0000","last_fullsized":"2024-09-19T09:42:37.524376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:40.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529109+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:37.529109+0000","last_peered":"2024-09-19T09:42:37.529109+0000","last_clean":"2024-09-19T09:42:37.529109+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:37.529109+0000","last_undegraded":"2024-09-19T09:42:37.529109+0000","last_fullsized":"2024-09-19T09:42:37.529109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:44.704108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520920+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:37.520920+0000","last_peered":"2024-09-19T09:42:37.520920+0000","last_clean":"2024-09-19T09:42:37.520920+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:37.520920+0000","last_undegraded":"2024-09-19T09:42:37.520920+0000","last_fullsized":"2024-09-19T09:42:37.520920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:46.803436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529710+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:37.529710+0000","last_peered":"2024-09-19T09:42:37.529710+0000","last_clean":"2024-09-19T09:42:37.529710+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:37.529710+0000","last_undegraded":"2024-09-19T09:42:37.529710+0000","last_fullsized":"2024-09-19T09:42:37.529710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:45.955881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524134+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:37.524134+0000","last_peered":"2024-09-19T09:42:37.524134+0000","last_clean":"2024-09-19T09:42:37.524134+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:37.524134+0000","last_undegraded":"2024-09-19T09:42:37.524134+0000","last_fullsized":"2024-09-19T09:42:37.524134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:10.602570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525755+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:37.525755+0000","last_peered":"2024-09-19T09:42:37.525755+0000","last_clean":"2024-09-19T09:42:37.525755+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:37.525755+0000","last_undegraded":"2024-09-19T09:42:37.525755+0000","last_fullsized":"2024-09-19T09:42:37.525755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:07.412836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520319+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:37.520319+0000","last_peered":"2024-09-19T09:42:37.520319+0000","last_clean":"2024-09-19T09:42:37.520319+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:37.520319+0000","last_undegraded":"2024-09-19T09:42:37.520319+0000","last_fullsized":"2024-09-19T09:42:37.520319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:45.686208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520948+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:37.520948+0000","last_peered":"2024-09-19T09:42:37.520948+0000","last_clean":"2024-09-19T09:42:37.520948+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:37.520948+0000","last_undegraded":"2024-09-19T09:42:37.520948+0000","last_fullsized":"2024-09-19T09:42:37.520948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:02.040571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520757+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:37.520757+0000","last_peered":"2024-09-19T09:42:37.520757+0000","last_clean":"2024-09-19T09:42:37.520757+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:37.520757+0000","last_undegraded":"2024-09-19T09:42:37.520757+0000","last_fullsized":"2024-09-19T09:42:37.520757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:50.287624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:37.521650+0000","last_peered":"2024-09-19T09:42:37.521650+0000","last_clean":"2024-09-19T09:42:37.521650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:37.521650+0000","last_undegraded":"2024-09-19T09:42:37.521650+0000","last_fullsized":"2024-09-19T09:42:37.521650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:14.066276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523708+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:37.523708+0000","last_peered":"2024-09-19T09:42:37.523708+0000","last_clean":"2024-09-19T09:42:37.523708+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:37.523708+0000","last_undegraded":"2024-09-19T09:42:37.523708+0000","last_fullsized":"2024-09-19T09:42:37.523708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:52.065555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526078+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:37.526078+0000","last_peered":"2024-09-19T09:42:37.526078+0000","last_clean":"2024-09-19T09:42:37.526078+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:37.526078+0000","last_undegraded":"2024-09-19T09:42:37.526078+0000","last_fullsized":"2024-09-19T09:42:37.526078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:39.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924975+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:42:38.924975+0000","last_peered":"2024-09-19T09:42:38.924975+0000","last_clean":"2024-09-19T09:42:38.924975+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:42:38.924975+0000","last_undegraded":"2024-09-19T09:42:38.924975+0000","last_fullsized":"2024-09-19T09:42:38.924975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529641+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:37.529641+0000","last_peered":"2024-09-19T09:42:37.529641+0000","last_clean":"2024-09-19T09:42:37.529641+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:37.529641+0000","last_undegraded":"2024-09-19T09:42:37.529641+0000","last_fullsized":"2024-09-19T09:42:37.529641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:22.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516538+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:37.516538+0000","last_peered":"2024-09-19T09:42:37.516538+0000","last_clean":"2024-09-19T09:42:37.516538+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:37.516538+0000","last_undegraded":"2024-09-19T09:42:37.516538+0000","last_fullsized":"2024-09-19T09:42:37.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:05.295037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525935+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:37.525935+0000","last_peered":"2024-09-19T09:42:37.525935+0000","last_clean":"2024-09-19T09:42:37.525935+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:37.525935+0000","last_undegraded":"2024-09-19T09:42:37.525935+0000","last_fullsized":"2024-09-19T09:42:37.525935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:34.313085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527336+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:37.527336+0000","last_peered":"2024-09-19T09:42:37.527336+0000","last_clean":"2024-09-19T09:42:37.527336+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:37.527336+0000","last_undegraded":"2024-09-19T09:42:37.527336+0000","last_fullsized":"2024-09-19T09:42:37.527336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:47.771515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520871+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:37.520871+0000","last_peered":"2024-09-19T09:42:37.520871+0000","last_clean":"2024-09-19T09:42:37.520871+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:37.520871+0000","last_undegraded":"2024-09-19T09:42:37.520871+0000","last_fullsized":"2024-09-19T09:42:37.520871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:59.689786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517517+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:37.517517+0000","last_peered":"2024-09-19T09:42:37.517517+0000","last_clean":"2024-09-19T09:42:37.517517+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:37.517517+0000","last_undegraded":"2024-09-19T09:42:37.517517+0000","last_fullsized":"2024-09-19T09:42:37.517517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:08.090159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520818+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:37.520818+0000","last_peered":"2024-09-19T09:42:37.520818+0000","last_clean":"2024-09-19T09:42:37.520818+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:37.520818+0000","last_undegraded":"2024-09-19T09:42:37.520818+0000","last_fullsized":"2024-09-19T09:42:37.520818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:49.323217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524154+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:37.524154+0000","last_peered":"2024-09-19T09:42:37.524154+0000","last_clean":"2024-09-19T09:42:37.524154+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:37.524154+0000","last_undegraded":"2024-09-19T09:42:37.524154+0000","last_fullsized":"2024-09-19T09:42:37.524154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515438+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:37.515438+0000","last_peered":"2024-09-19T09:42:37.515438+0000","last_clean":"2024-09-19T09:42:37.515438+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:37.515438+0000","last_undegraded":"2024-09-19T09:42:37.515438+0000","last_fullsized":"2024-09-19T09:42:37.515438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:14.060978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520798+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:37.520798+0000","last_peered":"2024-09-19T09:42:37.520798+0000","last_clean":"2024-09-19T09:42:37.520798+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:37.520798+0000","last_undegraded":"2024-09-19T09:42:37.520798+0000","last_fullsized":"2024-09-19T09:42:37.520798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520942+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:37.520942+0000","last_peered":"2024-09-19T09:42:37.520942+0000","last_clean":"2024-09-19T09:42:37.520942+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:37.520942+0000","last_undegraded":"2024-09-19T09:42:37.520942+0000","last_fullsized":"2024-09-19T09:42:37.520942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:13.898264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524356+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:37.524356+0000","last_peered":"2024-09-19T09:42:37.524356+0000","last_clean":"2024-09-19T09:42:37.524356+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:37.524356+0000","last_undegraded":"2024-09-19T09:42:37.524356+0000","last_fullsized":"2024-09-19T09:42:37.524356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:39.510007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924787+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:42:38.924787+0000","last_peered":"2024-09-19T09:42:38.924787+0000","last_clean":"2024-09-19T09:42:38.924787+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:42:38.924787+0000","last_undegraded":"2024-09-19T09:42:38.924787+0000","last_fullsized":"2024-09-19T09:42:38.924787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521393+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:37.521393+0000","last_peered":"2024-09-19T09:42:37.521393+0000","last_clean":"2024-09-19T09:42:37.521393+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:37.521393+0000","last_undegraded":"2024-09-19T09:42:37.521393+0000","last_fullsized":"2024-09-19T09:42:37.521393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:24.944545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521400+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:37.521400+0000","last_peered":"2024-09-19T09:42:37.521400+0000","last_clean":"2024-09-19T09:42:37.521400+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:37.521400+0000","last_undegraded":"2024-09-19T09:42:37.521400+0000","last_fullsized":"2024-09-19T09:42:37.521400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.057699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507486+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:37.507486+0000","last_peered":"2024-09-19T09:42:37.507486+0000","last_clean":"2024-09-19T09:42:37.507486+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:37.507486+0000","last_undegraded":"2024-09-19T09:42:37.507486+0000","last_fullsized":"2024-09-19T09:42:37.507486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520917+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:37.520917+0000","last_peered":"2024-09-19T09:42:37.520917+0000","last_clean":"2024-09-19T09:42:37.520917+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:37.520917+0000","last_undegraded":"2024-09-19T09:42:37.520917+0000","last_fullsized":"2024-09-19T09:42:37.520917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:51.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505395+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:37.505395+0000","last_peered":"2024-09-19T09:42:37.505395+0000","last_clean":"2024-09-19T09:42:37.505395+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:37.505395+0000","last_undegraded":"2024-09-19T09:42:37.505395+0000","last_fullsized":"2024-09-19T09:42:37.505395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507659+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:37.507659+0000","last_peered":"2024-09-19T09:42:37.507659+0000","last_clean":"2024-09-19T09:42:37.507659+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:37.507659+0000","last_undegraded":"2024-09-19T09:42:37.507659+0000","last_fullsized":"2024-09-19T09:42:37.507659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523337+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:37.523337+0000","last_peered":"2024-09-19T09:42:37.523337+0000","last_clean":"2024-09-19T09:42:37.523337+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:37.523337+0000","last_undegraded":"2024-09-19T09:42:37.523337+0000","last_fullsized":"2024-09-19T09:42:37.523337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:20.911082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512065+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:37.512065+0000","last_peered":"2024-09-19T09:42:37.512065+0000","last_clean":"2024-09-19T09:42:37.512065+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:37.512065+0000","last_undegraded":"2024-09-19T09:42:37.512065+0000","last_fullsized":"2024-09-19T09:42:37.512065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521678+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:37.521678+0000","last_peered":"2024-09-19T09:42:37.521678+0000","last_clean":"2024-09-19T09:42:37.521678+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:37.521678+0000","last_undegraded":"2024-09-19T09:42:37.521678+0000","last_fullsized":"2024-09-19T09:42:37.521678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:14.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506024+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:37.506024+0000","last_peered":"2024-09-19T09:42:37.506024+0000","last_clean":"2024-09-19T09:42:37.506024+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:37.506024+0000","last_undegraded":"2024-09-19T09:42:37.506024+0000","last_fullsized":"2024-09-19T09:42:37.506024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527680+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:37.527680+0000","last_peered":"2024-09-19T09:42:37.527680+0000","last_clean":"2024-09-19T09:42:37.527680+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:37.527680+0000","last_undegraded":"2024-09-19T09:42:37.527680+0000","last_fullsized":"2024-09-19T09:42:37.527680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:17.246201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.511783+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:37.511783+0000","last_peered":"2024-09-19T09:42:37.511783+0000","last_clean":"2024-09-19T09:42:37.511783+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:37.511783+0000","last_undegraded":"2024-09-19T09:42:37.511783+0000","last_fullsized":"2024-09-19T09:42:37.511783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525925+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:37.525925+0000","last_peered":"2024-09-19T09:42:37.525925+0000","last_clean":"2024-09-19T09:42:37.525925+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:37.525925+0000","last_undegraded":"2024-09-19T09:42:37.525925+0000","last_fullsized":"2024-09-19T09:42:37.525925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:59.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504525+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:37.504525+0000","last_peered":"2024-09-19T09:42:37.504525+0000","last_clean":"2024-09-19T09:42:37.504525+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:37.504525+0000","last_undegraded":"2024-09-19T09:42:37.504525+0000","last_fullsized":"2024-09-19T09:42:37.504525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526780+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:37.526780+0000","last_peered":"2024-09-19T09:42:37.526780+0000","last_clean":"2024-09-19T09:42:37.526780+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:37.526780+0000","last_undegraded":"2024-09-19T09:42:37.526780+0000","last_fullsized":"2024-09-19T09:42:37.526780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:27.841112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505747+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:37.505747+0000","last_peered":"2024-09-19T09:42:37.505747+0000","last_clean":"2024-09-19T09:42:37.505747+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:37.505747+0000","last_undegraded":"2024-09-19T09:42:37.505747+0000","last_fullsized":"2024-09-19T09:42:37.505747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529045+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:37.529045+0000","last_peered":"2024-09-19T09:42:37.529045+0000","last_clean":"2024-09-19T09:42:37.529045+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:37.529045+0000","last_undegraded":"2024-09-19T09:42:37.529045+0000","last_fullsized":"2024-09-19T09:42:37.529045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.641481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506728+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:37.506728+0000","last_peered":"2024-09-19T09:42:37.506728+0000","last_clean":"2024-09-19T09:42:37.506728+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:37.506728+0000","last_undegraded":"2024-09-19T09:42:37.506728+0000","last_fullsized":"2024-09-19T09:42:37.506728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528358+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:37.528358+0000","last_peered":"2024-09-19T09:42:37.528358+0000","last_clean":"2024-09-19T09:42:37.528358+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:37.528358+0000","last_undegraded":"2024-09-19T09:42:37.528358+0000","last_fullsized":"2024-09-19T09:42:37.528358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:37.218733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512692+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:37.512692+0000","last_peered":"2024-09-19T09:42:37.512692+0000","last_clean":"2024-09-19T09:42:37.512692+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:37.512692+0000","last_undegraded":"2024-09-19T09:42:37.512692+0000","last_fullsized":"2024-09-19T09:42:37.512692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529678+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:37.529678+0000","last_peered":"2024-09-19T09:42:37.529678+0000","last_clean":"2024-09-19T09:42:37.529678+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:37.529678+0000","last_undegraded":"2024-09-19T09:42:37.529678+0000","last_fullsized":"2024-09-19T09:42:37.529678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.537917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505904+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:37.505904+0000","last_peered":"2024-09-19T09:42:37.505904+0000","last_clean":"2024-09-19T09:42:37.505904+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:37.505904+0000","last_undegraded":"2024-09-19T09:42:37.505904+0000","last_fullsized":"2024-09-19T09:42:37.505904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:37.521415+0000","last_peered":"2024-09-19T09:42:37.521415+0000","last_clean":"2024-09-19T09:42:37.521415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:37.521415+0000","last_undegraded":"2024-09-19T09:42:37.521415+0000","last_fullsized":"2024-09-19T09:42:37.521415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:43.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924646+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:42:38.924646+0000","last_peered":"2024-09-19T09:42:38.924646+0000","last_clean":"2024-09-19T09:42:38.924646+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:42:38.924646+0000","last_undegraded":"2024-09-19T09:42:38.924646+0000","last_fullsized":"2024-09-19T09:42:38.924646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528927+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:37.528927+0000","last_peered":"2024-09-19T09:42:37.528927+0000","last_clean":"2024-09-19T09:42:37.528927+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:37.528927+0000","last_undegraded":"2024-09-19T09:42:37.528927+0000","last_fullsized":"2024-09-19T09:42:37.528927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:58.084932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.505607+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:37.505607+0000","last_peered":"2024-09-19T09:42:37.505607+0000","last_clean":"2024-09-19T09:42:37.505607+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:37.505607+0000","last_undegraded":"2024-09-19T09:42:37.505607+0000","last_fullsized":"2024-09-19T09:42:37.505607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529704+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:37.529704+0000","last_peered":"2024-09-19T09:42:37.529704+0000","last_clean":"2024-09-19T09:42:37.529704+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:37.529704+0000","last_undegraded":"2024-09-19T09:42:37.529704+0000","last_fullsized":"2024-09-19T09:42:37.529704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:51.417176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924927+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:42:38.924927+0000","last_peered":"2024-09-19T09:42:38.924927+0000","last_clean":"2024-09-19T09:42:38.924927+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:42:38.924927+0000","last_undegraded":"2024-09-19T09:42:38.924927+0000","last_fullsized":"2024-09-19T09:42:38.924927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529677+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:37.529677+0000","last_peered":"2024-09-19T09:42:37.529677+0000","last_clean":"2024-09-19T09:42:37.529677+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:37.529677+0000","last_undegraded":"2024-09-19T09:42:37.529677+0000","last_fullsized":"2024-09-19T09:42:37.529677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:30.350852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504671+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:37.504671+0000","last_peered":"2024-09-19T09:42:37.504671+0000","last_clean":"2024-09-19T09:42:37.504671+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:37.504671+0000","last_undegraded":"2024-09-19T09:42:37.504671+0000","last_fullsized":"2024-09-19T09:42:37.504671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.526017+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:37.526017+0000","last_peered":"2024-09-19T09:42:37.526017+0000","last_clean":"2024-09-19T09:42:37.526017+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:37.526017+0000","last_undegraded":"2024-09-19T09:42:37.526017+0000","last_fullsized":"2024-09-19T09:42:37.526017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:12.483808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924791+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:42:38.924791+0000","last_peered":"2024-09-19T09:42:38.924791+0000","last_clean":"2024-09-19T09:42:38.924791+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:42:38.924791+0000","last_undegraded":"2024-09-19T09:42:38.924791+0000","last_fullsized":"2024-09-19T09:42:38.924791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.529579+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:37.529579+0000","last_peered":"2024-09-19T09:42:37.529579+0000","last_clean":"2024-09-19T09:42:37.529579+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:37.529579+0000","last_undegraded":"2024-09-19T09:42:37.529579+0000","last_fullsized":"2024-09-19T09:42:37.529579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:22.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517484+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:37.517484+0000","last_peered":"2024-09-19T09:42:37.517484+0000","last_clean":"2024-09-19T09:42:37.517484+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:37.517484+0000","last_undegraded":"2024-09-19T09:42:37.517484+0000","last_fullsized":"2024-09-19T09:42:37.517484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.510554+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:37.510554+0000","last_peered":"2024-09-19T09:42:37.510554+0000","last_clean":"2024-09-19T09:42:37.510554+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:37.510554+0000","last_undegraded":"2024-09-19T09:42:37.510554+0000","last_fullsized":"2024-09-19T09:42:37.510554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525865+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:37.525865+0000","last_peered":"2024-09-19T09:42:37.525865+0000","last_clean":"2024-09-19T09:42:37.525865+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:37.525865+0000","last_undegraded":"2024-09-19T09:42:37.525865+0000","last_fullsized":"2024-09-19T09:42:37.525865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:02.766622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517823+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:37.517823+0000","last_peered":"2024-09-19T09:42:37.517823+0000","last_clean":"2024-09-19T09:42:37.517823+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:37.517823+0000","last_undegraded":"2024-09-19T09:42:37.517823+0000","last_fullsized":"2024-09-19T09:42:37.517823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520670+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:37.520670+0000","last_peered":"2024-09-19T09:42:37.520670+0000","last_clean":"2024-09-19T09:42:37.520670+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:37.520670+0000","last_undegraded":"2024-09-19T09:42:37.520670+0000","last_fullsized":"2024-09-19T09:42:37.520670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924736+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:42:38.924736+0000","last_peered":"2024-09-19T09:42:38.924736+0000","last_clean":"2024-09-19T09:42:38.924736+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:42:38.924736+0000","last_undegraded":"2024-09-19T09:42:38.924736+0000","last_fullsized":"2024-09-19T09:42:38.924736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.515746+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:37.515746+0000","last_peered":"2024-09-19T09:42:37.515746+0000","last_clean":"2024-09-19T09:42:37.515746+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:37.515746+0000","last_undegraded":"2024-09-19T09:42:37.515746+0000","last_fullsized":"2024-09-19T09:42:37.515746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:45.987518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512835+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:37.512835+0000","last_peered":"2024-09-19T09:42:37.512835+0000","last_clean":"2024-09-19T09:42:37.512835+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:37.512835+0000","last_undegraded":"2024-09-19T09:42:37.512835+0000","last_fullsized":"2024-09-19T09:42:37.512835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.522538+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:37.522538+0000","last_peered":"2024-09-19T09:42:37.522538+0000","last_clean":"2024-09-19T09:42:37.522538+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:37.522538+0000","last_undegraded":"2024-09-19T09:42:37.522538+0000","last_fullsized":"2024-09-19T09:42:37.522538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:36.990463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504431+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:37.504431+0000","last_peered":"2024-09-19T09:42:37.504431+0000","last_clean":"2024-09-19T09:42:37.504431+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:37.504431+0000","last_undegraded":"2024-09-19T09:42:37.504431+0000","last_fullsized":"2024-09-19T09:42:37.504431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.527661+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:37.527661+0000","last_peered":"2024-09-19T09:42:37.527661+0000","last_clean":"2024-09-19T09:42:37.527661+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:37.527661+0000","last_undegraded":"2024-09-19T09:42:37.527661+0000","last_fullsized":"2024-09-19T09:42:37.527661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:46.760134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519991+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:37.519991+0000","last_peered":"2024-09-19T09:42:37.519991+0000","last_clean":"2024-09-19T09:42:37.519991+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:37.519991+0000","last_undegraded":"2024-09-19T09:42:37.519991+0000","last_fullsized":"2024-09-19T09:42:37.519991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.516012+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:37.516012+0000","last_peered":"2024-09-19T09:42:37.516012+0000","last_clean":"2024-09-19T09:42:37.516012+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:37.516012+0000","last_undegraded":"2024-09-19T09:42:37.516012+0000","last_fullsized":"2024-09-19T09:42:37.516012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:49.909733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504564+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:37.504564+0000","last_peered":"2024-09-19T09:42:37.504564+0000","last_clean":"2024-09-19T09:42:37.504564+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:37.504564+0000","last_undegraded":"2024-09-19T09:42:37.504564+0000","last_fullsized":"2024-09-19T09:42:37.504564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.528430+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:37.528430+0000","last_peered":"2024-09-19T09:42:37.528430+0000","last_clean":"2024-09-19T09:42:37.528430+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:37.528430+0000","last_undegraded":"2024-09-19T09:42:37.528430+0000","last_fullsized":"2024-09-19T09:42:37.528430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:18.086219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506210+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:37.506210+0000","last_peered":"2024-09-19T09:42:37.506210+0000","last_clean":"2024-09-19T09:42:37.506210+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:37.506210+0000","last_undegraded":"2024-09-19T09:42:37.506210+0000","last_fullsized":"2024-09-19T09:42:37.506210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.520831+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:37.520831+0000","last_peered":"2024-09-19T09:42:37.520831+0000","last_clean":"2024-09-19T09:42:37.520831+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:37.520831+0000","last_undegraded":"2024-09-19T09:42:37.520831+0000","last_fullsized":"2024-09-19T09:42:37.520831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:11.793665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.517432+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:37.517432+0000","last_peered":"2024-09-19T09:42:37.517432+0000","last_clean":"2024-09-19T09:42:37.517432+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:37.517432+0000","last_undegraded":"2024-09-19T09:42:37.517432+0000","last_fullsized":"2024-09-19T09:42:37.517432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.512844+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:37.512844+0000","last_peered":"2024-09-19T09:42:37.512844+0000","last_clean":"2024-09-19T09:42:37.512844+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:37.512844+0000","last_undegraded":"2024-09-19T09:42:37.512844+0000","last_fullsized":"2024-09-19T09:42:37.512844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:25.197598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504951+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:37.504951+0000","last_peered":"2024-09-19T09:42:37.504951+0000","last_clean":"2024-09-19T09:42:37.504951+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:37.504951+0000","last_undegraded":"2024-09-19T09:42:37.504951+0000","last_fullsized":"2024-09-19T09:42:37.504951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523317+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:37.523317+0000","last_peered":"2024-09-19T09:42:37.523317+0000","last_clean":"2024-09-19T09:42:37.523317+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:37.523317+0000","last_undegraded":"2024-09-19T09:42:37.523317+0000","last_fullsized":"2024-09-19T09:42:37.523317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:32.907310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.504328+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:37.504328+0000","last_peered":"2024-09-19T09:42:37.504328+0000","last_clean":"2024-09-19T09:42:37.504328+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:37.504328+0000","last_undegraded":"2024-09-19T09:42:37.504328+0000","last_fullsized":"2024-09-19T09:42:37.504328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.523363+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:37.523363+0000","last_peered":"2024-09-19T09:42:37.523363+0000","last_clean":"2024-09-19T09:42:37.523363+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:37.523363+0000","last_undegraded":"2024-09-19T09:42:37.523363+0000","last_fullsized":"2024-09-19T09:42:37.523363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:18.634777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518619+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:37.518619+0000","last_peered":"2024-09-19T09:42:37.518619+0000","last_clean":"2024-09-19T09:42:37.518619+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:37.518619+0000","last_undegraded":"2024-09-19T09:42:37.518619+0000","last_fullsized":"2024-09-19T09:42:37.518619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521363+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:37.521363+0000","last_peered":"2024-09-19T09:42:37.521363+0000","last_clean":"2024-09-19T09:42:37.521363+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:37.521363+0000","last_undegraded":"2024-09-19T09:42:37.521363+0000","last_fullsized":"2024-09-19T09:42:37.521363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:14.796097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524033+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:37.524033+0000","last_peered":"2024-09-19T09:42:37.524033+0000","last_clean":"2024-09-19T09:42:37.524033+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:37.524033+0000","last_undegraded":"2024-09-19T09:42:37.524033+0000","last_fullsized":"2024-09-19T09:42:37.524033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.518495+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:37.518495+0000","last_peered":"2024-09-19T09:42:37.518495+0000","last_clean":"2024-09-19T09:42:37.518495+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:37.518495+0000","last_undegraded":"2024-09-19T09:42:37.518495+0000","last_fullsized":"2024-09-19T09:42:37.518495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.524588+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:37.524588+0000","last_peered":"2024-09-19T09:42:37.524588+0000","last_clean":"2024-09-19T09:42:37.524588+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:37.524588+0000","last_undegraded":"2024-09-19T09:42:37.524588+0000","last_fullsized":"2024-09-19T09:42:37.524588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:38.753135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.519528+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:37.519528+0000","last_peered":"2024-09-19T09:42:37.519528+0000","last_clean":"2024-09-19T09:42:37.519528+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:37.519528+0000","last_undegraded":"2024-09-19T09:42:37.519528+0000","last_fullsized":"2024-09-19T09:42:37.519528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.525904+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:37.525904+0000","last_peered":"2024-09-19T09:42:37.525904+0000","last_clean":"2024-09-19T09:42:37.525904+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:37.525904+0000","last_undegraded":"2024-09-19T09:42:37.525904+0000","last_fullsized":"2024-09-19T09:42:37.525904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:23.577488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.507762+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:37.507762+0000","last_peered":"2024-09-19T09:42:37.507762+0000","last_clean":"2024-09-19T09:42:37.507762+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:37.507762+0000","last_undegraded":"2024-09-19T09:42:37.507762+0000","last_fullsized":"2024-09-19T09:42:37.507762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.521745+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:37.521745+0000","last_peered":"2024-09-19T09:42:37.521745+0000","last_clean":"2024-09-19T09:42:37.521745+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:37.521745+0000","last_undegraded":"2024-09-19T09:42:37.521745+0000","last_fullsized":"2024-09-19T09:42:37.521745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:13.952632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T09:42:37.506615+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:37.506615+0000","last_peered":"2024-09-19T09:42:37.506615+0000","last_clean":"2024-09-19T09:42:37.506615+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:37.506615+0000","last_undegraded":"2024-09-19T09:42:37.506615+0000","last_fullsized":"2024-09-19T09:42:37.506615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:45.812 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:45.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.920+0000 7f0ca7e5e640 1 Processor -- start 2024-09-19T09:42:45.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 -- start start 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0ca0151fc0 0x7f0ca00c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ca01523a0 0x7f0ca01588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 0x7f0ca00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0ca0158e20 con 0x7f0ca01523a0 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f0ca0157e20 con 0x7f0ca0151fc0 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.921+0000 7f0ca7e5e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca0072100 con 0x7f0ca0072770 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ca01523a0 0x7f0ca01588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ca01523a0 0x7f0ca01588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59906/0 (socket says 172.21.15.123:59906) 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 -- 172.21.15.123:0/255494254 learned_addr learned my addr 172.21.15.123:0/255494254 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 -- 172.21.15.123:0/255494254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 msgr2=0x7f0ca00710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 --2- 172.21.15.123:0/255494254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 0x7f0ca00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 -- 172.21.15.123:0/255494254 >> v2:172.21.15.194:3300/0 conn(0x7f0ca0151fc0 msgr2=0x7f0ca00c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:45.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 --2- 172.21.15.123:0/255494254 >> v2:172.21.15.194:3300/0 conn(0x7f0ca0151fc0 0x7f0ca00c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.922+0000 7f0ca53f9640 1 -- 172.21.15.123:0/255494254 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca00723e0 con 0x7f0ca01523a0 2024-09-19T09:42:45.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca53f9640 1 --2- 172.21.15.123:0/255494254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca01523a0 0x7f0ca01588e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ca006fbd0 tx=0x7f0c9402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e471684613b55d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:45.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca4bf8640 1 -- 172.21.15.123:0/255494254 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94037070 con 0x7f0ca01523a0 2024-09-19T09:42:45.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca4bf8640 1 -- 172.21.15.123:0/255494254 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94032440 con 0x7f0ca01523a0 2024-09-19T09:42:45.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca4bf8640 1 -- 172.21.15.123:0/255494254 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94032810 con 0x7f0ca01523a0 2024-09-19T09:42:45.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/255494254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca01523a0 msgr2=0x7f0ca01588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/255494254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca01523a0 0x7f0ca01588e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ca006fbd0 tx=0x7f0c9402a140 comp rx=0 tx=0).stop 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/255494254 shutdown_connections 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/255494254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 0x7f0ca00710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/255494254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca01523a0 0x7f0ca01588e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/255494254 >> v2:172.21.15.194:3300/0 conn(0x7f0ca0151fc0 0x7f0ca00c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/255494254 >> 172.21.15.123:0/255494254 conn(0x7f0ca006ec90 msgr2=0x7f0ca006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/255494254 shutdown_connections 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.923+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/255494254 wait complete. 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.924+0000 7f0ca7e5e640 1 Processor -- start 2024-09-19T09:42:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 -- start start 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 0x7f0ca01540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 0x7f0ca006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca0157460 0x7f0ca01eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca015b3d0 con 0x7f0ca0151fc0 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca01583c0 con 0x7f0ca0157460 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca7e5e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca015b550 con 0x7f0ca0072770 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca53f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 0x7f0ca006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca53f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 0x7f0ca006c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59916/0 (socket says 172.21.15.123:59916) 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.925+0000 7f0ca53f9640 1 -- 172.21.15.123:0/670448173 learned_addr learned my addr 172.21.15.123:0/670448173 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca53f9640 1 -- 172.21.15.123:0/670448173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 msgr2=0x7f0ca01540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca53f9640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 0x7f0ca01540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca53f9640 1 -- 172.21.15.123:0/670448173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca0157460 msgr2=0x7f0ca01eebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca53f9640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca0157460 0x7f0ca01eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca53f9640 1 -- 172.21.15.123:0/670448173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca006c8e0 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca53f9640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 0x7f0ca006c3a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c940090b0 tx=0x7f0c940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94041070 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9403c890 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca0154a00 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94037040 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.926+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca0154f80 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.927+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca00c3800 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.927+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c94044070 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.928+0000 7f0c9e7fc640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c8c06c2e0 0x7f0c8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.928+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0c940ac110 con 0x7f0ca0151fc0 2024-09-19T09:42:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.928+0000 7f0ca5bfa640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c8c06c2e0 0x7f0c8c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:45.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.928+0000 7f0ca5bfa640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c8c06c2e0 0x7f0c8c06e7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000ab90 tx=0x7f0c90009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:45.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:45.932+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0c9407a910 con 0x7f0ca0151fc0 2024-09-19T09:42:46.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.095+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ca01e3440 con 0x7f0c8c06c2e0 2024-09-19T09:42:46.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.100+0000 7f0c9e7fc640 1 -- 172.21.15.123:0/670448173 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f0ca01e3440 con 0x7f0c8c06c2e0 2024-09-19T09:42:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c8c06c2e0 msgr2=0x7f0c8c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c8c06c2e0 0x7f0c8c06e7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000ab90 tx=0x7f0c90009250 comp rx=0 tx=0).stop 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 msgr2=0x7f0ca006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 0x7f0ca006c3a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c940090b0 tx=0x7f0c940046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 shutdown_connections 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca0157460 0x7f0ca01eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ca0151fc0 0x7f0ca006c3a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c8c06c2e0 0x7f0c8c06e7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 --2- 172.21.15.123:0/670448173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ca0072770 0x7f0ca01540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.103+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 >> 172.21.15.123:0/670448173 conn(0x7f0ca006ec90 msgr2=0x7f0ca00c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.104+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 shutdown_connections 2024-09-19T09:42:46.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.104+0000 7f0ca7e5e640 1 -- 172.21.15.123:0/670448173 wait complete. 2024-09-19T09:42:46.116 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-19T09:42:44.697913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219224,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755496,"statfs":{"total":773094113280,"available":772869627904,"internally_reserved":0,"allocated":3055616,"data_stored":1830616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208065+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:39.208065+0000","last_peered":"2024-09-19T09:42:39.208065+0000","last_clean":"2024-09-19T09:42:39.208065+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:39.208065+0000","last_undegraded":"2024-09-19T09:42:39.208065+0000","last_fullsized":"2024-09-19T09:42:39.208065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425721+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:39.425721+0000","last_peered":"2024-09-19T09:42:39.425721+0000","last_clean":"2024-09-19T09:42:39.425721+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:39.425721+0000","last_undegraded":"2024-09-19T09:42:39.425721+0000","last_fullsized":"2024-09-19T09:42:39.425721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807877+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:38.807877+0000","last_peered":"2024-09-19T09:42:38.807877+0000","last_clean":"2024-09-19T09:42:38.807877+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:38.807877+0000","last_undegraded":"2024-09-19T09:42:38.807877+0000","last_fullsized":"2024-09-19T09:42:38.807877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426221+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:39.426221+0000","last_peered":"2024-09-19T09:42:39.426221+0000","last_clean":"2024-09-19T09:42:39.426221+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:39.426221+0000","last_undegraded":"2024-09-19T09:42:39.426221+0000","last_fullsized":"2024-09-19T09:42:39.426221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207678+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:39.207678+0000","last_peered":"2024-09-19T09:42:39.207678+0000","last_clean":"2024-09-19T09:42:39.207678+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:39.207678+0000","last_undegraded":"2024-09-19T09:42:39.207678+0000","last_fullsized":"2024-09-19T09:42:39.207678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426075+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:39.426075+0000","last_peered":"2024-09-19T09:42:39.426075+0000","last_clean":"2024-09-19T09:42:39.426075+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:39.426075+0000","last_undegraded":"2024-09-19T09:42:39.426075+0000","last_fullsized":"2024-09-19T09:42:39.426075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207524+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:39.207524+0000","last_peered":"2024-09-19T09:42:39.207524+0000","last_clean":"2024-09-19T09:42:39.207524+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:39.207524+0000","last_undegraded":"2024-09-19T09:42:39.207524+0000","last_fullsized":"2024-09-19T09:42:39.207524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510378+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:38.510378+0000","last_peered":"2024-09-19T09:42:38.510378+0000","last_clean":"2024-09-19T09:42:38.510378+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:38.510378+0000","last_undegraded":"2024-09-19T09:42:38.510378+0000","last_fullsized":"2024-09-19T09:42:38.510378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208096+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:39.208096+0000","last_peered":"2024-09-19T09:42:39.208096+0000","last_clean":"2024-09-19T09:42:39.208096+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:39.208096+0000","last_undegraded":"2024-09-19T09:42:39.208096+0000","last_fullsized":"2024-09-19T09:42:39.208096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512763+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:38.512763+0000","last_peered":"2024-09-19T09:42:38.512763+0000","last_clean":"2024-09-19T09:42:38.512763+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:38.512763+0000","last_undegraded":"2024-09-19T09:42:38.512763+0000","last_fullsized":"2024-09-19T09:42:38.512763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511885+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:38.511885+0000","last_peered":"2024-09-19T09:42:38.511885+0000","last_clean":"2024-09-19T09:42:38.511885+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:38.511885+0000","last_undegraded":"2024-09-19T09:42:38.511885+0000","last_fullsized":"2024-09-19T09:42:38.511885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512418+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:38.512418+0000","last_peered":"2024-09-19T09:42:38.512418+0000","last_clean":"2024-09-19T09:42:38.512418+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:38.512418+0000","last_undegraded":"2024-09-19T09:42:38.512418+0000","last_fullsized":"2024-09-19T09:42:38.512418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510684+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:38.510684+0000","last_peered":"2024-09-19T09:42:38.510684+0000","last_clean":"2024-09-19T09:42:38.510684+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:38.510684+0000","last_undegraded":"2024-09-19T09:42:38.510684+0000","last_fullsized":"2024-09-19T09:42:38.510684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807777+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:38.807777+0000","last_peered":"2024-09-19T09:42:38.807777+0000","last_clean":"2024-09-19T09:42:38.807777+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:38.807777+0000","last_undegraded":"2024-09-19T09:42:38.807777+0000","last_fullsized":"2024-09-19T09:42:38.807777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:39.425650+0000","last_peered":"2024-09-19T09:42:39.425650+0000","last_clean":"2024-09-19T09:42:39.425650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:39.425650+0000","last_undegraded":"2024-09-19T09:42:39.425650+0000","last_fullsized":"2024-09-19T09:42:39.425650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425926+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:39.425926+0000","last_peered":"2024-09-19T09:42:39.425926+0000","last_clean":"2024-09-19T09:42:39.425926+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:39.425926+0000","last_undegraded":"2024-09-19T09:42:39.425926+0000","last_fullsized":"2024-09-19T09:42:39.425926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426684+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:39.426684+0000","last_peered":"2024-09-19T09:42:39.426684+0000","last_clean":"2024-09-19T09:42:39.426684+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:39.426684+0000","last_undegraded":"2024-09-19T09:42:39.426684+0000","last_fullsized":"2024-09-19T09:42:39.426684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924975+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:42:38.924975+0000","last_peered":"2024-09-19T09:42:38.924975+0000","last_clean":"2024-09-19T09:42:38.924975+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:42:38.924975+0000","last_undegraded":"2024-09-19T09:42:38.924975+0000","last_fullsized":"2024-09-19T09:42:38.924975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207933+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:39.207933+0000","last_peered":"2024-09-19T09:42:39.207933+0000","last_clean":"2024-09-19T09:42:39.207933+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:39.207933+0000","last_undegraded":"2024-09-19T09:42:39.207933+0000","last_fullsized":"2024-09-19T09:42:39.207933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512111+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:38.512111+0000","last_peered":"2024-09-19T09:42:38.512111+0000","last_clean":"2024-09-19T09:42:38.512111+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:38.512111+0000","last_undegraded":"2024-09-19T09:42:38.512111+0000","last_fullsized":"2024-09-19T09:42:38.512111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807900+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:38.807900+0000","last_peered":"2024-09-19T09:42:38.807900+0000","last_clean":"2024-09-19T09:42:38.807900+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:38.807900+0000","last_undegraded":"2024-09-19T09:42:38.807900+0000","last_fullsized":"2024-09-19T09:42:38.807900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426152+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:39.426152+0000","last_peered":"2024-09-19T09:42:39.426152+0000","last_clean":"2024-09-19T09:42:39.426152+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:39.426152+0000","last_undegraded":"2024-09-19T09:42:39.426152+0000","last_fullsized":"2024-09-19T09:42:39.426152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510406+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:38.510406+0000","last_peered":"2024-09-19T09:42:38.510406+0000","last_clean":"2024-09-19T09:42:38.510406+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:38.510406+0000","last_undegraded":"2024-09-19T09:42:38.510406+0000","last_fullsized":"2024-09-19T09:42:38.510406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426004+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:39.426004+0000","last_peered":"2024-09-19T09:42:39.426004+0000","last_clean":"2024-09-19T09:42:39.426004+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:39.426004+0000","last_undegraded":"2024-09-19T09:42:39.426004+0000","last_fullsized":"2024-09-19T09:42:39.426004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510568+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:38.510568+0000","last_peered":"2024-09-19T09:42:38.510568+0000","last_clean":"2024-09-19T09:42:38.510568+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:38.510568+0000","last_undegraded":"2024-09-19T09:42:38.510568+0000","last_fullsized":"2024-09-19T09:42:38.510568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512831+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:38.512831+0000","last_peered":"2024-09-19T09:42:38.512831+0000","last_clean":"2024-09-19T09:42:38.512831+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:38.512831+0000","last_undegraded":"2024-09-19T09:42:38.512831+0000","last_fullsized":"2024-09-19T09:42:38.512831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425723+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:39.425723+0000","last_peered":"2024-09-19T09:42:39.425723+0000","last_clean":"2024-09-19T09:42:39.425723+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:39.425723+0000","last_undegraded":"2024-09-19T09:42:39.425723+0000","last_fullsized":"2024-09-19T09:42:39.425723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510768+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:38.510768+0000","last_peered":"2024-09-19T09:42:38.510768+0000","last_clean":"2024-09-19T09:42:38.510768+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:38.510768+0000","last_undegraded":"2024-09-19T09:42:38.510768+0000","last_fullsized":"2024-09-19T09:42:38.510768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808033+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:38.808033+0000","last_peered":"2024-09-19T09:42:38.808033+0000","last_clean":"2024-09-19T09:42:38.808033+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:38.808033+0000","last_undegraded":"2024-09-19T09:42:38.808033+0000","last_fullsized":"2024-09-19T09:42:38.808033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426322+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:39.426322+0000","last_peered":"2024-09-19T09:42:39.426322+0000","last_clean":"2024-09-19T09:42:39.426322+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:39.426322+0000","last_undegraded":"2024-09-19T09:42:39.426322+0000","last_fullsized":"2024-09-19T09:42:39.426322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924787+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:42:38.924787+0000","last_peered":"2024-09-19T09:42:38.924787+0000","last_clean":"2024-09-19T09:42:38.924787+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:42:38.924787+0000","last_undegraded":"2024-09-19T09:42:38.924787+0000","last_fullsized":"2024-09-19T09:42:38.924787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512278+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:38.512278+0000","last_peered":"2024-09-19T09:42:38.512278+0000","last_clean":"2024-09-19T09:42:38.512278+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:38.512278+0000","last_undegraded":"2024-09-19T09:42:38.512278+0000","last_fullsized":"2024-09-19T09:42:38.512278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511859+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:38.511859+0000","last_peered":"2024-09-19T09:42:38.511859+0000","last_clean":"2024-09-19T09:42:38.511859+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:38.511859+0000","last_undegraded":"2024-09-19T09:42:38.511859+0000","last_fullsized":"2024-09-19T09:42:38.511859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510910+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:38.510910+0000","last_peered":"2024-09-19T09:42:38.510910+0000","last_clean":"2024-09-19T09:42:38.510910+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:38.510910+0000","last_undegraded":"2024-09-19T09:42:38.510910+0000","last_fullsized":"2024-09-19T09:42:38.510910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808051+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:38.808051+0000","last_peered":"2024-09-19T09:42:38.808051+0000","last_clean":"2024-09-19T09:42:38.808051+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:38.808051+0000","last_undegraded":"2024-09-19T09:42:38.808051+0000","last_fullsized":"2024-09-19T09:42:38.808051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512112+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:38.512112+0000","last_peered":"2024-09-19T09:42:38.512112+0000","last_clean":"2024-09-19T09:42:38.512112+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:38.512112+0000","last_undegraded":"2024-09-19T09:42:38.512112+0000","last_fullsized":"2024-09-19T09:42:38.512112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510468+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:38.510468+0000","last_peered":"2024-09-19T09:42:38.510468+0000","last_clean":"2024-09-19T09:42:38.510468+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:38.510468+0000","last_undegraded":"2024-09-19T09:42:38.510468+0000","last_fullsized":"2024-09-19T09:42:38.510468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510423+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:38.510423+0000","last_peered":"2024-09-19T09:42:38.510423+0000","last_clean":"2024-09-19T09:42:38.510423+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:38.510423+0000","last_undegraded":"2024-09-19T09:42:38.510423+0000","last_fullsized":"2024-09-19T09:42:38.510423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426077+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:39.426077+0000","last_peered":"2024-09-19T09:42:39.426077+0000","last_clean":"2024-09-19T09:42:39.426077+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:39.426077+0000","last_undegraded":"2024-09-19T09:42:39.426077+0000","last_fullsized":"2024-09-19T09:42:39.426077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425475+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:39.425475+0000","last_peered":"2024-09-19T09:42:39.425475+0000","last_clean":"2024-09-19T09:42:39.425475+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:39.425475+0000","last_undegraded":"2024-09-19T09:42:39.425475+0000","last_fullsized":"2024-09-19T09:42:39.425475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512425+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:38.512425+0000","last_peered":"2024-09-19T09:42:38.512425+0000","last_clean":"2024-09-19T09:42:38.512425+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:38.512425+0000","last_undegraded":"2024-09-19T09:42:38.512425+0000","last_fullsized":"2024-09-19T09:42:38.512425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426461+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:39.426461+0000","last_peered":"2024-09-19T09:42:39.426461+0000","last_clean":"2024-09-19T09:42:39.426461+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:39.426461+0000","last_undegraded":"2024-09-19T09:42:39.426461+0000","last_fullsized":"2024-09-19T09:42:39.426461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426390+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:39.426390+0000","last_peered":"2024-09-19T09:42:39.426390+0000","last_clean":"2024-09-19T09:42:39.426390+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:39.426390+0000","last_undegraded":"2024-09-19T09:42:39.426390+0000","last_fullsized":"2024-09-19T09:42:39.426390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808057+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:38.808057+0000","last_peered":"2024-09-19T09:42:38.808057+0000","last_clean":"2024-09-19T09:42:38.808057+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:38.808057+0000","last_undegraded":"2024-09-19T09:42:38.808057+0000","last_fullsized":"2024-09-19T09:42:38.808057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515580+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:42.515580+0000","last_peered":"2024-09-19T09:42:42.515580+0000","last_clean":"2024-09-19T09:42:42.515580+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:42.515580+0000","last_undegraded":"2024-09-19T09:42:42.515580+0000","last_fullsized":"2024-09-19T09:42:42.515580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512565+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:38.512565+0000","last_peered":"2024-09-19T09:42:38.512565+0000","last_clean":"2024-09-19T09:42:38.512565+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:38.512565+0000","last_undegraded":"2024-09-19T09:42:38.512565+0000","last_fullsized":"2024-09-19T09:42:38.512565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.517809+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:42.517809+0000","last_peered":"2024-09-19T09:42:42.517809+0000","last_clean":"2024-09-19T09:42:42.517809+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:42.517809+0000","last_undegraded":"2024-09-19T09:42:42.517809+0000","last_fullsized":"2024-09-19T09:42:42.517809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207581+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:39.207581+0000","last_peered":"2024-09-19T09:42:39.207581+0000","last_clean":"2024-09-19T09:42:39.207581+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:39.207581+0000","last_undegraded":"2024-09-19T09:42:39.207581+0000","last_fullsized":"2024-09-19T09:42:39.207581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515658+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:42.515658+0000","last_peered":"2024-09-19T09:42:42.515658+0000","last_clean":"2024-09-19T09:42:42.515658+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:42.515658+0000","last_undegraded":"2024-09-19T09:42:42.515658+0000","last_fullsized":"2024-09-19T09:42:42.515658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807779+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:38.807779+0000","last_peered":"2024-09-19T09:42:38.807779+0000","last_clean":"2024-09-19T09:42:38.807779+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:38.807779+0000","last_undegraded":"2024-09-19T09:42:38.807779+0000","last_fullsized":"2024-09-19T09:42:38.807779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426290+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:39.426290+0000","last_peered":"2024-09-19T09:42:39.426290+0000","last_clean":"2024-09-19T09:42:39.426290+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:39.426290+0000","last_undegraded":"2024-09-19T09:42:39.426290+0000","last_fullsized":"2024-09-19T09:42:39.426290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207825+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:39.207825+0000","last_peered":"2024-09-19T09:42:39.207825+0000","last_clean":"2024-09-19T09:42:39.207825+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:39.207825+0000","last_undegraded":"2024-09-19T09:42:39.207825+0000","last_fullsized":"2024-09-19T09:42:39.207825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511816+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:38.511816+0000","last_peered":"2024-09-19T09:42:38.511816+0000","last_clean":"2024-09-19T09:42:38.511816+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:38.511816+0000","last_undegraded":"2024-09-19T09:42:38.511816+0000","last_fullsized":"2024-09-19T09:42:38.511816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:38.512415+0000","last_peered":"2024-09-19T09:42:38.512415+0000","last_clean":"2024-09-19T09:42:38.512415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:38.512415+0000","last_undegraded":"2024-09-19T09:42:38.512415+0000","last_fullsized":"2024-09-19T09:42:38.512415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924646+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:42:38.924646+0000","last_peered":"2024-09-19T09:42:38.924646+0000","last_clean":"2024-09-19T09:42:38.924646+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:42:38.924646+0000","last_undegraded":"2024-09-19T09:42:38.924646+0000","last_fullsized":"2024-09-19T09:42:38.924646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207561+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:39.207561+0000","last_peered":"2024-09-19T09:42:39.207561+0000","last_clean":"2024-09-19T09:42:39.207561+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:39.207561+0000","last_undegraded":"2024-09-19T09:42:39.207561+0000","last_fullsized":"2024-09-19T09:42:39.207561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512648+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:38.512648+0000","last_peered":"2024-09-19T09:42:38.512648+0000","last_clean":"2024-09-19T09:42:38.512648+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:38.512648+0000","last_undegraded":"2024-09-19T09:42:38.512648+0000","last_fullsized":"2024-09-19T09:42:38.512648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207957+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:39.207957+0000","last_peered":"2024-09-19T09:42:39.207957+0000","last_clean":"2024-09-19T09:42:39.207957+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:39.207957+0000","last_undegraded":"2024-09-19T09:42:39.207957+0000","last_fullsized":"2024-09-19T09:42:39.207957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:07.533470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924927+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:42:38.924927+0000","last_peered":"2024-09-19T09:42:38.924927+0000","last_clean":"2024-09-19T09:42:38.924927+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:42:38.924927+0000","last_undegraded":"2024-09-19T09:42:38.924927+0000","last_fullsized":"2024-09-19T09:42:38.924927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208167+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:39.208167+0000","last_peered":"2024-09-19T09:42:39.208167+0000","last_clean":"2024-09-19T09:42:39.208167+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:39.208167+0000","last_undegraded":"2024-09-19T09:42:39.208167+0000","last_fullsized":"2024-09-19T09:42:39.208167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425782+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:39.425782+0000","last_peered":"2024-09-19T09:42:39.425782+0000","last_clean":"2024-09-19T09:42:39.425782+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:39.425782+0000","last_undegraded":"2024-09-19T09:42:39.425782+0000","last_fullsized":"2024-09-19T09:42:39.425782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426436+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:39.426436+0000","last_peered":"2024-09-19T09:42:39.426436+0000","last_clean":"2024-09-19T09:42:39.426436+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:39.426436+0000","last_undegraded":"2024-09-19T09:42:39.426436+0000","last_fullsized":"2024-09-19T09:42:39.426436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:19.189449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924791+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:42:38.924791+0000","last_peered":"2024-09-19T09:42:38.924791+0000","last_clean":"2024-09-19T09:42:38.924791+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:42:38.924791+0000","last_undegraded":"2024-09-19T09:42:38.924791+0000","last_fullsized":"2024-09-19T09:42:38.924791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207922+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:39.207922+0000","last_peered":"2024-09-19T09:42:39.207922+0000","last_clean":"2024-09-19T09:42:39.207922+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:39.207922+0000","last_undegraded":"2024-09-19T09:42:39.207922+0000","last_fullsized":"2024-09-19T09:42:39.207922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207308+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:39.207308+0000","last_peered":"2024-09-19T09:42:39.207308+0000","last_clean":"2024-09-19T09:42:39.207308+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:39.207308+0000","last_undegraded":"2024-09-19T09:42:39.207308+0000","last_fullsized":"2024-09-19T09:42:39.207308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425996+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:39.425996+0000","last_peered":"2024-09-19T09:42:39.425996+0000","last_clean":"2024-09-19T09:42:39.425996+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:39.425996+0000","last_undegraded":"2024-09-19T09:42:39.425996+0000","last_fullsized":"2024-09-19T09:42:39.425996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510573+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:38.510573+0000","last_peered":"2024-09-19T09:42:38.510573+0000","last_clean":"2024-09-19T09:42:38.510573+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:38.510573+0000","last_undegraded":"2024-09-19T09:42:38.510573+0000","last_fullsized":"2024-09-19T09:42:38.510573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207558+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:39.207558+0000","last_peered":"2024-09-19T09:42:39.207558+0000","last_clean":"2024-09-19T09:42:39.207558+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:39.207558+0000","last_undegraded":"2024-09-19T09:42:39.207558+0000","last_fullsized":"2024-09-19T09:42:39.207558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807721+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:38.807721+0000","last_peered":"2024-09-19T09:42:38.807721+0000","last_clean":"2024-09-19T09:42:38.807721+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:38.807721+0000","last_undegraded":"2024-09-19T09:42:38.807721+0000","last_fullsized":"2024-09-19T09:42:38.807721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924736+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:42:38.924736+0000","last_peered":"2024-09-19T09:42:38.924736+0000","last_clean":"2024-09-19T09:42:38.924736+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:42:38.924736+0000","last_undegraded":"2024-09-19T09:42:38.924736+0000","last_fullsized":"2024-09-19T09:42:38.924736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425500+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:39.425500+0000","last_peered":"2024-09-19T09:42:39.425500+0000","last_clean":"2024-09-19T09:42:39.425500+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:39.425500+0000","last_undegraded":"2024-09-19T09:42:39.425500+0000","last_fullsized":"2024-09-19T09:42:39.425500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426521+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:39.426521+0000","last_peered":"2024-09-19T09:42:39.426521+0000","last_clean":"2024-09-19T09:42:39.426521+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:39.426521+0000","last_undegraded":"2024-09-19T09:42:39.426521+0000","last_fullsized":"2024-09-19T09:42:39.426521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511988+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:38.511988+0000","last_peered":"2024-09-19T09:42:38.511988+0000","last_clean":"2024-09-19T09:42:38.511988+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:38.511988+0000","last_undegraded":"2024-09-19T09:42:38.511988+0000","last_fullsized":"2024-09-19T09:42:38.511988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425551+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:39.425551+0000","last_peered":"2024-09-19T09:42:39.425551+0000","last_clean":"2024-09-19T09:42:39.425551+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:39.425551+0000","last_undegraded":"2024-09-19T09:42:39.425551+0000","last_fullsized":"2024-09-19T09:42:39.425551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426479+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:39.426479+0000","last_peered":"2024-09-19T09:42:39.426479+0000","last_clean":"2024-09-19T09:42:39.426479+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:39.426479+0000","last_undegraded":"2024-09-19T09:42:39.426479+0000","last_fullsized":"2024-09-19T09:42:39.426479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208038+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:39.208038+0000","last_peered":"2024-09-19T09:42:39.208038+0000","last_clean":"2024-09-19T09:42:39.208038+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:39.208038+0000","last_undegraded":"2024-09-19T09:42:39.208038+0000","last_fullsized":"2024-09-19T09:42:39.208038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425565+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:39.425565+0000","last_peered":"2024-09-19T09:42:39.425565+0000","last_clean":"2024-09-19T09:42:39.425565+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:39.425565+0000","last_undegraded":"2024-09-19T09:42:39.425565+0000","last_fullsized":"2024-09-19T09:42:39.425565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425678+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:39.425678+0000","last_peered":"2024-09-19T09:42:39.425678+0000","last_clean":"2024-09-19T09:42:39.425678+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:39.425678+0000","last_undegraded":"2024-09-19T09:42:39.425678+0000","last_fullsized":"2024-09-19T09:42:39.425678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510775+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:38.510775+0000","last_peered":"2024-09-19T09:42:38.510775+0000","last_clean":"2024-09-19T09:42:38.510775+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:38.510775+0000","last_undegraded":"2024-09-19T09:42:38.510775+0000","last_fullsized":"2024-09-19T09:42:38.510775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516466+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:42.516466+0000","last_peered":"2024-09-19T09:42:42.516466+0000","last_clean":"2024-09-19T09:42:42.516466+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:42.516466+0000","last_undegraded":"2024-09-19T09:42:42.516466+0000","last_fullsized":"2024-09-19T09:42:42.516466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807908+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:38.807908+0000","last_peered":"2024-09-19T09:42:38.807908+0000","last_clean":"2024-09-19T09:42:38.807908+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:38.807908+0000","last_undegraded":"2024-09-19T09:42:38.807908+0000","last_fullsized":"2024-09-19T09:42:38.807908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207343+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:39.207343+0000","last_peered":"2024-09-19T09:42:39.207343+0000","last_clean":"2024-09-19T09:42:39.207343+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:39.207343+0000","last_undegraded":"2024-09-19T09:42:39.207343+0000","last_fullsized":"2024-09-19T09:42:39.207343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512166+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:38.512166+0000","last_peered":"2024-09-19T09:42:38.512166+0000","last_clean":"2024-09-19T09:42:38.512166+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:38.512166+0000","last_undegraded":"2024-09-19T09:42:38.512166+0000","last_fullsized":"2024-09-19T09:42:38.512166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425593+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:39.425593+0000","last_peered":"2024-09-19T09:42:39.425593+0000","last_clean":"2024-09-19T09:42:39.425593+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:39.425593+0000","last_undegraded":"2024-09-19T09:42:39.425593+0000","last_fullsized":"2024-09-19T09:42:39.425593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510540+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:38.510540+0000","last_peered":"2024-09-19T09:42:38.510540+0000","last_clean":"2024-09-19T09:42:38.510540+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:38.510540+0000","last_undegraded":"2024-09-19T09:42:38.510540+0000","last_fullsized":"2024-09-19T09:42:38.510540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:45.394478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425602+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:39.425602+0000","last_peered":"2024-09-19T09:42:39.425602+0000","last_clean":"2024-09-19T09:42:39.425602+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:39.425602+0000","last_undegraded":"2024-09-19T09:42:39.425602+0000","last_fullsized":"2024-09-19T09:42:39.425602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510830+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:38.510830+0000","last_peered":"2024-09-19T09:42:38.510830+0000","last_clean":"2024-09-19T09:42:38.510830+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:38.510830+0000","last_undegraded":"2024-09-19T09:42:38.510830+0000","last_fullsized":"2024-09-19T09:42:38.510830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516582+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:42.516582+0000","last_peered":"2024-09-19T09:42:42.516582+0000","last_clean":"2024-09-19T09:42:42.516582+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:42.516582+0000","last_undegraded":"2024-09-19T09:42:42.516582+0000","last_fullsized":"2024-09-19T09:42:42.516582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511970+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:38.511970+0000","last_peered":"2024-09-19T09:42:38.511970+0000","last_clean":"2024-09-19T09:42:38.511970+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:38.511970+0000","last_undegraded":"2024-09-19T09:42:38.511970+0000","last_fullsized":"2024-09-19T09:42:38.511970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426400+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:39.426400+0000","last_peered":"2024-09-19T09:42:39.426400+0000","last_clean":"2024-09-19T09:42:39.426400+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:39.426400+0000","last_undegraded":"2024-09-19T09:42:39.426400+0000","last_fullsized":"2024-09-19T09:42:39.426400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:50.680705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515634+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:42.515634+0000","last_peered":"2024-09-19T09:42:42.515634+0000","last_clean":"2024-09-19T09:42:42.515634+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:42.515634+0000","last_undegraded":"2024-09-19T09:42:42.515634+0000","last_fullsized":"2024-09-19T09:42:42.515634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426280+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:39.426280+0000","last_peered":"2024-09-19T09:42:39.426280+0000","last_clean":"2024-09-19T09:42:39.426280+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:39.426280+0000","last_undegraded":"2024-09-19T09:42:39.426280+0000","last_fullsized":"2024-09-19T09:42:39.426280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516048+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:42.516048+0000","last_peered":"2024-09-19T09:42:42.516048+0000","last_clean":"2024-09-19T09:42:42.516048+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:42.516048+0000","last_undegraded":"2024-09-19T09:42:42.516048+0000","last_fullsized":"2024-09-19T09:42:42.516048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807921+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:38.807921+0000","last_peered":"2024-09-19T09:42:38.807921+0000","last_clean":"2024-09-19T09:42:38.807921+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:38.807921+0000","last_undegraded":"2024-09-19T09:42:38.807921+0000","last_fullsized":"2024-09-19T09:42:38.807921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510741+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:38.510741+0000","last_peered":"2024-09-19T09:42:38.510741+0000","last_clean":"2024-09-19T09:42:38.510741+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:38.510741+0000","last_undegraded":"2024-09-19T09:42:38.510741+0000","last_fullsized":"2024-09-19T09:42:38.510741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510810+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:38.510810+0000","last_peered":"2024-09-19T09:42:38.510810+0000","last_clean":"2024-09-19T09:42:38.510810+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:38.510810+0000","last_undegraded":"2024-09-19T09:42:38.510810+0000","last_fullsized":"2024-09-19T09:42:38.510810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516995+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:42.516995+0000","last_peered":"2024-09-19T09:42:42.516995+0000","last_clean":"2024-09-19T09:42:42.516995+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:42.516995+0000","last_undegraded":"2024-09-19T09:42:42.516995+0000","last_fullsized":"2024-09-19T09:42:42.516995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":671603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":671603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:46.119 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:42:46.120 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:42:46.120 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:42:46.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T09:42:46.120 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T09:42:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.254+0000 7f254348d640 1 Processor -- start 2024-09-19T09:42:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.254+0000 7f254348d640 1 -- start start 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.254+0000 7f254348d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f253c1588e0 0x7f253c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f254348d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0c9ce0 con 0x7f253c0cb670 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f254348d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0c9f80 con 0x7f253c15f110 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f254348d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f253c15b2a0 con 0x7f253c1588e0 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2541a2a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f253c0cb670 0x7f253c165a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58690/0 (socket says 172.21.15.123:58690) 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2541a2a640 1 -- 172.21.15.123:0/3735601415 learned_addr learned my addr 172.21.15.123:0/3735601415 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2541229640 1 --2- 172.21.15.123:0/3735601415 >> v2:172.21.15.194:3300/0 conn(0x7f253c1588e0 0x7f253c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838517310 0 0) 0x7f253c0c9ce0 con 0x7f253c0cb670 2024-09-19T09:42:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2528003520 con 0x7f253c0cb670 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2111583262 0 0) 0x7f2528003520 con 0x7f253c0cb670 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 >> v2:172.21.15.194:3300/0 conn(0x7f253c1588e0 msgr2=0x7f253c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 --2- 172.21.15.123:0/3735601415 >> v2:172.21.15.194:3300/0 conn(0x7f253c1588e0 0x7f253c0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 >> v1:172.21.15.194:6789/0 conn(0x7f253c15f110 legacy=0x7f253c0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c15b580 con 0x7f253c0cb670 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f25340019f0 con 0x7f253c0cb670 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2541229640 1 --2- 172.21.15.123:0/3735601415 >> v2:172.21.15.194:3300/0 conn(0x7f253c1588e0 0x7f253c0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 >> v1:172.21.15.123:6789/0 conn(0x7f253c0cb670 legacy=0x7f253c165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280039b0 0x7f2528003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2528004800 0x7f2528004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25280051c0 0x7f252800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f253c15b2a0 con 0x7f25280039b0 2024-09-19T09:42:46.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f252800c070 con 0x7f25280051c0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f252800c270 con 0x7f2528004800 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2541229640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280039b0 0x7f2528003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2541a2a640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25280051c0 0x7f252800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.255+0000 7f2540a28640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2528004800 0x7f2528004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541229640 1 -- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2528004800 msgr2=0x7f2528004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541229640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2528004800 0x7f2528004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541229640 1 -- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25280051c0 msgr2=0x7f252800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541229640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25280051c0 0x7f252800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541229640 1 -- 172.21.15.123:0/3735601415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2528003520 con 0x7f25280039b0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541a2a640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25280051c0 0x7f252800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2540a28640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2528004800 0x7f2528004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541a2a640 1 -- 172.21.15.123:0/3735601415 reap_dead start 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f2541229640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280039b0 0x7f2528003dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2530009c90 tx=0x7f2528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37bf11fce39d88c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530036070 con 0x7f25280039b0 2024-09-19T09:42:46.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2530031400 con 0x7f25280039b0 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.256+0000 7f252ffff640 1 -- 172.21.15.123:0/3735601415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530009860 con 0x7f25280039b0 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 -- 172.21.15.123:0/3735601415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280039b0 msgr2=0x7f2528003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280039b0 0x7f2528003dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2530009c90 tx=0x7f2528005830 comp rx=0 tx=0).stop 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 -- 172.21.15.123:0/3735601415 shutdown_connections 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 --2- 172.21.15.123:0/3735601415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280039b0 0x7f2528003dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 -- 172.21.15.123:0/3735601415 >> 172.21.15.123:0/3735601415 conn(0x7f253c073950 msgr2=0x7f253c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 -- 172.21.15.123:0/3735601415 shutdown_connections 2024-09-19T09:42:46.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.257+0000 7f254348d640 1 -- 172.21.15.123:0/3735601415 wait complete. 2024-09-19T09:42:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.258+0000 7f254348d640 1 Processor -- start 2024-09-19T09:42:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.258+0000 7f254348d640 1 -- start start 2024-09-19T09:42:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25280039b0 0x7f253c1f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f253c06e7d0 0x7f253c1f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 0x7f253c14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f253c15f540 con 0x7f253c06f450 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f253c15c060 con 0x7f253c06e7d0 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f253c0c5cb0 con 0x7f25280039b0 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 0x7f253c14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 0x7f253c14e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59934/0 (socket says 172.21.15.123:59934) 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 -- 172.21.15.123:0/4189808711 learned_addr learned my addr 172.21.15.123:0/4189808711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541229640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25280039b0 0x7f253c1f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2540a28640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f253c06e7d0 0x7f253c1f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 -- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25280039b0 msgr2=0x7f253c1f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25280039b0 0x7f253c1f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 -- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f253c06e7d0 msgr2=0x7f253c1f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f253c06e7d0 0x7f253c1f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 -- 172.21.15.123:0/4189808711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c15c5b0 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f2541a2a640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 0x7f253c14e3a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2534002230 tx=0x7f253400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253400ec10 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253400edb0 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.259+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c15c880 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.260+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25340146a0 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.260+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c1f0ed0 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.261+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c158cc0 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.261+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f253401b060 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.261+0000 7f252dffb640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f252006c2b0 0x7f252006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.262+0000 7f2541229640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f252006c2b0 0x7f252006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.262+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f253408ab70 con 0x7f253c06f450 2024-09-19T09:42:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.262+0000 7f2541229640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f252006c2b0 0x7f252006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2530033000 tx=0x7f2530008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.266+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f25340592e0 con 0x7f253c06f450 2024-09-19T09:42:46.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.475+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f253c15eef0 con 0x7f253c06f450 2024-09-19T09:42:46.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.478+0000 7f252dffb640 1 -- 172.21.15.123:0/4189808711 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173511 (secure 0 0 0) 0x7f2534058be0 con 0x7f253c06f450 2024-09-19T09:42:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:46.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f252006c2b0 msgr2=0x7f252006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f252006c2b0 0x7f252006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2530033000 tx=0x7f2530008030 comp rx=0 tx=0).stop 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 msgr2=0x7f253c14e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 0x7f253c14e3a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2534002230 tx=0x7f253400e530 comp rx=0 tx=0).stop 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 shutdown_connections 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f253c06f450 0x7f253c14e3a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f253c06e7d0 0x7f253c1f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f252006c2b0 0x7f252006e770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 --2- 172.21.15.123:0/4189808711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25280039b0 0x7f253c1f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 >> 172.21.15.123:0/4189808711 conn(0x7f253c073950 msgr2=0x7f253c0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 shutdown_connections 2024-09-19T09:42:46.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.481+0000 7f254348d640 1 -- 172.21.15.123:0/4189808711 wait complete. 2024-09-19T09:42:46.493 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2665176031},{"type":"v1","addr":"172.21.15.123:6825","nonce":2665176031}]},"active_addr":"172.21.15.123:6825/2665176031","active_change":"2024-09-19T09:42:18.689358+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":584219021}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2544637173}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1792855644}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2390650709}]}]} 2024-09-19T09:42:46.497 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T09:42:46.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T09:42:46.497 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:46.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.593+0000 7f4da2077640 1 Processor -- start 2024-09-19T09:42:46.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4da2077640 1 -- start start 2024-09-19T09:42:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4da2077640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 0x7f4d9c0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4da2077640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d9c0c7f40 0x7f4d9c0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4da2077640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c15c240 con 0x7f4d9c0c8400 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4da2077640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9c155a30 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4da2077640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c15b3e0 con 0x7f4d9c155650 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.594+0000 7f4d9affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d9c0c7f40 0x7f4d9c0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d9c0c7f40 0x7f4d9c0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59948/0 (socket says 172.21.15.123:59948) 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 -- 172.21.15.123:0/1479266184 learned_addr learned my addr 172.21.15.123:0/1479266184 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 -- 172.21.15.123:0/1479266184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 msgr2=0x7f4d9c0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 --2- 172.21.15.123:0/1479266184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 0x7f4d9c0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 -- 172.21.15.123:0/1479266184 >> v1:172.21.15.194:6789/0 conn(0x7f4d9c0c8400 legacy=0x7f4d9c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 -- 172.21.15.123:0/1479266184 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c15b6c0 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.595+0000 7f4d9affd640 1 --2- 172.21.15.123:0/1479266184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0ccd90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009870 tx=0x7f4d8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563540b0ab80a531 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4d9a7fc640 1 -- 172.21.15.123:0/1479266184 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84037070 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4d9a7fc640 1 -- 172.21.15.123:0/1479266184 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84032440 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4d9a7fc640 1 -- 172.21.15.123:0/1479266184 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84032810 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 -- 172.21.15.123:0/1479266184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 msgr2=0x7f4d9c0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 --2- 172.21.15.123:0/1479266184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0ccd90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009870 tx=0x7f4d8402a210 comp rx=0 tx=0).stop 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 -- 172.21.15.123:0/1479266184 shutdown_connections 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 --2- 172.21.15.123:0/1479266184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0ccd90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 --2- 172.21.15.123:0/1479266184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 0x7f4d9c0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 -- 172.21.15.123:0/1479266184 >> 172.21.15.123:0/1479266184 conn(0x7f4d9c0cd5c0 msgr2=0x7f4d9c0cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 -- 172.21.15.123:0/1479266184 shutdown_connections 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.596+0000 7f4da2077640 1 -- 172.21.15.123:0/1479266184 wait complete. 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.597+0000 7f4da2077640 1 Processor -- start 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.597+0000 7f4da2077640 1 -- start start 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4da2077640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4da2077640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d9c0c8400 0x7f4d9c0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4da2077640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 0x7f4d9c0c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4da2077640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c15bf60 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4da2077640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c15bc80 con 0x7f4d9c0c8400 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4da2077640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c0ce430 con 0x7f4d9c155650 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59964/0 (socket says 172.21.15.123:59964) 2024-09-19T09:42:46.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 -- 172.21.15.123:0/562380368 learned_addr learned my addr 172.21.15.123:0/562380368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 -- 172.21.15.123:0/562380368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 msgr2=0x7f4d9c0c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 0x7f4d9c0c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 -- 172.21.15.123:0/562380368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d9c0c8400 msgr2=0x7f4d9c0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d9c0c8400 0x7f4d9c0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.598+0000 7f4d9b7fe640 1 -- 172.21.15.123:0/562380368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c158400 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.599+0000 7f4d9b7fe640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0cca80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00b410 tx=0x7f4d8c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.599+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c015020 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.599+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c011850 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.599+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c011c40 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.599+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c0c6cd0 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.599+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c1586a0 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.600+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c158a80 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.600+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4d8c018020 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.601+0000 7f4d93fff640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d7c06c2b0 0x7f4d7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.601+0000 7f4d9affd640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d7c06c2b0 0x7f4d7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.601+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4d8c08b3e0 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.601+0000 7f4d9affd640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d7c06c2b0 0x7f4d7c06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d84034000 tx=0x7f4d8402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.605+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4d9c158a80 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.775+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d9c0d0460 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.776+0000 7f4d93fff640 1 -- 172.21.15.123:0/562380368 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7f4d8c01f020 con 0x7f4d9c0c7f40 2024-09-19T09:42:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:46.778 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:38.507234+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:46.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d7c06c2b0 msgr2=0x7f4d7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d7c06c2b0 0x7f4d7c06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d84034000 tx=0x7f4d8402c000 comp rx=0 tx=0).stop 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 msgr2=0x7f4d9c0cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0cca80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00b410 tx=0x7f4d8c00b8d0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 shutdown_connections 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d7c06c2b0 0x7f4d7c06e770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d9c155650 0x7f4d9c0c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d9c0c8400 0x7f4d9c0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 --2- 172.21.15.123:0/562380368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d9c0c7f40 0x7f4d9c0cca80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.778+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 >> 172.21.15.123:0/562380368 conn(0x7f4d9c0cd5c0 msgr2=0x7f4d9c072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.779+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 shutdown_connections 2024-09-19T09:42:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.779+0000 7f4da2077640 1 -- 172.21.15.123:0/562380368 wait complete. 2024-09-19T09:42:46.792 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T09:42:46.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:46.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.888+0000 7fe51b9bd640 1 Processor -- start 2024-09-19T09:42:46.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.888+0000 7fe51b9bd640 1 -- start start 2024-09-19T09:42:46.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.888+0000 7fe51b9bd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5141531a0 0x7fe5140b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe51b9bd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5140cb050 0x7fe5140cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe51b9bd640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5140c3f40 con 0x7fe5140c9540 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe51b9bd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe5140c4220 con 0x7fe5140cb050 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe51b9bd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe5140c4500 con 0x7fe5141531a0 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5140cb050 0x7fe5140cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5140cb050 0x7fe5140cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59968/0 (socket says 172.21.15.123:59968) 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 -- 172.21.15.123:0/2475157648 learned_addr learned my addr 172.21.15.123:0/2475157648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe519759640 1 --2- 172.21.15.123:0/2475157648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5141531a0 0x7fe5140b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 -- 172.21.15.123:0/2475157648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5141531a0 msgr2=0x7fe5140b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 --2- 172.21.15.123:0/2475157648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5141531a0 0x7fe5140b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 -- 172.21.15.123:0/2475157648 >> v1:172.21.15.194:6789/0 conn(0x7fe5140c9540 legacy=0x7fe5140ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.889+0000 7fe518f58640 1 -- 172.21.15.123:0/2475157648 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5140c47e0 con 0x7fe5140cb050 2024-09-19T09:42:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe518f58640 1 --2- 172.21.15.123:0/2475157648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe5140cb5d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe508009870 tx=0x7fe50802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e73fba5475e917 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe507fff640 1 -- 172.21.15.123:0/2475157648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508037070 con 0x7fe5140cb050 2024-09-19T09:42:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe507fff640 1 -- 172.21.15.123:0/2475157648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe508032440 con 0x7fe5140cb050 2024-09-19T09:42:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe507fff640 1 -- 172.21.15.123:0/2475157648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508032810 con 0x7fe5140cb050 2024-09-19T09:42:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 -- 172.21.15.123:0/2475157648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 msgr2=0x7fe5140cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/2475157648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe5140cb5d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe508009870 tx=0x7fe50802a210 comp rx=0 tx=0).stop 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 -- 172.21.15.123:0/2475157648 shutdown_connections 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/2475157648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe5140cb5d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/2475157648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5141531a0 0x7fe5140b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 -- 172.21.15.123:0/2475157648 >> 172.21.15.123:0/2475157648 conn(0x7fe514070e90 msgr2=0x7fe5140712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 -- 172.21.15.123:0/2475157648 shutdown_connections 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.890+0000 7fe51b9bd640 1 -- 172.21.15.123:0/2475157648 wait complete. 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.891+0000 7fe51b9bd640 1 Processor -- start 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 -- start start 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5140c9540 0x7fe5141422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe51415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5141531a0 0x7fe514140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5140c9b10 con 0x7fe5140cb050 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe514153580 con 0x7fe5141531a0 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe51b9bd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe5140caad0 con 0x7fe5140c9540 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe518f58640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe51415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe518f58640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe51415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59970/0 (socket says 172.21.15.123:59970) 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe518f58640 1 -- 172.21.15.123:0/1121128477 learned_addr learned my addr 172.21.15.123:0/1121128477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe519759640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5140c9540 0x7fe5141422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.892+0000 7fe519f5a640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5141531a0 0x7fe514140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe518f58640 1 -- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5140c9540 msgr2=0x7fe5141422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe518f58640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5140c9540 0x7fe5141422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe518f58640 1 -- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5141531a0 msgr2=0x7fe514140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe518f58640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5141531a0 0x7fe514140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe518f58640 1 -- 172.21.15.123:0/1121128477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51415bd80 con 0x7fe5140cb050 2024-09-19T09:42:46.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe518f58640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe51415c680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe508009870 tx=0x7fe5080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508041020 con 0x7fe5140cb050 2024-09-19T09:42:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5080306c0 con 0x7fe5140cb050 2024-09-19T09:42:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51415c040 con 0x7fe5140cb050 2024-09-19T09:42:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508037040 con 0x7fe5140cb050 2024-09-19T09:42:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.893+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe51413fee0 con 0x7fe5140cb050 2024-09-19T09:42:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.894+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5140b4be0 con 0x7fe5140cb050 2024-09-19T09:42:46.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.895+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe508044020 con 0x7fe5140cb050 2024-09-19T09:42:46.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.895+0000 7fe505ffb640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe4f806c2b0 0x7fe4f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.895+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe5080abaf0 con 0x7fe5140cb050 2024-09-19T09:42:46.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.895+0000 7fe519759640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe4f806c2b0 0x7fe4f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.896+0000 7fe519759640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe4f806c2b0 0x7fe4f806e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5100079a0 tx=0x7fe510008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:46.899+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe50804b030 con 0x7fe5140cb050 2024-09-19T09:42:47.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.067+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5141e4dd0 con 0x7fe5140cb050 2024-09-19T09:42:47.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.068+0000 7fe505ffb640 1 -- 172.21.15.123:0/1121128477 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fe50807a2f0 con 0x7fe5140cb050 2024-09-19T09:42:47.070 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:47.070 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:38.507234+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe4f806c2b0 msgr2=0x7fe4f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe4f806c2b0 0x7fe4f806e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5100079a0 tx=0x7fe510008040 comp rx=0 tx=0).stop 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 msgr2=0x7fe51415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe51415c680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe508009870 tx=0x7fe5080046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 shutdown_connections 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5141531a0 0x7fe514140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5140cb050 0x7fe51415c680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe4f806c2b0 0x7fe4f806e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 --2- 172.21.15.123:0/1121128477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5140c9540 0x7fe5141422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 >> 172.21.15.123:0/1121128477 conn(0x7fe514070e90 msgr2=0x7fe514152050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 shutdown_connections 2024-09-19T09:42:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.070+0000 7fe51b9bd640 1 -- 172.21.15.123:0/1121128477 wait complete. 2024-09-19T09:42:47.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T09:42:47.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T09:42:47.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T09:42:47.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T09:42:47.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T09:42:47.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T09:42:47.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T09:42:47.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T09:42:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.250+0000 7f8274ad7640 1 Processor -- start 2024-09-19T09:42:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.250+0000 7f8274ad7640 1 -- start start 2024-09-19T09:42:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.251+0000 7fc253601640 1 Processor -- start 2024-09-19T09:42:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.251+0000 7fc253601640 1 -- start start 2024-09-19T09:42:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f8274ad7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270073170 0x7f8270073550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f8274ad7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8270159bb0 0x7f827015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f8274ad7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827006e770 con 0x7f82700c59a0 2024-09-19T09:42:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f8274ad7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f82700c9eb0 con 0x7f8270159bb0 2024-09-19T09:42:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f8274ad7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f827015c9f0 con 0x7f8270073170 2024-09-19T09:42:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.251+0000 7f6f44a4d640 1 Processor -- start 2024-09-19T09:42:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7ffa71bd6640 1 Processor -- start 2024-09-19T09:42:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f4c7fb98640 1 Processor -- start 2024-09-19T09:42:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.251+0000 7f6f44a4d640 1 -- start start 2024-09-19T09:42:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7fcc6b4a4640 1 Processor -- start 2024-09-19T09:42:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f6f44a4d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f380dcdc0 0x7f6f3800d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f6f44a4d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f3800c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f6f44a4d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f38049040 con 0x7f6f3804d310 2024-09-19T09:42:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f6f44a4d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6f3804e530 con 0x7f6f380dcdc0 2024-09-19T09:42:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f6f44a4d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3804e760 con 0x7f6f3800bd90 2024-09-19T09:42:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc253601640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc24c06ce90 0x7fc24c158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc253601640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc24c0c4780 0x7fc24c0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc253601640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c0c9630 con 0x7fc24c06d270 2024-09-19T09:42:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc253601640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c0c8210 con 0x7fc24c06ce90 2024-09-19T09:42:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc253601640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c070b60 con 0x7fc24c0c4780 2024-09-19T09:42:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fcadffff640 1 Processor -- start 2024-09-19T09:42:47.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fcc6b4a4640 1 -- start start 2024-09-19T09:42:47.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f3800c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f380dcdc0 0x7f6f3800d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f3800c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49144/0 (socket says 172.21.15.123:49144) 2024-09-19T09:42:47.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3ffff640 1 -- 172.21.15.123:0/187205865 learned_addr learned my addr 172.21.15.123:0/187205865 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc251b9e640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc24c06d270 0x7fc24c151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54876/0 (socket says 172.21.15.123:54876) 2024-09-19T09:42:47.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc251b9e640 1 -- 172.21.15.123:0/1067120973 learned_addr learned my addr 172.21.15.123:0/1067120973 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fcadffff640 1 -- start start 2024-09-19T09:42:47.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7ffa71bd6640 1 -- start start 2024-09-19T09:42:47.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f826dd9b640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f82700c59a0 0x7f82700c97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54868/0 (socket says 172.21.15.123:54868) 2024-09-19T09:42:47.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f826dd9b640 1 -- 172.21.15.123:0/2288648256 learned_addr learned my addr 172.21.15.123:0/2288648256 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f826ed9d640 1 --2- 172.21.15.123:0/2288648256 >> v2:172.21.15.194:3300/0 conn(0x7f8270159bb0 0x7f827015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc25139d640 1 --2- 172.21.15.123:0/1067120973 >> v2:172.21.15.123:3300/0 conn(0x7fc24c06ce90 0x7fc24c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f826e59c640 1 --2- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270073170 0x7f8270073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7fc250b9c640 1 --2- 172.21.15.123:0/1067120973 >> v2:172.21.15.194:3300/0 conn(0x7fc24c0c4780 0x7fc24c0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/187205865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 msgr2=0x7f6f3800c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3f7fe640 1 --2- 172.21.15.123:0/187205865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f3800c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/187205865 >> v1:172.21.15.123:6789/0 conn(0x7f6f3804d310 legacy=0x7f6f380e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/187205865 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3804ea00 con 0x7f6f380dcdc0 2024-09-19T09:42:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.252+0000 7f4c7fb98640 1 -- start start 2024-09-19T09:42:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f4c7fb98640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c7004a670 0x7f4c7004aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f4c7fb98640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700e6a60 con 0x7f4c700dcd80 2024-09-19T09:42:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f4c7fb98640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700e6d20 con 0x7f4c700e5f20 2024-09-19T09:42:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7f4c7fb98640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f4c70044d30 con 0x7f4c7004a670 2024-09-19T09:42:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7ffa71bd6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa6c1524a0 0x7ffa6c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7ffa71bd6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffa6c0c8b40 0x7ffa6c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7e135640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4c700e5f20 0x7f4c700e6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54896/0 (socket says 172.21.15.123:54896) 2024-09-19T09:42:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7e135640 1 -- 172.21.15.123:0/4290373080 learned_addr learned my addr 172.21.15.123:0/4290373080 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fc25139d640 1 -- 172.21.15.123:0/1067120973 >> v2:172.21.15.194:3300/0 conn(0x7fc24c0c4780 msgr2=0x7fc24c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fc25139d640 1 --2- 172.21.15.123:0/1067120973 >> v2:172.21.15.194:3300/0 conn(0x7fc24c0c4780 0x7fc24c0c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fc25139d640 1 -- 172.21.15.123:0/1067120973 >> v1:172.21.15.194:6789/0 conn(0x7fc24c06d270 legacy=0x7fc24c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fc25139d640 1 -- 172.21.15.123:0/1067120973 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c0c98d0 con 0x7fc24c06ce90 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f826ed9d640 1 -- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270073170 msgr2=0x7f8270073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f826ed9d640 1 --2- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270073170 0x7f8270073550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f826ed9d640 1 -- 172.21.15.123:0/2288648256 >> v1:172.21.15.194:6789/0 conn(0x7f82700c59a0 legacy=0x7f82700c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f826ed9d640 1 -- 172.21.15.123:0/2288648256 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827006ea30 con 0x7f8270159bb0 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7d133640 1 --2- 172.21.15.123:0/4290373080 >> v2:172.21.15.194:3300/0 conn(0x7f4c7004a670 0x7f4c7004aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc6b4a4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc5c0d8860 0x7fcc5c049940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc6b4a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c049e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc6b4a4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5c050840 con 0x7fcc5c0502c0 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc6b4a4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcc5c0e1c50 con 0x7fcc5c0d8860 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc6b4a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0e1f30 con 0x7fcc5c0dee30 2024-09-19T09:42:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc68a3f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcc5c0502c0 0x7fcc5c0de720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58720/0 (socket says 172.21.15.123:58720) 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc68a3f640 1 -- 172.21.15.123:0/968770348 learned_addr learned my addr 172.21.15.123:0/968770348 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcc69a41640 1 --2- 172.21.15.123:0/968770348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c049e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7ffa71bd6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c0c9080 con 0x7ffa6c0c86f0 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7ffa71bd6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6c159090 con 0x7ffa6c1524a0 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.253+0000 7ffa71bd6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6c073df0 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffa6c0c8b40 0x7ffa6c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffa6c0c8b40 0x7ffa6c072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55886/0 (socket says 172.21.15.123:55886) 2024-09-19T09:42:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 -- 172.21.15.123:0/2399583218 learned_addr learned my addr 172.21.15.123:0/2399583218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcadffff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcae0159400 0x7fcae01633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcadffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae00c7f40 0x7fcae00c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcadffff640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae00c8e70 con 0x7fcae01597e0 2024-09-19T09:42:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcadffff640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fcae00c7ab0 con 0x7fcae0159400 2024-09-19T09:42:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/2399583218 >> v2:172.21.15.123:3300/0 conn(0x7ffa6c1524a0 0x7ffa6c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 -- 172.21.15.123:0/2399583218 >> v2:172.21.15.123:3300/0 conn(0x7ffa6c1524a0 msgr2=0x7ffa6c158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7fcadffff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcae006cc70 con 0x7fcae00c7f40 2024-09-19T09:42:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/2399583218 >> v2:172.21.15.123:3300/0 conn(0x7ffa6c1524a0 0x7ffa6c158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 -- 172.21.15.123:0/2399583218 >> v1:172.21.15.194:6789/0 conn(0x7ffa6c0c86f0 legacy=0x7ffa6c0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696835999 0 0) 0x7f4c700e6d20 con 0x7f4c700e5f20 2024-09-19T09:42:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c64003520 con 0x7f4c700e5f20 2024-09-19T09:42:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33074978 0 0) 0x7f4c700e6a60 con 0x7f4c700dcd80 2024-09-19T09:42:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c700e6d20 con 0x7f4c700dcd80 2024-09-19T09:42:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7f9fdcf9f640 1 Processor -- start 2024-09-19T09:42:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcc69a41640 1 -- 172.21.15.123:0/968770348 >> v2:172.21.15.123:3300/0 conn(0x7fcc5c0d8860 msgr2=0x7fcc5c049940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcade7fc640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fcae01597e0 0x7fcae01606e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54904/0 (socket says 172.21.15.123:54904) 2024-09-19T09:42:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcadeffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcae0159400 0x7fcae01633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcade7fc640 1 -- 172.21.15.123:0/1885225370 learned_addr learned my addr 172.21.15.123:0/1885225370 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcadf7fe640 1 --2- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae00c7f40 0x7fcae00c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcc69a41640 1 --2- 172.21.15.123:0/968770348 >> v2:172.21.15.123:3300/0 conn(0x7fcc5c0d8860 0x7fcc5c049940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f4c7d133640 1 -- 172.21.15.123:0/4290373080 >> v1:172.21.15.194:6789/0 conn(0x7f4c700e5f20 legacy=0x7f4c700e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f4c7d133640 1 -- 172.21.15.123:0/4290373080 >> v1:172.21.15.123:6789/0 conn(0x7f4c700dcd80 legacy=0x7f4c70045d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f4c7d133640 1 -- 172.21.15.123:0/4290373080 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70044f80 con 0x7f4c7004a670 2024-09-19T09:42:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcc69a41640 1 -- 172.21.15.123:0/968770348 >> v1:172.21.15.123:6789/0 conn(0x7fcc5c0502c0 legacy=0x7fcc5c0de720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f826ed9d640 1 --2- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270159bb0 0x7f827015c4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8268009d90 tx=0x7f826802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=645c6b0e4d80cb3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcc69a41640 1 -- 172.21.15.123:0/968770348 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c0e2210 con 0x7fcc5c0dee30 2024-09-19T09:42:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f826d59a640 1 -- 172.21.15.123:0/2288648256 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268007740 con 0x7f8270159bb0 2024-09-19T09:42:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcadeffd640 1 -- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae00c7f40 msgr2=0x7fcae00c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcadeffd640 1 --2- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae00c7f40 0x7fcae00c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcadeffd640 1 -- 172.21.15.123:0/1885225370 >> v1:172.21.15.194:6789/0 conn(0x7fcae01597e0 legacy=0x7fcae01606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7fcadeffd640 1 -- 172.21.15.123:0/1885225370 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae00c7180 con 0x7fcae0159400 2024-09-19T09:42:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f9fdcf9f640 1 -- start start 2024-09-19T09:42:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.255+0000 7f826d59a640 1 -- 172.21.15.123:0/2288648256 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82680078e0 con 0x7f8270159bb0 2024-09-19T09:42:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.254+0000 7ffa6bfff640 1 -- 172.21.15.123:0/2399583218 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c0c95f0 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f6f3f7fe640 1 --2- 172.21.15.123:0/187205865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f380dcdc0 0x7f6f3800d230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097a0 tx=0x7f6f3402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d74f5265d43fdaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/2399583218 >> v2:172.21.15.123:3300/0 conn(0x7ffa6c1524a0 0x7ffa6c158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/2399583218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c072620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0722a0 tx=0x7ffa6002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6f6b66da2b8524 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7fcc69a41640 1 --2- 172.21.15.123:0/968770348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c049e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097a0 tx=0x7fcc5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e2d53766ad60a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fdcf9f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 0x7f9fd80ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f4c7d133640 1 --2- 172.21.15.123:0/4290373080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7004a670 0x7f4c7004aaa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009720 tx=0x7f4c7402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5506cf3310005b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f826d59a640 1 -- 172.21.15.123:0/2288648256 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268007cb0 con 0x7f8270159bb0 2024-09-19T09:42:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7fcadeffd640 1 --2- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae0159400 0x7fcae01633b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcad00097a0 tx=0x7fcad002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3402691644799ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7ffa6a7fc640 1 -- 172.21.15.123:0/2399583218 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60037070 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7ffa6a7fc640 1 -- 172.21.15.123:0/2399583218 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6002ae30 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7ffa6a7fc640 1 -- 172.21.15.123:0/2399583218 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60032640 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7fcc5bfff640 1 -- 172.21.15.123:0/968770348 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037070 con 0x7fcc5c0dee30 2024-09-19T09:42:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f6f3e7fc640 1 -- 172.21.15.123:0/187205865 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34037070 con 0x7f6f380dcdc0 2024-09-19T09:42:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f6f3e7fc640 1 -- 172.21.15.123:0/187205865 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3402ae40 con 0x7f6f380dcdc0 2024-09-19T09:42:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fdcf9f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd80cbcc0 con 0x7f9fd815ec60 2024-09-19T09:42:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fdcf9f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd815b1b0 con 0x7f9fd80c5f20 2024-09-19T09:42:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fdcf9f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd815af60 con 0x7f9fd80c5b40 2024-09-19T09:42:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fd659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 0x7f9fd80ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7fc25139d640 1 --2- 172.21.15.123:0/1067120973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06ce90 0x7fc24c158920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0c8390 tx=0x7fc23c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ec9663e55a58c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fd659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 0x7f9fd80ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49176/0 (socket says 172.21.15.123:49176) 2024-09-19T09:42:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fd659c640 1 -- 172.21.15.123:0/1490754105 learned_addr learned my addr 172.21.15.123:0/1490754105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7fcc5bfff640 1 -- 172.21.15.123:0/968770348 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54032440 con 0x7fcc5c0dee30 2024-09-19T09:42:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74037070 con 0x7f4c7004a670 2024-09-19T09:42:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7fcc5bfff640 1 -- 172.21.15.123:0/968770348 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54032810 con 0x7fcc5c0dee30 2024-09-19T09:42:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f8274ad7640 1 -- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270159bb0 msgr2=0x7f827015c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f8274ad7640 1 --2- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270159bb0 0x7f827015c4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8268009d90 tx=0x7f826802a5f0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fd659c640 1 -- 172.21.15.123:0/1490754105 >> v1:172.21.15.194:6789/0 conn(0x7f9fd80c5f20 legacy=0x7f9fd815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7402acf0 con 0x7f4c7004a670 2024-09-19T09:42:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fd659c640 1 -- 172.21.15.123:0/1490754105 >> v1:172.21.15.123:6789/0 conn(0x7f9fd815ec60 legacy=0x7f9fd8154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.256+0000 7f9fd659c640 1 -- 172.21.15.123:0/1490754105 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd815b490 con 0x7f9fd80c5b40 2024-09-19T09:42:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f4c7c932640 1 -- 172.21.15.123:0/4290373080 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68001670 con 0x7f4c7004a670 2024-09-19T09:42:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fcaddffb640 1 -- 172.21.15.123:0/1885225370 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0037070 con 0x7fcae0159400 2024-09-19T09:42:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fcaddffb640 1 -- 172.21.15.123:0/1885225370 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad002ae40 con 0x7fcae0159400 2024-09-19T09:42:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fcaddffb640 1 -- 172.21.15.123:0/1885225370 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0037070 con 0x7fcae0159400 2024-09-19T09:42:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f8274ad7640 1 -- 172.21.15.123:0/2288648256 shutdown_connections 2024-09-19T09:42:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f8274ad7640 1 --2- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270159bb0 0x7f827015c4b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f8274ad7640 1 --2- 172.21.15.123:0/2288648256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270073170 0x7f8270073550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f8274ad7640 1 -- 172.21.15.123:0/2288648256 >> 172.21.15.123:0/2288648256 conn(0x7f82700ce9a0 msgr2=0x7f82700cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f3e7fc640 1 -- 172.21.15.123:0/187205865 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34032660 con 0x7f6f380dcdc0 2024-09-19T09:42:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fc243fff640 1 -- 172.21.15.123:0/1067120973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c037070 con 0x7fc24c06ce90 2024-09-19T09:42:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fc243fff640 1 -- 172.21.15.123:0/1067120973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c032440 con 0x7fc24c06ce90 2024-09-19T09:42:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fc243fff640 1 -- 172.21.15.123:0/1067120973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c032810 con 0x7fc24c06ce90 2024-09-19T09:42:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 -- 172.21.15.123:0/187205865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f380dcdc0 msgr2=0x7f6f3800d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/968770348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 msgr2=0x7fcc5c049e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7fcc6b4a4640 1 --2- 172.21.15.123:0/968770348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c049e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097a0 tx=0x7fcc5402a180 comp rx=0 tx=0).stop 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 --2- 172.21.15.123:0/187205865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f380dcdc0 0x7f6f3800d230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097a0 tx=0x7f6f3402a130 comp rx=0 tx=0).stop 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 -- 172.21.15.123:0/187205865 shutdown_connections 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 --2- 172.21.15.123:0/187205865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f3800c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 --2- 172.21.15.123:0/187205865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f380dcdc0 0x7f6f3800d230 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097a0 tx=0x7f6f3402a130 comp rx=0 tx=0).stop 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 -- 172.21.15.123:0/187205865 >> 172.21.15.123:0/187205865 conn(0x7f6f3800a160 msgr2=0x7f6f3800db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 -- 172.21.15.123:0/187205865 shutdown_connections 2024-09-19T09:42:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f6f44a4d640 1 -- 172.21.15.123:0/187205865 wait complete. 2024-09-19T09:42:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f9fd659c640 1 --2- 172.21.15.123:0/1490754105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 0x7f9fd80ccb70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9fd815b0e0 tx=0x7f9fcc02a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30083fe61b4dc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f4c7fb98640 1 -- 172.21.15.123:0/4290373080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7004a670 msgr2=0x7f4c7004aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f4c7fb98640 1 --2- 172.21.15.123:0/4290373080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7004a670 0x7f4c7004aaa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009720 tx=0x7f4c7402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2399583218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 msgr2=0x7ffa6c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7ffa71bd6640 1 --2- 172.21.15.123:0/2399583218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c072620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0722a0 tx=0x7ffa6002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2399583218 shutdown_connections 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7ffa71bd6640 1 --2- 172.21.15.123:0/2399583218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c072620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7ffa71bd6640 1 --2- 172.21.15.123:0/2399583218 >> v2:172.21.15.123:3300/0 conn(0x7ffa6c1524a0 0x7ffa6c158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2399583218 >> 172.21.15.123:0/2399583218 conn(0x7ffa6c0cdbd0 msgr2=0x7ffa6c0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f9fd559a640 1 -- 172.21.15.123:0/1490754105 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc037070 con 0x7f9fd80c5b40 2024-09-19T09:42:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f9fd559a640 1 -- 172.21.15.123:0/1490754105 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc032640 con 0x7f9fd80c5b40 2024-09-19T09:42:47.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.257+0000 7f8274ad7640 1 -- 172.21.15.123:0/2288648256 shutdown_connections 2024-09-19T09:42:47.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f9fd559a640 1 -- 172.21.15.123:0/1490754105 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc032a10 con 0x7f9fd80c5b40 2024-09-19T09:42:47.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/968770348 shutdown_connections 2024-09-19T09:42:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcc6b4a4640 1 --2- 172.21.15.123:0/968770348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c049e80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcc6b4a4640 1 --2- 172.21.15.123:0/968770348 >> v2:172.21.15.123:3300/0 conn(0x7fcc5c0d8860 0x7fcc5c049940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/968770348 >> 172.21.15.123:0/968770348 conn(0x7fcc5c054440 msgr2=0x7fcc5c054850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 -- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae0159400 msgr2=0x7fcae01633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 --2- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae0159400 0x7fcae01633b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcad00097a0 tx=0x7fcad002a130 comp rx=0 tx=0).stop 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 -- 172.21.15.123:0/1885225370 shutdown_connections 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 --2- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae00c7f40 0x7fcae00c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 --2- 172.21.15.123:0/1885225370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae0159400 0x7fcae01633b0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcad00097a0 tx=0x7fcad002a130 comp rx=0 tx=0).stop 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 -- 172.21.15.123:0/1885225370 >> 172.21.15.123:0/1885225370 conn(0x7fcae00c9100 msgr2=0x7fcae00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 -- 172.21.15.123:0/1885225370 shutdown_connections 2024-09-19T09:42:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fc253601640 1 -- 172.21.15.123:0/1067120973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06ce90 msgr2=0x7fc24c158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fc253601640 1 --2- 172.21.15.123:0/1067120973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06ce90 0x7fc24c158920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0c8390 tx=0x7fc23c02a200 comp rx=0 tx=0).stop 2024-09-19T09:42:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcadffff640 1 -- 172.21.15.123:0/1885225370 wait complete. 2024-09-19T09:42:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/968770348 shutdown_connections 2024-09-19T09:42:47.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f4c7fb98640 1 -- 172.21.15.123:0/4290373080 shutdown_connections 2024-09-19T09:42:47.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f4c7fb98640 1 --2- 172.21.15.123:0/4290373080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7004a670 0x7f4c7004aaa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2399583218 shutdown_connections 2024-09-19T09:42:47.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f4c7fb98640 1 -- 172.21.15.123:0/4290373080 >> 172.21.15.123:0/4290373080 conn(0x7f4c7004fc40 msgr2=0x7f4c70050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2399583218 wait complete. 2024-09-19T09:42:47.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/1490754105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 msgr2=0x7f9fd80ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f9fdcf9f640 1 --2- 172.21.15.123:0/1490754105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 0x7f9fd80ccb70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9fd815b0e0 tx=0x7f9fcc02a310 comp rx=0 tx=0).stop 2024-09-19T09:42:47.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/968770348 wait complete. 2024-09-19T09:42:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/1490754105 shutdown_connections 2024-09-19T09:42:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f9fdcf9f640 1 --2- 172.21.15.123:0/1490754105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5b40 0x7f9fd80ccb70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/1490754105 >> 172.21.15.123:0/1490754105 conn(0x7f9fd8073bb0 msgr2=0x7f9fd806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/1490754105 shutdown_connections 2024-09-19T09:42:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/1490754105 wait complete. 2024-09-19T09:42:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.258+0000 7f8274ad7640 1 -- 172.21.15.123:0/2288648256 wait complete. 2024-09-19T09:42:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f6f44a4d640 1 Processor -- start 2024-09-19T09:42:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7fc253601640 1 -- 172.21.15.123:0/1067120973 shutdown_connections 2024-09-19T09:42:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7fc253601640 1 --2- 172.21.15.123:0/1067120973 >> v2:172.21.15.194:3300/0 conn(0x7fc24c0c4780 0x7fc24c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7fc253601640 1 --2- 172.21.15.123:0/1067120973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06ce90 0x7fc24c158920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7fc253601640 1 -- 172.21.15.123:0/1067120973 >> 172.21.15.123:0/1067120973 conn(0x7fc24c06fa90 msgr2=0x7fc24c06fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7fc253601640 1 -- 172.21.15.123:0/1067120973 shutdown_connections 2024-09-19T09:42:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.259+0000 7f6f44a4d640 1 -- start start 2024-09-19T09:42:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7f4c7fb98640 1 -- 172.21.15.123:0/4290373080 shutdown_connections 2024-09-19T09:42:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7f8274ad7640 1 Processor -- start 2024-09-19T09:42:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7fcadffff640 1 Processor -- start 2024-09-19T09:42:47.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7fcc6b4a4640 1 Processor -- start 2024-09-19T09:42:47.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7fc253601640 1 -- 172.21.15.123:0/1067120973 wait complete. 2024-09-19T09:42:47.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7f9fdcf9f640 1 Processor -- start 2024-09-19T09:42:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7ffa71bd6640 1 Processor -- start 2024-09-19T09:42:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f44a4d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f380cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f44a4d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f3804d310 0x7f6f3804a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7fcadffff640 1 -- start start 2024-09-19T09:42:47.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7ffa71bd6640 1 -- start start 2024-09-19T09:42:47.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f44a4d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3804b1e0 0x7f6f3804b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f44a4d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f380dd1a0 con 0x7f6f3804d310 2024-09-19T09:42:47.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f44a4d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3804ef60 con 0x7f6f3804b1e0 2024-09-19T09:42:47.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f44a4d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3800c6d0 con 0x7f6f3800bd90 2024-09-19T09:42:47.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f3effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f3804d310 0x7f6f3804a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f3effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f3804d310 0x7f6f3804a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60024/0 (socket says 172.21.15.123:60024) 2024-09-19T09:42:47.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f6f3effd640 1 -- 172.21.15.123:0/251804723 learned_addr learned my addr 172.21.15.123:0/251804723 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7fcadffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae00c7f40 0x7fcae01f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7fc253601640 1 Processor -- start 2024-09-19T09:42:47.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7fcadffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae01597e0 0x7fcae0160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7fc253601640 1 -- start start 2024-09-19T09:42:47.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae01f8c30 0x7fcae0160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadffff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcae006c8a0 con 0x7fcae01f8c30 2024-09-19T09:42:47.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadffff640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcae00c7740 con 0x7fcae00c7f40 2024-09-19T09:42:47.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadffff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcae006ca20 con 0x7fcae01597e0 2024-09-19T09:42:47.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcc6b4a4640 1 -- start start 2024-09-19T09:42:47.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7f4c7fb98640 1 -- 172.21.15.123:0/4290373080 wait complete. 2024-09-19T09:42:47.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.260+0000 7f8274ad7640 1 -- start start 2024-09-19T09:42:47.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f8274ad7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270073170 0x7f827013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f4c7fb98640 1 Processor -- start 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f8274ad7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82700c59a0 0x7f827006be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f8274ad7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270159bb0 0x7f8270143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f8274ad7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82701593b0 con 0x7f82700c59a0 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f8274ad7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82701590d0 con 0x7f8270073170 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f8274ad7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8270159690 con 0x7f8270159bb0 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f826dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82700c59a0 0x7f827006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f826dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82700c59a0 0x7f827006be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60038/0 (socket says 172.21.15.123:60038) 2024-09-19T09:42:47.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f826dd9b640 1 -- 172.21.15.123:0/3434180528 learned_addr learned my addr 172.21.15.123:0/3434180528 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae01f8c30 0x7fcae0160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826e59c640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270073170 0x7f827013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.261+0000 7f9fdcf9f640 1 -- start start 2024-09-19T09:42:47.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f3effd640 1 -- 172.21.15.123:0/251804723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 msgr2=0x7f6f380cfa30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:47.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f3effd640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f3800bd90 0x7f6f380cfa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f3effd640 1 -- 172.21.15.123:0/251804723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3804b1e0 msgr2=0x7f6f3804b690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:47.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f3effd640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3804b1e0 0x7f6f3804b690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f3effd640 1 -- 172.21.15.123:0/251804723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f380e0da0 con 0x7f6f3804d310 2024-09-19T09:42:47.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae01f8c30 0x7fcae0160c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60046/0 (socket says 172.21.15.123:60046) 2024-09-19T09:42:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fdcf9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd80c5b40 0x7f9fd81f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fdcf9f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5f20 0x7f9fd80b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcadf7fe640 1 -- 172.21.15.123:0/3286994787 learned_addr learned my addr 172.21.15.123:0/3286994787 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f4c7fb98640 1 -- start start 2024-09-19T09:42:47.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fdcf9f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd81f6be0 0x7f9fd8153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7fcade7fc640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae01597e0 0x7fcae0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f3effd640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f3804d310 0x7f6f3804a4b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c430 tx=0x7f6f2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826ed9d640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270159bb0 0x7f8270143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fd5d9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5f20 0x7f9fd80b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fd5d9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5f20 0x7f9fd80b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49220/0 (socket says 172.21.15.123:49220) 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fd5d9b640 1 -- 172.21.15.123:0/619466273 learned_addr learned my addr 172.21.15.123:0/619466273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fd6d9d640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd81f6be0 0x7f9fd8153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826e59c640 1 -- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270159bb0 msgr2=0x7f8270143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826e59c640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8270159bb0 0x7f8270143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826e59c640 1 -- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82700c59a0 msgr2=0x7f827006be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826e59c640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82700c59a0 0x7f827006be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f826e59c640 1 -- 172.21.15.123:0/3434180528 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700cd930 con 0x7f8270073170 2024-09-19T09:42:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f9fdcf9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd80cd0b0 con 0x7f9fd80c5b40 2024-09-19T09:42:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd815ba50 con 0x7f9fd81f6be0 2024-09-19T09:42:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011790 con 0x7f6f3804d310 2024-09-19T09:42:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.262+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2c017070 con 0x7f6f3804d310 2024-09-19T09:42:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011b30 con 0x7f6f3804d310 2024-09-19T09:42:47.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcadf7fe640 1 -- 172.21.15.123:0/3286994787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae01597e0 msgr2=0x7fcae0160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa71bd6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa6c0c86f0 0x7ffa6c145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc253601640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc24c06ce90 0x7fc24c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcadf7fe640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae01597e0 0x7fcae0160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc6b4a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5c0502c0 0x7fcc5c038770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc6b4a4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5c0d8860 0x7fcc5c038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc6b4a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc253601640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06d270 0x7fc24c0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f6f44a4d640 1 -- 172.21.15.123:0/251804723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f380e1080 con 0x7f6f3804d310 2024-09-19T09:42:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc6b4a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c0d8c40 con 0x7fcc5c0502c0 2024-09-19T09:42:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc6b4a4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c00f710 con 0x7fcc5c0d8860 2024-09-19T09:42:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc6b4a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0d8dc0 con 0x7fcc5c0dee30 2024-09-19T09:42:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcadf7fe640 1 -- 172.21.15.123:0/3286994787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae00c7f40 msgr2=0x7fcae01f86f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:42:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcadf7fe640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae00c7f40 0x7fcae01f86f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa71bd6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c13a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcadf7fe640 1 -- 172.21.15.123:0/3286994787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae00739b0 con 0x7fcae01f8c30 2024-09-19T09:42:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f6f44a4d640 1 -- 172.21.15.123:0/251804723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f380e1640 con 0x7f6f3804d310 2024-09-19T09:42:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc253601640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc24c0c4780 0x7fc24c0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa71bd6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa6c1524a0 0x7ffa6c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc253601640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0705b0 con 0x7fc24c06d270 2024-09-19T09:42:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa71bd6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0c9bb0 con 0x7ffa6c0c86f0 2024-09-19T09:42:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa71bd6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c152880 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f826e59c640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270073170 0x7f827013fcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f825800e8b0 tx=0x7f825800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc250b9c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06d270 0x7fc24c0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc250b9c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06d270 0x7fc24c0cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60058/0 (socket says 172.21.15.123:60058) 2024-09-19T09:42:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc250b9c640 1 -- 172.21.15.123:0/3917642512 learned_addr learned my addr 172.21.15.123:0/3917642512 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa6affd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c13a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa6affd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c13a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55928/0 (socket says 172.21.15.123:55928) 2024-09-19T09:42:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa6affd640 1 -- 172.21.15.123:0/2275203123 learned_addr learned my addr 172.21.15.123:0/2275203123 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c0c9e90 con 0x7ffa6c1524a0 2024-09-19T09:42:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc69a41640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0c8460 con 0x7fc24c06ce90 2024-09-19T09:42:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa6c1524a0 0x7ffa6c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f4c7fb98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c7004a670 0x7f4c70047900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c070730 con 0x7fc24c0c4780 2024-09-19T09:42:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc69240640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5c0502c0 0x7fcc5c038770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd80cb8a0 con 0x7f9fd80c5f20 2024-09-19T09:42:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc69240640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5c0502c0 0x7fcc5c038770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60072/0 (socket says 172.21.15.123:60072) 2024-09-19T09:42:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7f4c7fb98640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c700dcd80 0x7f4c700e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.263+0000 7fcc69240640 1 -- 172.21.15.123:0/2385135517 learned_addr learned my addr 172.21.15.123:0/2385135517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f4c7fb98640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c700e5f20 0x7f4c70184c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc251b9e640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc24c0c4780 0x7fc24c0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc25139d640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc24c06ce90 0x7fc24c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258017070 con 0x7f8270073170 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827013f1f0 con 0x7f8270073170 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd659c640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd80c5b40 0x7f9fd81f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd5d9b640 1 -- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd81f6be0 msgr2=0x7f9fd8153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd5d9b640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd81f6be0 0x7f9fd8153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd5d9b640 1 -- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd80c5b40 msgr2=0x7f9fd81f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd5d9b640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd80c5b40 0x7f9fd81f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd5d9b640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd80b5a70 con 0x7f9fd80c5f20 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa6affd640 1 -- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa6c1524a0 msgr2=0x7ffa6c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa6affd640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa6c1524a0 0x7ffa6c154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa6affd640 1 -- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa6c0c86f0 msgr2=0x7ffa6c145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa6affd640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa6c0c86f0 0x7ffa6c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa6affd640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c145a40 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa6affd640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c13a3e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400cb20 tx=0x7ffa64002070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc68a3f640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5c0d8860 0x7fcc5c038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcadf7fe640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae01f8c30 0x7fcae0160c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcad800cd70 tx=0x7fcad800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8270140c20 con 0x7f8270073170 2024-09-19T09:42:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc69240640 1 -- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 msgr2=0x7fcc5c0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc69240640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc69240640 1 -- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5c0d8860 msgr2=0x7fcc5c038cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc69240640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5c0d8860 0x7fcc5c038cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc69240640 1 -- 172.21.15.123:0/2385135517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c0e1480 con 0x7fcc5c0502c0 2024-09-19T09:42:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc250b9c640 1 -- 172.21.15.123:0/3917642512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc24c0c4780 msgr2=0x7fc24c0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc250b9c640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc24c0c4780 0x7fc24c0720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc250b9c640 1 -- 172.21.15.123:0/3917642512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc24c06ce90 msgr2=0x7fc24c14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f380de810 con 0x7f6f3804d310 2024-09-19T09:42:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcc69a41640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc5c0dee30 0x7fcc5c0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc250b9c640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc24c06ce90 0x7fc24c14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fc250b9c640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c0cd490 con 0x7fc24c06d270 2024-09-19T09:42:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64017070 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825800c940 con 0x7f8270073170 2024-09-19T09:42:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8003b90 con 0x7fcae01f8c30 2024-09-19T09:42:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825800cd30 con 0x7f8270073170 2024-09-19T09:42:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa64003da0 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f9fd5d9b640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5f20 0x7f9fd80b5530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c6b0 tx=0x7f9fd000cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad8003d30 con 0x7fcae01f8c30 2024-09-19T09:42:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c164690 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f4c7d934640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c7004a670 0x7f4c70047900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f4c7d934640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c7004a670 0x7f4c70047900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60078/0 (socket says 172.21.15.123:60078) 2024-09-19T09:42:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f4c7d133640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c700dcd80 0x7f4c700e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.264+0000 7f4c7d133640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c700dcd80 0x7f4c700e18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55952/0 (socket says 172.21.15.123:55952) 2024-09-19T09:42:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7ffa71bd6640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c1539b0 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f4c7fb98640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70045540 con 0x7f4c7004a670 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f4c7fb98640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700dd160 con 0x7f4c700dcd80 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f4c7fb98640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4c70045820 con 0x7f4c700e5f20 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f4c7e135640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c700e5f20 0x7f4c70184c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f4c7e135640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c700e5f20 0x7f4c70184c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49260/0 (socket says 172.21.15.123:49260) 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f4c7d934640 1 -- 172.21.15.123:0/822557546 learned_addr learned my addr 172.21.15.123:0/822557546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7fc250b9c640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06d270 0x7fc24c0cb610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc24800d620 tx=0x7fc24800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7fcc69240640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5c0502c0 0x7fcc5c038770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000b4d0 tx=0x7fcc6000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8004240 con 0x7fcae01f8c30 2024-09-19T09:42:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0016020 con 0x7f9fd80c5f20 2024-09-19T09:42:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0006d50 con 0x7f9fd80c5f20 2024-09-19T09:42:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0003bb0 con 0x7f9fd80c5f20 2024-09-19T09:42:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60014070 con 0x7fcc5c0502c0 2024-09-19T09:42:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b620 con 0x7fc24c06d270 2024-09-19T09:42:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc248019070 con 0x7fc24c06d270 2024-09-19T09:42:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b9e0 con 0x7fc24c06d270 2024-09-19T09:42:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400a900 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa44001030 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c0cd1b0 con 0x7fc24c06d270 2024-09-19T09:42:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c140680 con 0x7fc24c06d270 2024-09-19T09:42:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8254001030 con 0x7f8270073170 2024-09-19T09:42:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd80b67b0 con 0x7f9fd80c5f20 2024-09-19T09:42:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd80b4d30 con 0x7f9fd80c5f20 2024-09-19T09:42:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f825801a070 con 0x7f8270073170 2024-09-19T09:42:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae01f90d0 con 0x7fcae01f8c30 2024-09-19T09:42:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae00724a0 con 0x7fcae01f8c30 2024-09-19T09:42:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f2c011cd0 con 0x7f6f3804d310 2024-09-19T09:42:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7f6f2bfff640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f2406c300 0x7f6f2406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f2c08b2b0 con 0x7f6f3804d310 2024-09-19T09:42:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f6f2bfff640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7f6f240744a0 0x7f6f240768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 --> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f2c021e50 con 0x7f6f240744a0 2024-09-19T09:42:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc24c1472b0 con 0x7fc24c06d270 2024-09-19T09:42:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f6f3f7fe640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f2406c300 0x7f6f2406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f4c7d133640 1 -- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c700e5f20 msgr2=0x7f4c70184c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f4c7d133640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c700e5f20 0x7f4c70184c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f4c7d133640 1 -- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c7004a670 msgr2=0x7f4c70047900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f4c7d133640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c7004a670 0x7f4c70047900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7f4c7d133640 1 -- 172.21.15.123:0/822557546 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700e5c00 con 0x7f4c700dcd80 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f8266ffd640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f825006c380 0x7f825006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f826dd9b640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f825006c380 0x7f825006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f825808b740 con 0x7f8270073170 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f8266ffd640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f8250074600 0x7f8250076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 --> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8258016ec0 con 0x7f8250074600 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8258092050 con 0x7f8270073170 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7f826dd9b640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f825006c380 0x7f825006e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f827014d240 tx=0x7f8260007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcae01633b0 con 0x7fcae01f8c30 2024-09-19T09:42:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fbc001030 con 0x7f9fd80c5f20 2024-09-19T09:42:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa6401a070 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7ffa53fff640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa5806c380 0x7ffa5806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa5806c380 0x7ffa5806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f4c7d133640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c700dcd80 0x7f4c700e18d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c74031000 tx=0x7f4c740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74037040 con 0x7f4c700dcd80 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74004270 con 0x7f4c700dcd80 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74003610 con 0x7f4c700dcd80 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f4c7fb98640 1 -- 172.21.15.123:0/822557546 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c700e5000 con 0x7f4c700dcd80 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f4c7fb98640 1 -- 172.21.15.123:0/822557546 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c700e5640 con 0x7f4c700dcd80 2024-09-19T09:42:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.265+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c0e1740 con 0x7fcc5c0502c0 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.266+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c0e0b30 con 0x7fcc5c0502c0 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc5c0e1220 con 0x7fcc5c0502c0 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.267+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc60010870 con 0x7fcc5c0502c0 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60010c60 con 0x7fcc5c0502c0 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6f2c092050 con 0x7f6f3804d310 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.268+0000 7f6f3ffff640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7f6f240744a0 0x7f6f240768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7f6f3ffff640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7f6f240744a0 0x7f6f240768c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7f4c7fb98640 1 -- 172.21.15.123:0/822557546 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c700e2bd0 con 0x7f4c700dcd80 2024-09-19T09:42:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7f826ed9d640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f8250074600 0x7f8250076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.269+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffa6408ace0 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7ffa53fff640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7ffa58074600 0x7ffa58076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== osd.2 v2:172.21.15.123:6801/2615633995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f2c021e50 con 0x7f6f240744a0 2024-09-19T09:42:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7f6f3f7fe640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f2406c300 0x7f6f2406e7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f34034000 tx=0x7f6f3402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9fd00050d0 con 0x7f9fd80c5f20 2024-09-19T09:42:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa64020e50 con 0x7ffa58074600 2024-09-19T09:42:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ffa6408b0d0 con 0x7ffa6c0c8b40 2024-09-19T09:42:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7ffa58074600 0x7ffa58076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7f826ed9d640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f8250074600 0x7f8250076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa5806c380 0x7ffa5806e840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c006fd0 tx=0x7ffa5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc60017070 con 0x7fcc5c0502c0 2024-09-19T09:42:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7f9fc6ffd640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c300 0x7f9fb806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.270+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcad80043e0 con 0x7fcae01f8c30 2024-09-19T09:42:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd008ae90 con 0x7f9fd80c5f20 2024-09-19T09:42:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f9fc6ffd640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7f9fb8074520 0x7f9fb8076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fd0010e50 con 0x7f9fb8074520 2024-09-19T09:42:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9fd008d5e0 con 0x7f9fd80c5f20 2024-09-19T09:42:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcc59ffb640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcc4806c380 0x7fcc4806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f9fd6d9d640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7f9fb8074520 0x7f9fb8076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== osd.1 v2:172.21.15.123:6800/1169600851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8258016ec0 con 0x7f8250074600 2024-09-19T09:42:47.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7ffa58074600 0x7ffa58076a20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcc6008b160 con 0x7fcc5c0502c0 2024-09-19T09:42:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcac77fe640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcacc06c300 0x7fcacc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcc68a3f640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcc4806c380 0x7fcc4806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4c7402acf0 con 0x7f4c700dcd80 2024-09-19T09:42:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7f9fd659c640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c300 0x7f9fb806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcc59ffb640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7fcc480745a0 0x7fcc480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcad808c410 con 0x7fcae01f8c30 2024-09-19T09:42:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcadeffd640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcacc06c300 0x7fcacc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcac77fe640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7fcacc074520 0x7fcacc076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 --> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc48077070 con 0x7fcc480745a0 2024-09-19T09:42:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.271+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcc60092050 con 0x7fcc5c0502c0 2024-09-19T09:42:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcc69a41640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7fcc480745a0 0x7fcc480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcade7fc640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7fcacc074520 0x7fcacc076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7f4c6e7fc640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4c5c06c380 0x7f4c5c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcadeffd640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcacc06c300 0x7fcacc06e7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcad0034000 tx=0x7fcad002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcc68a3f640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcc4806c380 0x7fcc4806e840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc6402dd50 tx=0x7fcc6406e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcc69a41640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7fcc480745a0 0x7fcc480769c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4c740ab7b0 con 0x7f4c700dcd80 2024-09-19T09:42:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 --> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcad8011e50 con 0x7fcacc074520 2024-09-19T09:42:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcad808c8f0 con 0x7fcae01f8c30 2024-09-19T09:42:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7f4c7d934640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4c5c06c380 0x7f4c5c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7f4c6e7fc640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7f4c5c074600 0x7f4c5c076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc24800bb80 con 0x7fc24c06d270 2024-09-19T09:42:47.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 --> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c74034ec0 con 0x7f4c5c074600 2024-09-19T09:42:47.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== osd.5 v2:172.21.15.194:6824/3240582688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa64020e50 con 0x7ffa58074600 2024-09-19T09:42:47.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.272+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4c740b2050 con 0x7f4c700dcd80 2024-09-19T09:42:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fcade7fc640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7fcacc074520 0x7fcacc076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7f9fd6d9d640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7f9fb8074520 0x7f9fb8076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc241ffb640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc23006c380 0x7fc23006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc24808c2b0 con 0x7fc24c06d270 2024-09-19T09:42:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc25139d640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc23006c380 0x7fc23006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7f9fd659c640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c300 0x7f9fb806e7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc034000 tx=0x7f9fcc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc241ffb640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7fc230074600 0x7fc230076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== osd.7 v2:172.21.15.194:6816/125762816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc48077070 con 0x7fcc480745a0 2024-09-19T09:42:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc24800cfb0 con 0x7fc230074600 2024-09-19T09:42:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc24808c6a0 con 0x7fc24c06d270 2024-09-19T09:42:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7fc251b9e640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7fc230074600 0x7fc230076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.273+0000 7f4c7e135640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7f4c5c074600 0x7f4c5c076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.274+0000 7f4c7d934640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4c5c06c380 0x7f4c5c06e840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c780765c0 tx=0x7f4c7806e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.274+0000 7fc25139d640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc23006c380 0x7fc23006e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc23c034000 tx=0x7fc23c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.274+0000 7fc251b9e640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7fc230074600 0x7fc230076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.274+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== osd.4 v2:172.21.15.194:6808/3240452263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9fd0010e50 con 0x7f9fb8074520 2024-09-19T09:42:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.275+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== osd.3 v2:172.21.15.123:6816/116101554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcad8011e50 con 0x7fcacc074520 2024-09-19T09:42:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.275+0000 7f4c7e135640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7f4c5c074600 0x7f4c5c076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.275+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== osd.0 v2:172.21.15.123:6826/202872460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc24800cfb0 con 0x7fc230074600 2024-09-19T09:42:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.287+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 --> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc5c036e10 con 0x7fcc480745a0 2024-09-19T09:42:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.288+0000 7fcc59ffb640 1 -- 172.21.15.123:0/2385135517 <== osd.7 v2:172.21.15.194:6816/125762816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc5c036e10 con 0x7fcc480745a0 2024-09-19T09:42:47.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.288+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7fcc480745a0 msgr2=0x7fcc480769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.288+0000 7fcc6b4a4640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7fcc480745a0 0x7fcc480769c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcc4806c380 msgr2=0x7fcc4806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcc4806c380 0x7fcc4806e840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc6402dd50 tx=0x7fcc6406e040 comp rx=0 tx=0).stop 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5c0502c0 msgr2=0x7fcc5c038770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 --2- 172.21.15.123:0/2385135517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5c0502c0 0x7fcc5c038770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000b4d0 tx=0x7fcc6000b990 comp rx=0 tx=0).stop 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc69a41640 1 -- 172.21.15.123:0/2385135517 reap_dead start 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 shutdown_connections 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 >> 172.21.15.123:0/2385135517 conn(0x7fcc5c054440 msgr2=0x7fcc5c04f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 shutdown_connections 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.289+0000 7fcc6b4a4640 1 -- 172.21.15.123:0/2385135517 wait complete. 2024-09-19T09:42:47.364 INFO:teuthology.orchestra.run.smithi123.stdout:64424509448 2024-09-19T09:42:47.365 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T09:42:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.300+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 --> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f380e1840 con 0x7f6f240744a0 2024-09-19T09:42:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.300+0000 7f6f2bfff640 1 -- 172.21.15.123:0/251804723 <== osd.2 v2:172.21.15.123:6801/2615633995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f380e1840 con 0x7f6f240744a0 2024-09-19T09:42:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.300+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 --> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8254002dd0 con 0x7f8250074600 2024-09-19T09:42:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7f6f240744a0 msgr2=0x7f6f240768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7f6f240744a0 0x7f6f240768c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f2406c300 msgr2=0x7f6f2406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6f2406c300 0x7f6f2406e7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f34034000 tx=0x7f6f3402e000 comp rx=0 tx=0).stop 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f3804d310 msgr2=0x7f6f3804a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 --2- 172.21.15.123:0/251804723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f3804d310 0x7f6f3804a4b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c430 tx=0x7f6f2c00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f3ffff640 1 -- 172.21.15.123:0/251804723 reap_dead start 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 shutdown_connections 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f8266ffd640 1 -- 172.21.15.123:0/3434180528 <== osd.1 v2:172.21.15.123:6800/1169600851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8254002dd0 con 0x7f8250074600 2024-09-19T09:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 >> 172.21.15.123:0/251804723 conn(0x7f6f3800a160 msgr2=0x7f6f3800cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 shutdown_connections 2024-09-19T09:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.301+0000 7f6f29ffb640 1 -- 172.21.15.123:0/251804723 wait complete. 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f8250074600 msgr2=0x7f8250076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f8274ad7640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f8250074600 0x7f8250076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f825006c380 msgr2=0x7f825006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f8274ad7640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f825006c380 0x7f825006e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f827014d240 tx=0x7f8260007e90 comp rx=0 tx=0).stop 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270073170 msgr2=0x7f827013fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f8274ad7640 1 --2- 172.21.15.123:0/3434180528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8270073170 0x7f827013fcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f825800e8b0 tx=0x7f825800ed70 comp rx=0 tx=0).stop 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.302+0000 7f826ed9d640 1 -- 172.21.15.123:0/3434180528 reap_dead start 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 shutdown_connections 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 >> 172.21.15.123:0/3434180528 conn(0x7f82700ce9a0 msgr2=0x7f82700ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 --> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcae00cc110 con 0x7fcacc074520 2024-09-19T09:42:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 --> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa44002dd0 con 0x7ffa58074600 2024-09-19T09:42:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 shutdown_connections 2024-09-19T09:42:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7f8274ad7640 1 -- 172.21.15.123:0/3434180528 wait complete. 2024-09-19T09:42:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 --> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fbc002dd0 con 0x7f9fb8074520 2024-09-19T09:42:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.303+0000 7fcac77fe640 1 -- 172.21.15.123:0/3286994787 <== osd.3 v2:172.21.15.123:6816/116101554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcae00cc110 con 0x7fcacc074520 2024-09-19T09:42:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa53fff640 1 -- 172.21.15.123:0/2275203123 <== osd.5 v2:172.21.15.194:6824/3240582688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa44002dd0 con 0x7ffa58074600 2024-09-19T09:42:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fc6ffd640 1 -- 172.21.15.123:0/619466273 <== osd.4 v2:172.21.15.194:6808/3240452263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9fbc002dd0 con 0x7f9fb8074520 2024-09-19T09:42:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7fcacc074520 msgr2=0x7fcacc076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7fcacc074520 0x7fcacc076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcacc06c300 msgr2=0x7fcacc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcacc06c300 0x7fcacc06e7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcad0034000 tx=0x7fcad002e000 comp rx=0 tx=0).stop 2024-09-19T09:42:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae01f8c30 msgr2=0x7fcae0160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 --2- 172.21.15.123:0/3286994787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcae01f8c30 0x7fcae0160c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcad800cd70 tx=0x7fcad800a660 comp rx=0 tx=0).stop 2024-09-19T09:42:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadf7fe640 1 -- 172.21.15.123:0/3286994787 reap_dead start 2024-09-19T09:42:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7ffa58074600 msgr2=0x7ffa58076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa51ffb640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7ffa58074600 0x7ffa58076a20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7f9fb8074520 msgr2=0x7f9fb8076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fdcf9f640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7f9fb8074520 0x7f9fb8076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 shutdown_connections 2024-09-19T09:42:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 >> 172.21.15.123:0/3286994787 conn(0x7fcae00c9100 msgr2=0x7fcae006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa5806c380 msgr2=0x7ffa5806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa51ffb640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffa5806c380 0x7ffa5806e840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c006fd0 tx=0x7ffa5c008040 comp rx=0 tx=0).stop 2024-09-19T09:42:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c300 msgr2=0x7f9fb806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fdcf9f640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c300 0x7f9fb806e7c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc034000 tx=0x7f9fcc02e000 comp rx=0 tx=0).stop 2024-09-19T09:42:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5f20 msgr2=0x7f9fd80b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fdcf9f640 1 --2- 172.21.15.123:0/619466273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd80c5f20 0x7f9fd80b5530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c6b0 tx=0x7f9fd000cb70 comp rx=0 tx=0).stop 2024-09-19T09:42:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 msgr2=0x7ffa6c13a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7f9fd6d9d640 1 -- 172.21.15.123:0/619466273 reap_dead start 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa51ffb640 1 --2- 172.21.15.123:0/2275203123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa6c0c8b40 0x7ffa6c13a3e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400cb20 tx=0x7ffa64002070 comp rx=0 tx=0).stop 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.304+0000 7ffa6bfff640 1 -- 172.21.15.123:0/2275203123 reap_dead start 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 shutdown_connections 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 >> 172.21.15.123:0/2275203123 conn(0x7ffa6c0cdbd0 msgr2=0x7ffa6c072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 shutdown_connections 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 >> 172.21.15.123:0/619466273 conn(0x7f9fd8073bb0 msgr2=0x7f9fd80751e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 shutdown_connections 2024-09-19T09:42:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7fcadffff640 1 -- 172.21.15.123:0/3286994787 wait complete. 2024-09-19T09:42:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 shutdown_connections 2024-09-19T09:42:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7f9fdcf9f640 1 -- 172.21.15.123:0/619466273 wait complete. 2024-09-19T09:42:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 shutdown_connections 2024-09-19T09:42:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7ffa51ffb640 1 -- 172.21.15.123:0/2275203123 wait complete. 2024-09-19T09:42:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.305+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 --> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc24c1472b0 con 0x7fc230074600 2024-09-19T09:42:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.306+0000 7fc241ffb640 1 -- 172.21.15.123:0/3917642512 <== osd.0 v2:172.21.15.123:6826/202872460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc24c1472b0 con 0x7fc230074600 2024-09-19T09:42:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.306+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7fc230074600 msgr2=0x7fc230076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.306+0000 7fc253601640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7fc230074600 0x7fc230076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc23006c380 msgr2=0x7fc23006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc23006c380 0x7fc23006e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc23c034000 tx=0x7fc23c02e000 comp rx=0 tx=0).stop 2024-09-19T09:42:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06d270 msgr2=0x7fc24c0cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 --2- 172.21.15.123:0/3917642512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c06d270 0x7fc24c0cb610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc24800d620 tx=0x7fc24800dae0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc251b9e640 1 -- 172.21.15.123:0/3917642512 reap_dead start 2024-09-19T09:42:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 shutdown_connections 2024-09-19T09:42:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 >> 172.21.15.123:0/3917642512 conn(0x7fc24c06fa90 msgr2=0x7fc24c1572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 shutdown_connections 2024-09-19T09:42:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.307+0000 7fc253601640 1 -- 172.21.15.123:0/3917642512 wait complete. 2024-09-19T09:42:47.380 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-19T09:42:47.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T09:42:47.381 INFO:teuthology.orchestra.run.smithi123.stdout:64424509446 2024-09-19T09:42:47.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T09:42:47.382 INFO:teuthology.orchestra.run.smithi123.stdout:64424509447 2024-09-19T09:42:47.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T09:42:47.383 INFO:teuthology.orchestra.run.smithi123.stdout:64424509447 2024-09-19T09:42:47.384 INFO:teuthology.orchestra.run.smithi123.stdout:64424509447 2024-09-19T09:42:47.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T09:42:47.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T09:42:47.386 INFO:teuthology.orchestra.run.smithi123.stdout:64424509448 2024-09-19T09:42:47.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T09:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.543+0000 7f48b298d640 1 Processor -- start 2024-09-19T09:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.544+0000 7f48b298d640 1 -- start start 2024-09-19T09:42:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.545+0000 7f48b298d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 0x7f48ac154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.545+0000 7f48b298d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48ac15b290 con 0x7f48ac15eec0 2024-09-19T09:42:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.545+0000 7f48b298d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48ac15b570 con 0x7f48ac067fa0 2024-09-19T09:42:47.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.545+0000 7f48b298d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac15b850 con 0x7f48ac067bc0 2024-09-19T09:42:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.546+0000 7f48abfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 0x7f48ac154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.546+0000 7f48abfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 0x7f48ac154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49268/0 (socket says 172.21.15.123:49268) 2024-09-19T09:42:47.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.546+0000 7f48abfff640 1 -- 172.21.15.123:0/1470394834 learned_addr learned my addr 172.21.15.123:0/1470394834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.546+0000 7f48abfff640 1 -- 172.21.15.123:0/1470394834 >> v1:172.21.15.194:6789/0 conn(0x7f48ac067fa0 legacy=0x7f48ac15e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.546+0000 7f48abfff640 1 -- 172.21.15.123:0/1470394834 >> v1:172.21.15.123:6789/0 conn(0x7f48ac15eec0 legacy=0x7f48ac06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.547+0000 7f48abfff640 1 -- 172.21.15.123:0/1470394834 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac15bb30 con 0x7f48ac067bc0 2024-09-19T09:42:47.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.548+0000 7f48abfff640 1 --2- 172.21.15.123:0/1470394834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 0x7f48ac154d80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009e80 tx=0x7f48a402a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe91d66ab6e49331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.548+0000 7f48aaffd640 1 -- 172.21.15.123:0/1470394834 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4036070 con 0x7f48ac067bc0 2024-09-19T09:42:47.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.548+0000 7f48aaffd640 1 -- 172.21.15.123:0/1470394834 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a4031600 con 0x7f48ac067bc0 2024-09-19T09:42:47.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.549+0000 7f48b298d640 1 -- 172.21.15.123:0/1470394834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 msgr2=0x7f48ac154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.549+0000 7f48b298d640 1 --2- 172.21.15.123:0/1470394834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 0x7f48ac154d80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009e80 tx=0x7f48a402a750 comp rx=0 tx=0).stop 2024-09-19T09:42:47.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.550+0000 7f48b298d640 1 -- 172.21.15.123:0/1470394834 shutdown_connections 2024-09-19T09:42:47.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.550+0000 7f48b298d640 1 --2- 172.21.15.123:0/1470394834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac067bc0 0x7f48ac154d80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.550+0000 7f48b298d640 1 -- 172.21.15.123:0/1470394834 >> 172.21.15.123:0/1470394834 conn(0x7f48ac0cd920 msgr2=0x7f48ac0cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.550+0000 7f48b298d640 1 -- 172.21.15.123:0/1470394834 shutdown_connections 2024-09-19T09:42:47.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.550+0000 7f48b298d640 1 -- 172.21.15.123:0/1470394834 wait complete. 2024-09-19T09:42:47.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.552+0000 7f48b298d640 1 Processor -- start 2024-09-19T09:42:47.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.552+0000 7f48b298d640 1 -- start start 2024-09-19T09:42:47.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.553+0000 7f48b298d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48ac067bc0 0x7f48ac155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.553+0000 7f48b298d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 0x7f48ac154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.553+0000 7f48ab7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 0x7f48ac154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48abfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48ac067bc0 0x7f48ac155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48abfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48ac067bc0 0x7f48ac155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55960/0 (socket says 172.21.15.123:55960) 2024-09-19T09:42:47.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48ab7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 0x7f48ac154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60096/0 (socket says 172.21.15.123:60096) 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48abfff640 1 -- 172.21.15.123:0/1642503871 learned_addr learned my addr 172.21.15.123:0/1642503871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac15eec0 0x7f48ac154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac06d450 con 0x7f48ac067fa0 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac15af80 con 0x7f48ac067bc0 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac06d5d0 con 0x7f48ac15eec0 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48ab7fe640 1 -- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac15eec0 msgr2=0x7f48ac154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48ab7fe640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac15eec0 0x7f48ac154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48ab7fe640 1 -- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48ac067bc0 msgr2=0x7f48ac155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48ab7fe640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48ac067bc0 0x7f48ac155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.554+0000 7f48ab7fe640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac1f0e00 con 0x7f48ac067fa0 2024-09-19T09:42:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.555+0000 7f48ab7fe640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 0x7f48ac154760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06f7f0 tx=0x7f48a000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.555+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a00050d0 con 0x7f48ac067fa0 2024-09-19T09:42:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.555+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a0005270 con 0x7f48ac067fa0 2024-09-19T09:42:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.555+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a000a640 con 0x7f48ac067fa0 2024-09-19T09:42:47.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.555+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac1539a0 con 0x7f48ac067fa0 2024-09-19T09:42:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.556+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac153f60 con 0x7f48ac067fa0 2024-09-19T09:42:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.558+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ac0c8da0 con 0x7f48ac067fa0 2024-09-19T09:42:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.558+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f48a000a800 con 0x7f48ac067fa0 2024-09-19T09:42:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.559+0000 7f48a8ff9640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f489806c300 0x7f489806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.559+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f48a008adb0 con 0x7f48ac067fa0 2024-09-19T09:42:47.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.562+0000 7f48abfff640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f489806c300 0x7f489806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.563+0000 7f48abfff640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f489806c300 0x7f489806e7c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009c90 tx=0x7f48a4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.566+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f48a0059600 con 0x7f48ac067fa0 2024-09-19T09:42:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.575+0000 7fa112776640 1 Processor -- start 2024-09-19T09:42:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.575+0000 7fa112776640 1 -- start start 2024-09-19T09:42:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.576+0000 7fa112776640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa104008e40 0x7fa1040db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.576+0000 7fa112776640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa10404bd70 0x7fa1040db900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.576+0000 7fa112776640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10404d010 con 0x7fa1040d5820 2024-09-19T09:42:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa112776640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa10404d2d0 con 0x7fa104008e40 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa112776640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa104008360 con 0x7fa10404bd70 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111774640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa1040d5820 0x7fa104045c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54924/0 (socket says 172.21.15.123:54924) 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111774640 1 -- 172.21.15.123:0/2976469664 learned_addr learned my addr 172.21.15.123:0/2976469664 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111f75640 1 --2- 172.21.15.123:0/2976469664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa10404bd70 0x7fa1040db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa103fff640 1 -- 172.21.15.123:0/2976469664 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635882023 0 0) 0x7fa10404d010 con 0x7fa1040d5820 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa103fff640 1 -- 172.21.15.123:0/2976469664 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f8003520 con 0x7fa1040d5820 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa110f73640 1 --2- 172.21.15.123:0/2976469664 >> v2:172.21.15.194:3300/0 conn(0x7fa104008e40 0x7fa1040db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111f75640 1 -- 172.21.15.123:0/2976469664 >> v2:172.21.15.194:3300/0 conn(0x7fa104008e40 msgr2=0x7fa1040db3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111f75640 1 --2- 172.21.15.123:0/2976469664 >> v2:172.21.15.194:3300/0 conn(0x7fa104008e40 0x7fa1040db3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111f75640 1 -- 172.21.15.123:0/2976469664 >> v1:172.21.15.194:6789/0 conn(0x7fa1040d5820 legacy=0x7fa104045c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.577+0000 7fa111f75640 1 -- 172.21.15.123:0/2976469664 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa104008640 con 0x7fa10404bd70 2024-09-19T09:42:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.578+0000 7fa111f75640 1 --2- 172.21.15.123:0/2976469664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa10404bd70 0x7fa1040db900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa10c051220 tx=0x7fa10c0a72e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65033deddba21f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.578+0000 7fa103fff640 1 -- 172.21.15.123:0/2976469664 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0b4070 con 0x7fa10404bd70 2024-09-19T09:42:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.578+0000 7fa103fff640 1 -- 172.21.15.123:0/2976469664 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c0af680 con 0x7fa10404bd70 2024-09-19T09:42:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.578+0000 7fa103fff640 1 -- 172.21.15.123:0/2976469664 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0afaf0 con 0x7fa10404bd70 2024-09-19T09:42:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fa112776640 1 -- 172.21.15.123:0/2976469664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa10404bd70 msgr2=0x7fa1040db900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fa112776640 1 --2- 172.21.15.123:0/2976469664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa10404bd70 0x7fa1040db900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa10c051220 tx=0x7fa10c0a72e0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7f9fdb90a640 1 Processor -- start 2024-09-19T09:42:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fa112776640 1 -- 172.21.15.123:0/2976469664 shutdown_connections 2024-09-19T09:42:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fa112776640 1 --2- 172.21.15.123:0/2976469664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa10404bd70 0x7fa1040db900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fa112776640 1 --2- 172.21.15.123:0/2976469664 >> v2:172.21.15.194:3300/0 conn(0x7fa104008e40 0x7fa1040db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fa112776640 1 -- 172.21.15.123:0/2976469664 >> 172.21.15.123:0/2976469664 conn(0x7fa104050d60 msgr2=0x7fa104051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7fd39cea6640 1 Processor -- start 2024-09-19T09:42:47.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.579+0000 7f9fdb90a640 1 -- start start 2024-09-19T09:42:47.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.580+0000 7fd39cea6640 1 -- start start 2024-09-19T09:42:47.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.580+0000 7fa112776640 1 -- 172.21.15.123:0/2976469664 shutdown_connections 2024-09-19T09:42:47.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.580+0000 7fa112776640 1 -- 172.21.15.123:0/2976469664 wait complete. 2024-09-19T09:42:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.580+0000 7f33017b7640 1 Processor -- start 2024-09-19T09:42:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.580+0000 7f33017b7640 1 -- start start 2024-09-19T09:42:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f9fdb90a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9fd40c4780 0x7f9fd4158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f9fd96a6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9fd406ce90 0x7f9fd40c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58762/0 (socket says 172.21.15.123:58762) 2024-09-19T09:42:47.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f9fd96a6640 1 -- 172.21.15.123:0/2449715334 learned_addr learned my addr 172.21.15.123:0/2449715334 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f33017b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f32f404c980 0x7f32f4046ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7fd39cea6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd398153160 0x7fd3980caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7fd39cea6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3980c3bd0 0x7fd39806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2449715334 >> v2:172.21.15.194:3300/0 conn(0x7f9fd406d270 0x7f9fd4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f33017b7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32f4006650 0x7f32f40dabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.581+0000 7f33017b7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f4006ae0 con 0x7f32f40d4fc0 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f33017b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f32f4046b60 con 0x7f32f404c980 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f33017b7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f32f40d53a0 con 0x7f32f4006650 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32faffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f32f40d4fc0 0x7f32f404b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54932/0 (socket says 172.21.15.123:54932) 2024-09-19T09:42:47.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32faffd640 1 -- 172.21.15.123:0/1150726827 learned_addr learned my addr 172.21.15.123:0/1150726827 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fb135eb7640 1 Processor -- start 2024-09-19T09:42:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fd9ea7640 1 --2- 172.21.15.123:0/2449715334 >> v2:172.21.15.194:3300/0 conn(0x7f9fd406d270 0x7f9fd4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32fb7fe640 1 --2- 172.21.15.123:0/1150726827 >> v2:172.21.15.194:3300/0 conn(0x7f32f4006650 0x7f32f40dabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32fa7fc640 1 --2- 172.21.15.123:0/1150726827 >> v2:172.21.15.123:3300/0 conn(0x7f32f404c980 0x7f32f4046ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd40c9630 con 0x7f9fd406ce90 2024-09-19T09:42:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fa112776640 1 Processor -- start 2024-09-19T09:42:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd39cea6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd39815c460 0x7fd39806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd39cea6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd3980ca880 con 0x7fd3980c3bd0 2024-09-19T09:42:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd39cea6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fd3980cb530 con 0x7fd39815c460 2024-09-19T09:42:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd39cea6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd398153540 con 0x7fd398153160 2024-09-19T09:42:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd395d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3980c3bd0 0x7fd39806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fd8ea5640 1 --2- 172.21.15.123:0/2449715334 >> v2:172.21.15.123:3300/0 conn(0x7f9fd40c4780 0x7f9fd4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd40c8210 con 0x7f9fd40c4780 2024-09-19T09:42:47.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32fb7fe640 1 -- 172.21.15.123:0/1150726827 >> v2:172.21.15.123:3300/0 conn(0x7f32f404c980 msgr2=0x7f32f4046ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32fb7fe640 1 --2- 172.21.15.123:0/1150726827 >> v2:172.21.15.123:3300/0 conn(0x7f32f404c980 0x7f32f4046ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32fb7fe640 1 -- 172.21.15.123:0/1150726827 >> v1:172.21.15.194:6789/0 conn(0x7f32f40d4fc0 legacy=0x7f32f404b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32f9ffb640 1 -- 172.21.15.123:0/1150726827 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906865912 0 0) 0x7f32f4006ae0 con 0x7f32f40d4fc0 2024-09-19T09:42:47.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f32fb7fe640 1 -- 172.21.15.123:0/1150726827 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40dbb80 con 0x7f32f4006650 2024-09-19T09:42:47.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f2ee13f6640 1 Processor -- start 2024-09-19T09:42:47.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fa112776640 1 -- start start 2024-09-19T09:42:47.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fd3fff640 1 -- 172.21.15.123:0/2449715334 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708114758 0 0) 0x7f9fd40c9630 con 0x7f9fd406ce90 2024-09-19T09:42:47.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd395d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3980c3bd0 0x7fd39806f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60114/0 (socket says 172.21.15.123:60114) 2024-09-19T09:42:47.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd396d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd39815c460 0x7fd39806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd395d9b640 1 -- 172.21.15.123:0/1222301431 learned_addr learned my addr 172.21.15.123:0/1222301431 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd4070b60 con 0x7f9fd406d270 2024-09-19T09:42:47.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fd39659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd398153160 0x7fd3980caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f9fd3fff640 1 -- 172.21.15.123:0/2449715334 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fc4003520 con 0x7f9fd406ce90 2024-09-19T09:42:47.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fd39659c640 1 -- 172.21.15.123:0/1222301431 >> v2:172.21.15.194:3300/0 conn(0x7fd39815c460 msgr2=0x7fd39806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fd39659c640 1 --2- 172.21.15.123:0/1222301431 >> v2:172.21.15.194:3300/0 conn(0x7fd39815c460 0x7fd39806f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fd39659c640 1 -- 172.21.15.123:0/1222301431 >> v2:172.21.15.123:3300/0 conn(0x7fd3980c3bd0 msgr2=0x7fd39806f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fd39659c640 1 --2- 172.21.15.123:0/1222301431 >> v2:172.21.15.123:3300/0 conn(0x7fd3980c3bd0 0x7fd39806f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fd39659c640 1 -- 172.21.15.123:0/1222301431 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39806ecd0 con 0x7fd398153160 2024-09-19T09:42:47.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f9fd9ea7640 1 -- 172.21.15.123:0/2449715334 >> v2:172.21.15.123:3300/0 conn(0x7f9fd40c4780 msgr2=0x7f9fd4158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f9fd9ea7640 1 --2- 172.21.15.123:0/2449715334 >> v2:172.21.15.123:3300/0 conn(0x7f9fd40c4780 0x7f9fd4158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f9fd9ea7640 1 -- 172.21.15.123:0/2449715334 >> v1:172.21.15.123:6789/0 conn(0x7f9fd406ce90 legacy=0x7f9fd40c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f9fd9ea7640 1 -- 172.21.15.123:0/2449715334 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd40c98d0 con 0x7f9fd406d270 2024-09-19T09:42:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7fb135eb7640 1 -- start start 2024-09-19T09:42:47.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb135eb7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1300c4780 0x7fb130158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb135eb7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1300c9630 con 0x7fb13006ce90 2024-09-19T09:42:47.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb135eb7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb130070b60 con 0x7fb13006d270 2024-09-19T09:42:47.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb135eb7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb1300c8210 con 0x7fb1300c4780 2024-09-19T09:42:47.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f32fb7fe640 1 --2- 172.21.15.123:0/1150726827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f4006650 0x7f32f40dabf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32fc06af60 tx=0x7f32fc0a7620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c30e5c4bbb64a8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fa112776640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 0x7fa1041663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fa112776640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa10404bd70 0x7fa104163e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.582+0000 7f2ee13f6640 1 -- start start 2024-09-19T09:42:47.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f2ee13f6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1551d0 0x7f2edc15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f2ee13f6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2edc1555b0 0x7f2edc0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f2ee13f6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2edc15e620 con 0x7f2edc15f300 2024-09-19T09:42:47.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb12effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1300c4780 0x7fb130158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb12f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb13006ce90 0x7fb1300c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58768/0 (socket says 172.21.15.123:58768) 2024-09-19T09:42:47.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7fb12f7fe640 1 -- 172.21.15.123:0/119293923 learned_addr learned my addr 172.21.15.123:0/119293923 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:47.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f2ee13f6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f2edc0c5c50 con 0x7f2edc1555b0 2024-09-19T09:42:47.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.583+0000 7f2ee13f6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2edc15b5f0 con 0x7f2edc1551d0 2024-09-19T09:42:47.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 0x7fa1041663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f32f9ffb640 1 -- 172.21.15.123:0/1150726827 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b5070 con 0x7f32f4006650 2024-09-19T09:42:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f32f9ffb640 1 -- 172.21.15.123:0/1150726827 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0ad540 con 0x7f32f4006650 2024-09-19T09:42:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f32f9ffb640 1 -- 172.21.15.123:0/1150726827 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0ad9d0 con 0x7f32f4006650 2024-09-19T09:42:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2edaffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1551d0 0x7f2edc15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2edaffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1551d0 0x7f2edc15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49336/0 (socket says 172.21.15.123:49336) 2024-09-19T09:42:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2edaffd640 1 -- 172.21.15.123:0/3279796627 learned_addr learned my addr 172.21.15.123:0/3279796627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2eda7fc640 1 --2- 172.21.15.123:0/3279796627 >> v2:172.21.15.194:3300/0 conn(0x7f2edc1555b0 0x7f2edc0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 0x7fa1041663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49322/0 (socket says 172.21.15.123:49322) 2024-09-19T09:42:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa112776640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1040d5820 0x7fa1040d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa112776640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa10404c520 con 0x7fa10404bd70 2024-09-19T09:42:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa112776640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa10404c3a0 con 0x7fa1040d5820 2024-09-19T09:42:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa112776640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa1040dbe40 con 0x7fa104008e40 2024-09-19T09:42:47.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 -- 172.21.15.123:0/4293546959 learned_addr learned my addr 172.21.15.123:0/4293546959 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fb12e7fc640 1 -- 172.21.15.123:0/119293923 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968333949 0 0) 0x7fb1300c9630 con 0x7fb13006ce90 2024-09-19T09:42:47.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa110f73640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa10404bd70 0x7fa104163e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fb12e7fc640 1 -- 172.21.15.123:0/119293923 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb118003520 con 0x7fb13006ce90 2024-09-19T09:42:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111f75640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1040d5820 0x7fa1040d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fd39659c640 1 --2- 172.21.15.123:0/1222301431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd398153160 0x7fd3980caff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3980704a0 tx=0x7fd38802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b68b49680afa1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2eda7fc640 1 -- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1551d0 msgr2=0x7f2edc15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2eda7fc640 1 --2- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1551d0 0x7f2edc15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f9fd9ea7640 1 --2- 172.21.15.123:0/2449715334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd406d270 0x7f9fd4151b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40c8390 tx=0x7f9fcc02a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11fbe50c1905ad91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2eda7fc640 1 -- 172.21.15.123:0/3279796627 >> v1:172.21.15.123:6789/0 conn(0x7f2edc15f300 legacy=0x7f2edc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7f2eda7fc640 1 -- 172.21.15.123:0/3279796627 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc15b8d0 con 0x7f2edc1555b0 2024-09-19T09:42:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fd39559a640 1 -- 172.21.15.123:0/1222301431 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388037070 con 0x7fd398153160 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 -- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1040d5820 msgr2=0x7fa1040d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1040d5820 0x7fa1040d47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 -- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa10404bd70 msgr2=0x7fa104163e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa10404bd70 0x7fa104163e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fa111774640 1 -- 172.21.15.123:0/4293546959 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa104167480 con 0x7fa104008e40 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fb12e7fc640 1 -- 172.21.15.123:0/119293923 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446578694 0 0) 0x7fb130070b60 con 0x7fb13006d270 2024-09-19T09:42:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fb12effd640 1 -- 172.21.15.123:0/119293923 >> v1:172.21.15.194:6789/0 conn(0x7fb13006d270 legacy=0x7fb130151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fb12effd640 1 -- 172.21.15.123:0/119293923 >> v1:172.21.15.123:6789/0 conn(0x7fb13006ce90 legacy=0x7fb1300c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fb12effd640 1 -- 172.21.15.123:0/119293923 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1300c98d0 con 0x7fb1300c4780 2024-09-19T09:42:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fd39559a640 1 -- 172.21.15.123:0/1222301431 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38802ae50 con 0x7fd398153160 2024-09-19T09:42:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.584+0000 7fd39559a640 1 -- 172.21.15.123:0/1222301431 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388032660 con 0x7fd398153160 2024-09-19T09:42:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fa111774640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 0x7fa1041663a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c3c0 tx=0x7fa10800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 -- 172.21.15.123:0/1150726827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f4006650 msgr2=0x7f32f40dabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108017070 con 0x7fa104008e40 2024-09-19T09:42:47.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 --2- 172.21.15.123:0/1150726827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f4006650 0x7f32f40dabf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32fc06af60 tx=0x7f32fc0a7620 comp rx=0 tx=0).stop 2024-09-19T09:42:47.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 -- 172.21.15.123:0/1150726827 shutdown_connections 2024-09-19T09:42:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 --2- 172.21.15.123:0/1150726827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f4006650 0x7f32f40dabf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041669a0 con 0x7fa104008e40 2024-09-19T09:42:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa108005ce0 con 0x7fa104008e40 2024-09-19T09:42:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 --2- 172.21.15.123:0/1150726827 >> v2:172.21.15.123:3300/0 conn(0x7f32f404c980 0x7f32f4046ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1080072d0 con 0x7fa104008e40 2024-09-19T09:42:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 -- 172.21.15.123:0/1150726827 >> 172.21.15.123:0/1150726827 conn(0x7f32f4050590 msgr2=0x7f32f4050970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f9fd3fff640 1 -- 172.21.15.123:0/2449715334 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc037070 con 0x7f9fd406d270 2024-09-19T09:42:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f9fd3fff640 1 -- 172.21.15.123:0/2449715334 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc032440 con 0x7f9fd406d270 2024-09-19T09:42:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f9fd3fff640 1 -- 172.21.15.123:0/2449715334 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc032810 con 0x7f9fd406d270 2024-09-19T09:42:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041654b0 con 0x7fa104008e40 2024-09-19T09:42:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 -- 172.21.15.123:0/1150726827 shutdown_connections 2024-09-19T09:42:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7f33017b7640 1 -- 172.21.15.123:0/1150726827 wait complete. 2024-09-19T09:42:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fd39cea6640 1 -- 172.21.15.123:0/1222301431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd398153160 msgr2=0x7fd3980caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fd39cea6640 1 --2- 172.21.15.123:0/1222301431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd398153160 0x7fd3980caff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3980704a0 tx=0x7fd38802a100 comp rx=0 tx=0).stop 2024-09-19T09:42:47.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.585+0000 7fb12effd640 1 --2- 172.21.15.123:0/119293923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1300c4780 0x7fb130158920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb1300c8390 tx=0x7fb12002a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c5dd43916b9d868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f2eda7fc640 1 --2- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc1555b0 0x7f2edc0ccb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097a0 tx=0x7f2ed002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=108f4d651e0760d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fd39cea6640 1 -- 172.21.15.123:0/1222301431 shutdown_connections 2024-09-19T09:42:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fb12e7fc640 1 -- 172.21.15.123:0/119293923 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120037070 con 0x7fb1300c4780 2024-09-19T09:42:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fd39cea6640 1 --2- 172.21.15.123:0/1222301431 >> v2:172.21.15.194:3300/0 conn(0x7fd39815c460 0x7fd39806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fd39cea6640 1 --2- 172.21.15.123:0/1222301431 >> v2:172.21.15.123:3300/0 conn(0x7fd3980c3bd0 0x7fd39806f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fd39cea6640 1 --2- 172.21.15.123:0/1222301431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd398153160 0x7fd3980caff0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fb12e7fc640 1 -- 172.21.15.123:0/119293923 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb120032440 con 0x7fb1300c4780 2024-09-19T09:42:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd406d270 msgr2=0x7f9fd4151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2449715334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd406d270 0x7f9fd4151b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40c8390 tx=0x7f9fcc02a1f0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f2ed9ffb640 1 -- 172.21.15.123:0/3279796627 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0037070 con 0x7f2edc1555b0 2024-09-19T09:42:47.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7fd39cea6640 1 -- 172.21.15.123:0/1222301431 >> 172.21.15.123:0/1222301431 conn(0x7fd3980713d0 msgr2=0x7fd3980cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 shutdown_connections 2024-09-19T09:42:47.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f2ed9ffb640 1 -- 172.21.15.123:0/3279796627 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed0032440 con 0x7f2edc1555b0 2024-09-19T09:42:47.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2449715334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd406d270 0x7f9fd4151b40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2449715334 >> v2:172.21.15.123:3300/0 conn(0x7f9fd40c4780 0x7f9fd4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.586+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 >> 172.21.15.123:0/2449715334 conn(0x7f9fd406fa90 msgr2=0x7f9fd406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb12e7fc640 1 -- 172.21.15.123:0/119293923 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1200327f0 con 0x7fb1300c4780 2024-09-19T09:42:47.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 shutdown_connections 2024-09-19T09:42:47.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ec005290 con 0x7fa104008e40 2024-09-19T09:42:47.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb135eb7640 1 -- 172.21.15.123:0/119293923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1300c4780 msgr2=0x7fb130158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb135eb7640 1 --2- 172.21.15.123:0/119293923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1300c4780 0x7fb130158920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb1300c8390 tx=0x7fb12002a1f0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2449715334 wait complete. 2024-09-19T09:42:47.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa10801a070 con 0x7fa104008e40 2024-09-19T09:42:47.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb135eb7640 1 -- 172.21.15.123:0/119293923 shutdown_connections 2024-09-19T09:42:47.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb135eb7640 1 --2- 172.21.15.123:0/119293923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1300c4780 0x7fb130158920 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb1300c8390 tx=0x7fb12002a1f0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb135eb7640 1 -- 172.21.15.123:0/119293923 >> 172.21.15.123:0/119293923 conn(0x7fb13006fa90 msgr2=0x7fb13006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ed9ffb640 1 -- 172.21.15.123:0/3279796627 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0032810 con 0x7f2edc1555b0 2024-09-19T09:42:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 -- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc1555b0 msgr2=0x7f2edc0ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc1555b0 0x7f2edc0ccb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097a0 tx=0x7f2ed002a1c0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fd39cea6640 1 -- 172.21.15.123:0/1222301431 shutdown_connections 2024-09-19T09:42:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fd39cea6640 1 -- 172.21.15.123:0/1222301431 wait complete. 2024-09-19T09:42:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fb135eb7640 1 -- 172.21.15.123:0/119293923 shutdown_connections 2024-09-19T09:42:47.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f33017b7640 1 Processor -- start 2024-09-19T09:42:47.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 -- 172.21.15.123:0/3279796627 shutdown_connections 2024-09-19T09:42:47.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc1555b0 0x7f2edc0ccb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/3279796627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1551d0 0x7f2edc15edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 -- 172.21.15.123:0/3279796627 >> 172.21.15.123:0/3279796627 conn(0x7f2edc0d0e10 msgr2=0x7f2edc0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f33017b7640 1 -- start start 2024-09-19T09:42:47.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 -- 172.21.15.123:0/3279796627 shutdown_connections 2024-09-19T09:42:47.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7fa101ffb640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa0f006c300 0x7fa0f006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.588+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa10808a670 con 0x7fa104008e40 2024-09-19T09:42:47.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.588+0000 7fa110f73640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa0f006c300 0x7fa0f006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.588+0000 7fb135eb7640 1 -- 172.21.15.123:0/119293923 wait complete. 2024-09-19T09:42:47.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.588+0000 7f33017b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 0x7f32f4170bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.588+0000 7fa110f73640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa0f006c300 0x7fa0f006e7c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa1041660e0 tx=0x7fa0fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.588+0000 7f33017b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32f404c980 0x7f32f404a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f32faffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 0x7f32f4170bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f33017b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 0x7f32f40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f32faffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 0x7f32f4170bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60132/0 (socket says 172.21.15.123:60132) 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f33017b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4046510 con 0x7f32f4006650 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f33017b7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4046230 con 0x7f32f40d4fc0 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f33017b7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f32f40467f0 con 0x7f32f404c980 2024-09-19T09:42:47.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f32fb7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 0x7f32f40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f32fb7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 0x7f32f40c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56036/0 (socket says 172.21.15.123:56036) 2024-09-19T09:42:47.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f32fb7fe640 1 -- 172.21.15.123:0/2781697315 learned_addr learned my addr 172.21.15.123:0/2781697315 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.587+0000 7f2ee13f6640 1 -- 172.21.15.123:0/3279796627 wait complete. 2024-09-19T09:42:47.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7fb135eb7640 1 Processor -- start 2024-09-19T09:42:47.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7f9fdb90a640 1 Processor -- start 2024-09-19T09:42:47.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.589+0000 7fb135eb7640 1 -- start start 2024-09-19T09:42:47.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f2ee13f6640 1 Processor -- start 2024-09-19T09:42:47.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32fa7fc640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32f404c980 0x7f32f404a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32faffd640 1 -- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32f404c980 msgr2=0x7f32f404a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fd39cea6640 1 Processor -- start 2024-09-19T09:42:47.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f9fdb90a640 1 -- start start 2024-09-19T09:42:47.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f2ee13f6640 1 -- start start 2024-09-19T09:42:47.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fd39cea6640 1 -- start start 2024-09-19T09:42:47.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb135eb7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb13006ce90 0x7fb130153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb135eb7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13006d270 0x7fb1300cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb135eb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 0x7fb1301edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb135eb7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb1300c9090 con 0x7fb1300cd2c0 2024-09-19T09:42:47.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb135eb7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb1300c8460 con 0x7fb13006d270 2024-09-19T09:42:47.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb135eb7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb1300c9210 con 0x7fb13006ce90 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32faffd640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32f404c980 0x7f32f404a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32faffd640 1 -- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 msgr2=0x7f32f40c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32faffd640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 0x7f32f40c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32faffd640 1 -- 172.21.15.123:0/2781697315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f4170140 con 0x7f32f4006650 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 0x7fb1301edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 0x7fb1301edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60136/0 (socket says 172.21.15.123:60136) 2024-09-19T09:42:47.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7fb12ffff640 1 -- 172.21.15.123:0/3415986256 learned_addr learned my addr 172.21.15.123:0/3415986256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.590+0000 7f32faffd640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 0x7f32f4170bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c480 tx=0x7f32ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fb12ffff640 1 -- 172.21.15.123:0/3415986256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb13006ce90 msgr2=0x7fb130153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fb12ffff640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb13006ce90 0x7fb130153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fb12ffff640 1 -- 172.21.15.123:0/3415986256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13006d270 msgr2=0x7fb1300cc8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:47.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fb12ffff640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13006d270 0x7fb1300cc8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fb12ffff640 1 -- 172.21.15.123:0/3415986256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1301527f0 con 0x7fb1300cd2c0 2024-09-19T09:42:47.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec018070 con 0x7f32f4006650 2024-09-19T09:42:47.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== osd.6 v2:172.21.15.194:6800/2256990025 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c74034ec0 con 0x7f4c5c074600 2024-09-19T09:42:47.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f40d9e00 con 0x7f32f4006650 2024-09-19T09:42:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f32fa7fc640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32f404c980 0x7f32f404a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec0074e0 con 0x7f32f4006650 2024-09-19T09:42:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f41703c0 con 0x7f32f4006650 2024-09-19T09:42:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec01d640 con 0x7f32f4006650 2024-09-19T09:42:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f2ee13f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2edc1551d0 0x7f2edc0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fb12ffff640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 0x7fb1301edba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c7b0 tx=0x7fb12800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f32fb7fe640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 0x7f32f40c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:47.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7fd39cea6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3980c3bd0 0x7fd39814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f2ee13f6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1555b0 0x7f2edc15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd39cea6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 0x7fd3981ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f9fdb90a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd406ce90 0x7f9fd4144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.591+0000 7f9fdb90a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd406d270 0x7f9fd41574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fdb90a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd40c4780 0x7f9fd41ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fdb90a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40c9090 con 0x7f9fd406ce90 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fdb90a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40c8460 con 0x7f9fd40c4780 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd39cea6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39815c460 0x7fd3981eea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fdb90a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd40c9210 con 0x7f9fd406d270 2024-09-19T09:42:47.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd39cea6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd39806e580 con 0x7fd3980c3bd0 2024-09-19T09:42:47.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fd9ea7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd40c4780 0x7f9fd41ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd39cea6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd39806e2a0 con 0x7fd398153160 2024-09-19T09:42:47.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd39cea6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd3980caad0 con 0x7fd39815c460 2024-09-19T09:42:47.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fd8ea5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd406d270 0x7f9fd41574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fd9ea7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd40c4780 0x7f9fd41ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56058/0 (socket says 172.21.15.123:56058) 2024-09-19T09:42:47.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fd9ea7640 1 -- 172.21.15.123:0/2027108999 learned_addr learned my addr 172.21.15.123:0/2027108999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd395d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 0x7fd3981ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd395d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 0x7fd3981ee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56070/0 (socket says 172.21.15.123:56070) 2024-09-19T09:42:47.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd395d9b640 1 -- 172.21.15.123:0/2620080056 learned_addr learned my addr 172.21.15.123:0/2620080056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd396d9d640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39815c460 0x7fd3981eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f2ee13f6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc15f300 0x7f2edc0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f9fd96a6640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd406ce90 0x7f9fd4144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7f2ee13f6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc15e8a0 con 0x7f2edc1551d0 2024-09-19T09:42:47.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.592+0000 7fd39659c640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3980c3bd0 0x7fd39814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128017070 con 0x7fb1300cd2c0 2024-09-19T09:42:47.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f40cf040 con 0x7f32f4006650 2024-09-19T09:42:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2eda7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1555b0 0x7f2edc15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2eda7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1555b0 0x7f2edc15dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49370/0 (socket says 172.21.15.123:49370) 2024-09-19T09:42:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb130152ac0 con 0x7fb1300cd2c0 2024-09-19T09:42:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2eda7fc640 1 -- 172.21.15.123:0/1097729557 learned_addr learned my addr 172.21.15.123:0/1097729557 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f9fd8ea5640 1 -- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd40c4780 msgr2=0x7f9fd41ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f9fd8ea5640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd40c4780 0x7f9fd41ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f9fd8ea5640 1 -- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd406ce90 msgr2=0x7f9fd4144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f9fd8ea5640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd406ce90 0x7f9fd4144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f9fd8ea5640 1 -- 172.21.15.123:0/2027108999 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd40c67e0 con 0x7f9fd406d270 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fd395d9b640 1 -- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39815c460 msgr2=0x7fd3981eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fd395d9b640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39815c460 0x7fd3981eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fd395d9b640 1 -- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3980c3bd0 msgr2=0x7fd39814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fd395d9b640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3980c3bd0 0x7fd39814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fd395d9b640 1 -- 172.21.15.123:0/2620080056 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd398156050 con 0x7fd398153160 2024-09-19T09:42:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2edaffd640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2edc1551d0 0x7f2edc0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb130154770 con 0x7fb1300cd2c0 2024-09-19T09:42:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fd39659c640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3980c3bd0 0x7fd39814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb128003b70 con 0x7fb1300cd2c0 2024-09-19T09:42:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2edb7fe640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc15f300 0x7f2edc0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc15be90 con 0x7f2edc15f300 2024-09-19T09:42:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2edc06cde0 con 0x7f2edc1555b0 2024-09-19T09:42:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128005070 con 0x7fb1300cd2c0 2024-09-19T09:42:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.593+0000 7f9fd8ea5640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd406d270 0x7f9fd41574e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000e8a0 tx=0x7f9fc000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa108058820 con 0x7fa104008e40 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32ec01b070 con 0x7f32f4006650 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f2edaffd640 1 -- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1555b0 msgr2=0x7f2edc15dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f2edaffd640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1555b0 0x7f2edc15dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f2edaffd640 1 -- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc15f300 msgr2=0x7f2edc0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f2edaffd640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc15f300 0x7f2edc0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f2edaffd640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc15d870 con 0x7f2edc1551d0 2024-09-19T09:42:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f32e37fe640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32e806c2b0 0x7f32e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f2edaffd640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2edc1551d0 0x7f2edc0c7800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00e880 tx=0x7f2ecc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.594+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f32ec08a7e0 con 0x7f32f4006650 2024-09-19T09:42:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb110005290 con 0x7fb1300cd2c0 2024-09-19T09:42:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0017070 con 0x7f9fd406d270 2024-09-19T09:42:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc000c940 con 0x7f9fd406d270 2024-09-19T09:42:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7f32fa7fc640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32e806c2b0 0x7f32e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7fd395d9b640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 0x7fd3981ee530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00e860 tx=0x7fd38c00ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd41f0b00 con 0x7f9fd406d270 2024-09-19T09:42:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7f32fa7fc640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32e806c2b0 0x7f32e806e770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32f000d440 tx=0x7f32f000f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c017070 con 0x7fd398153160 2024-09-19T09:42:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c00c940 con 0x7fd398153160 2024-09-19T09:42:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00cd30 con 0x7fd398153160 2024-09-19T09:42:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3981f0a00 con 0x7fd398153160 2024-09-19T09:42:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.597+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3980c7eb0 con 0x7fd398153160 2024-09-19T09:42:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb12801a070 con 0x7fb1300cd2c0 2024-09-19T09:42:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.595+0000 7fb117fff640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb11c06c300 0x7fb11c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb12808a7a0 con 0x7fb1300cd2c0 2024-09-19T09:42:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fb12f7fe640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb11c06c300 0x7fb11c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7fb12f7fe640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb11c06c300 0x7fb11c06e7c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb124001660 tx=0x7fb124007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd4072a90 con 0x7f9fd406d270 2024-09-19T09:42:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.596+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0009e60 con 0x7f9fd406d270 2024-09-19T09:42:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.597+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9fc001a070 con 0x7f9fd406d270 2024-09-19T09:42:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.598+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3980ca3c0 con 0x7fd398153160 2024-09-19T09:42:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.598+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd4071c80 con 0x7f9fd406d270 2024-09-19T09:42:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.598+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd38c01a070 con 0x7fd398153160 2024-09-19T09:42:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.598+0000 7f9fd1ffb640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c330 0x7f9fb806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9fc008e420 con 0x7f9fd406d270 2024-09-19T09:42:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7f9fd96a6640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c330 0x7f9fb806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7fd386ffd640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd37806c330 0x7fd37806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd38c08b380 con 0x7fd398153160 2024-09-19T09:42:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7fd39659c640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd37806c330 0x7fd37806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7f9fd96a6640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c330 0x7f9fb806e7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8001560 tx=0x7f9fc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.599+0000 7fd39659c640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd37806c330 0x7fd37806e7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd388034000 tx=0x7fd38802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.601+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f32f4170140 con 0x7f32f4006650 2024-09-19T09:42:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.603+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9fd4071c80 con 0x7f9fd406d270 2024-09-19T09:42:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.604+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd38c059580 con 0x7fd398153160 2024-09-19T09:42:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.607+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb1280589a0 con 0x7fb1300cd2c0 2024-09-19T09:42:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.607+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc017070 con 0x7f2edc1551d0 2024-09-19T09:42:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.608+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00c940 con 0x7f2edc1551d0 2024-09-19T09:42:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.608+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2edc15c3e0 con 0x7f2edc1551d0 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.608+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2edc0c6d20 con 0x7f2edc1551d0 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.609+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00cd10 con 0x7f2edc1551d0 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.611+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc005290 con 0x7f2edc1551d0 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.613+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ecc01a070 con 0x7f2edc1551d0 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.614+0000 7f2ec37fe640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2ec806c380 0x7f2ec806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.614+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2ecc08ba70 con 0x7f2edc1551d0 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.619+0000 7f4c7fb98640 1 -- 172.21.15.123:0/822557546 --> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c7004b1b0 con 0x7f4c5c074600 2024-09-19T09:42:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.619+0000 7f2eda7fc640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2ec806c380 0x7f2ec806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c6e7fc640 1 -- 172.21.15.123:0/822557546 <== osd.6 v2:172.21.15.194:6800/2256990025 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c7004b1b0 con 0x7f4c5c074600 2024-09-19T09:42:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f2eda7fc640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2ec806c380 0x7f2ec806e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0ce610 tx=0x7f2ed002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7f4c5c074600 msgr2=0x7f4c5c076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c5bfff640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7f4c5c074600 0x7f4c5c076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4c5c06c380 msgr2=0x7f4c5c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c5bfff640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4c5c06c380 0x7f4c5c06e840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c780765c0 tx=0x7f4c7806e040 comp rx=0 tx=0).stop 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c700dcd80 msgr2=0x7f4c700e18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.620+0000 7f4c5bfff640 1 --2- 172.21.15.123:0/822557546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c700dcd80 0x7f4c700e18d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c74031000 tx=0x7f4c740046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.621+0000 7f4c7e135640 1 -- 172.21.15.123:0/822557546 reap_dead start 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.621+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 shutdown_connections 2024-09-19T09:42:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.621+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 >> 172.21.15.123:0/822557546 conn(0x7f4c7004fc40 msgr2=0x7f4c700db570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.621+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 shutdown_connections 2024-09-19T09:42:47.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.621+0000 7f4c5bfff640 1 -- 172.21.15.123:0/822557546 wait complete. 2024-09-19T09:42:47.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.623+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2edc15d870 con 0x7f2edc1551d0 2024-09-19T09:42:47.654 INFO:teuthology.orchestra.run.smithi123.stdout:64424509445 2024-09-19T09:42:47.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T09:42:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.818+0000 7fd70f265640 1 Processor -- start 2024-09-19T09:42:47.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.818+0000 7fd70f265640 1 -- start start 2024-09-19T09:42:47.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70f265640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd7081571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70f265640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd70815a760 0x7fd7080c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70f265640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd708158120 con 0x7fd7080c9740 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70f265640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd7080c75e0 con 0x7fd70815a760 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70f265640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd7080720f0 con 0x7fd708151520 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70c800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd70815a760 0x7fd7080c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70c800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd70815a760 0x7fd7080c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60184/0 (socket says 172.21.15.123:60184) 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.820+0000 7fd70c800640 1 -- 172.21.15.123:0/3699671896 learned_addr learned my addr 172.21.15.123:0/3699671896 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.821+0000 7fd70c800640 1 -- 172.21.15.123:0/3699671896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 msgr2=0x7fd7081571f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.821+0000 7fd70c800640 1 --2- 172.21.15.123:0/3699671896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd7081571f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.821+0000 7fd70c800640 1 -- 172.21.15.123:0/3699671896 >> v1:172.21.15.123:6789/0 conn(0x7fd7080c9740 legacy=0x7fd708072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.821+0000 7fd70c800640 1 -- 172.21.15.123:0/3699671896 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd708157880 con 0x7fd70815a760 2024-09-19T09:42:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.822+0000 7fd70c800640 1 --2- 172.21.15.123:0/3699671896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd7080c9200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd704008870 tx=0x7fd70402c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e320f52204fafcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.823+0000 7fd6fffff640 1 -- 172.21.15.123:0/3699671896 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704032070 con 0x7fd70815a760 2024-09-19T09:42:47.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.823+0000 7fd6fffff640 1 -- 172.21.15.123:0/3699671896 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd704032620 con 0x7fd70815a760 2024-09-19T09:42:47.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 -- 172.21.15.123:0/3699671896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 msgr2=0x7fd7080c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 --2- 172.21.15.123:0/3699671896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd7080c9200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd704008870 tx=0x7fd70402c7c0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 -- 172.21.15.123:0/3699671896 shutdown_connections 2024-09-19T09:42:47.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 --2- 172.21.15.123:0/3699671896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd7080c9200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 --2- 172.21.15.123:0/3699671896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd7081571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 -- 172.21.15.123:0/3699671896 >> 172.21.15.123:0/3699671896 conn(0x7fd70806ed00 msgr2=0x7fd70806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 -- 172.21.15.123:0/3699671896 shutdown_connections 2024-09-19T09:42:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.824+0000 7fd70f265640 1 -- 172.21.15.123:0/3699671896 wait complete. 2024-09-19T09:42:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.826+0000 7fd70f265640 1 Processor -- start 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.826+0000 7fd70f265640 1 -- start start 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70f265640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7080c9740 0x7fd7080c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70f265640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd70814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70f265640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd70814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70f265640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd708071d80 con 0x7fd70815a760 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70f265640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd708157e40 con 0x7fd7080c9740 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70f265640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd7080c6c10 con 0x7fd708151520 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70d802640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd70814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70d802640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd70814ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60196/0 (socket says 172.21.15.123:60196) 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70d802640 1 -- 172.21.15.123:0/2846932774 learned_addr learned my addr 172.21.15.123:0/2846932774 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.827+0000 7fd70c800640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd70814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.828+0000 7fd70d802640 1 -- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 msgr2=0x7fd70814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.828+0000 7fd70d802640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd70814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.828+0000 7fd70d802640 1 -- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7080c9740 msgr2=0x7fd7080c4540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.828+0000 7fd70d802640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7080c9740 0x7fd7080c4540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.828+0000 7fd70d802640 1 -- 172.21.15.123:0/2846932774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd708147d50 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.828+0000 7fd70d802640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd70814ff70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c7b0 tx=0x7fd6f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.829+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8016020 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.829+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd708156d30 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.829+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70813e800 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.829+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f800a640 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.830+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800aa30 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.832+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6f8019020 con 0x7fd70815a760 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.833+0000 7fd6fdffb640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd6ec06c2b0 0x7fd6ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.833+0000 7fd70d001640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd6ec06c2b0 0x7fd6ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.834+0000 7fd70d001640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd6ec06c2b0 0x7fd6ec06e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd70000abe0 tx=0x7fd700009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.834+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd6f808b440 con 0x7fd70815a760 2024-09-19T09:42:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.835+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e8005290 con 0x7fd70815a760 2024-09-19T09:42:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.844+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd6f8020020 con 0x7fd70815a760 2024-09-19T09:42:47.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.955+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa0ec005580 con 0x7fa104008e40 2024-09-19T09:42:47.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.955+0000 7fa101ffb640 1 -- 172.21.15.123:0/4293546959 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa10805cb00 con 0x7fa104008e40 2024-09-19T09:42:47.960 INFO:teuthology.orchestra.run.smithi123.stdout:64424509446 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa0f006c300 msgr2=0x7fa0f006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa0f006c300 0x7fa0f006e7c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa1041660e0 tx=0x7fa0fc008040 comp rx=0 tx=0).stop 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 msgr2=0x7fa1041663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 0x7fa1041663a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c3c0 tx=0x7fa10800c880 comp rx=0 tx=0).stop 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 shutdown_connections 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1040d5820 0x7fa1040d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa10404bd70 0x7fa104163e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa0f006c300 0x7fa0f006e7c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 --2- 172.21.15.123:0/4293546959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa104008e40 0x7fa1041663a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.959+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 >> 172.21.15.123:0/4293546959 conn(0x7fa104050d60 msgr2=0x7fa104164500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.960+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 shutdown_connections 2024-09-19T09:42:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.960+0000 7fa112776640 1 -- 172.21.15.123:0/4293546959 wait complete. 2024-09-19T09:42:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.960+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f48ac073330 con 0x7f48ac067fa0 2024-09-19T09:42:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.961+0000 7f48a8ff9640 1 -- 172.21.15.123:0/1642503871 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48a0058f00 con 0x7f48ac067fa0 2024-09-19T09:42:47.963 INFO:teuthology.orchestra.run.smithi123.stdout:64424509446 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.966+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f489806c300 msgr2=0x7f489806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f489806c300 0x7f489806e7c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009c90 tx=0x7f48a4009000 comp rx=0 tx=0).stop 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 msgr2=0x7f48ac154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 0x7f48ac154760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06f7f0 tx=0x7f48a000cbe0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 shutdown_connections 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f489806c300 0x7f489806e7c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48ac15eec0 0x7f48ac154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f48ac067fa0 0x7f48ac154760 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06f7f0 tx=0x7f48a000cbe0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 --2- 172.21.15.123:0/1642503871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48ac067bc0 0x7f48ac155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 >> 172.21.15.123:0/1642503871 conn(0x7f48ac0cd920 msgr2=0x7f48ac075300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 shutdown_connections 2024-09-19T09:42:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.967+0000 7f48b298d640 1 -- 172.21.15.123:0/1642503871 wait complete. 2024-09-19T09:42:47.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-19T09:42:47.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-19T09:42:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.989+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2ebc005850 con 0x7f2edc1551d0 2024-09-19T09:42:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.989+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f32f40475a0 con 0x7f32f4006650 2024-09-19T09:42:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.990+0000 7f2ec37fe640 1 -- 172.21.15.123:0/1097729557 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ecc059c00 con 0x7f2edc1551d0 2024-09-19T09:42:47.992 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-19T09:42:47.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.990+0000 7f32e37fe640 1 -- 172.21.15.123:0/2781697315 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32ec058870 con 0x7f32f4006650 2024-09-19T09:42:47.992 INFO:teuthology.orchestra.run.smithi123.stdout:64424509447 2024-09-19T09:42:47.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2ec806c380 msgr2=0x7f2ec806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32e806c2b0 msgr2=0x7f32e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2ec806c380 0x7f2ec806e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0ce610 tx=0x7f2ed002e000 comp rx=0 tx=0).stop 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2edc1551d0 msgr2=0x7f2edc0c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2edc1551d0 0x7f2edc0c7800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00e880 tx=0x7f2ecc00ed40 comp rx=0 tx=0).stop 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 shutdown_connections 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc15f300 0x7f2edc0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2ec806c380 0x7f2ec806e840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc1555b0 0x7f2edc15dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 --2- 172.21.15.123:0/1097729557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2edc1551d0 0x7f2edc0c7800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 >> 172.21.15.123:0/1097729557 conn(0x7f2edc0d0e10 msgr2=0x7f2edc0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 shutdown_connections 2024-09-19T09:42:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f2ee13f6640 1 -- 172.21.15.123:0/1097729557 wait complete. 2024-09-19T09:42:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32e806c2b0 0x7f32e806e770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32f000d440 tx=0x7f32f000f040 comp rx=0 tx=0).stop 2024-09-19T09:42:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 msgr2=0x7f32f4170bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 0x7f32f4170bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c480 tx=0x7f32ec00c940 comp rx=0 tx=0).stop 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 shutdown_connections 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32f40d4fc0 0x7f32f40c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f32e806c2b0 0x7f32e806e770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32f404c980 0x7f32f404a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 --2- 172.21.15.123:0/2781697315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32f4006650 0x7f32f4170bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 >> 172.21.15.123:0/2781697315 conn(0x7f32f4050590 msgr2=0x7f32f40077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 shutdown_connections 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.993+0000 7f33017b7640 1 -- 172.21.15.123:0/2781697315 wait complete. 2024-09-19T09:42:47.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.994+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9fd40705b0 con 0x7f9fd406d270 2024-09-19T09:42:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.995+0000 7f9fd1ffb640 1 -- 172.21.15.123:0/2027108999 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fc0058a60 con 0x7f9fd406d270 2024-09-19T09:42:47.999 INFO:teuthology.orchestra.run.smithi123.stdout:64424509446 2024-09-19T09:42:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c330 msgr2=0x7f9fb806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c330 0x7f9fb806e7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8001560 tx=0x7f9fc8009040 comp rx=0 tx=0).stop 2024-09-19T09:42:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd406d270 msgr2=0x7f9fd41574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd406d270 0x7f9fd41574e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000e8a0 tx=0x7f9fc000ed60 comp rx=0 tx=0).stop 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 shutdown_connections 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd40c4780 0x7f9fd41ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fb806c330 0x7f9fb806e7f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd406d270 0x7f9fd41574e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.997+0000 7f9fdb90a640 1 --2- 172.21.15.123:0/2027108999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd406ce90 0x7f9fd4144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.998+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 >> 172.21.15.123:0/2027108999 conn(0x7f9fd406fa90 msgr2=0x7f9fd406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.998+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 shutdown_connections 2024-09-19T09:42:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:47.998+0000 7f9fdb90a640 1 -- 172.21.15.123:0/2027108999 wait complete. 2024-09-19T09:42:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.002+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb110005850 con 0x7fb1300cd2c0 2024-09-19T09:42:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.002+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd3980c9f90 con 0x7fd398153160 2024-09-19T09:42:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.002+0000 7fb117fff640 1 -- 172.21.15.123:0/3415986256 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb12805cca0 con 0x7fb1300cd2c0 2024-09-19T09:42:48.005 INFO:teuthology.orchestra.run.smithi123.stdout:64424509445 2024-09-19T09:42:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.003+0000 7fd386ffd640 1 -- 172.21.15.123:0/2620080056 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd38c05d880 con 0x7fd398153160 2024-09-19T09:42:48.005 INFO:teuthology.orchestra.run.smithi123.stdout:64424509447 2024-09-19T09:42:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb11c06c300 msgr2=0x7fb11c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb11c06c300 0x7fb11c06e7c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb124001660 tx=0x7fb124007930 comp rx=0 tx=0).stop 2024-09-19T09:42:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 msgr2=0x7fb1301edba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 0x7fb1301edba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c7b0 tx=0x7fb12800cc70 comp rx=0 tx=0).stop 2024-09-19T09:42:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 shutdown_connections 2024-09-19T09:42:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1300cd2c0 0x7fb1301edba0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13006d270 0x7fb1300cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb11c06c300 0x7fb11c06e7c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 --2- 172.21.15.123:0/3415986256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb13006ce90 0x7fb130153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 >> 172.21.15.123:0/3415986256 conn(0x7fb13006fa90 msgr2=0x7fb13014f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 shutdown_connections 2024-09-19T09:42:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.005+0000 7fb135eb7640 1 -- 172.21.15.123:0/3415986256 wait complete. 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd37806c330 msgr2=0x7fd37806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd37806c330 0x7fd37806e7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd388034000 tx=0x7fd38802e000 comp rx=0 tx=0).stop 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 msgr2=0x7fd3981ee530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 0x7fd3981ee530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00e860 tx=0x7fd38c00ed20 comp rx=0 tx=0).stop 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 shutdown_connections 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd37806c330 0x7fd37806e7f0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd388034000 tx=0x7fd38802e000 comp rx=0 tx=0).stop 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39815c460 0x7fd3981eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd398153160 0x7fd3981ee530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 --2- 172.21.15.123:0/2620080056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3980c3bd0 0x7fd39814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.006+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 >> 172.21.15.123:0/2620080056 conn(0x7fd3980713d0 msgr2=0x7fd39814c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.007+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 shutdown_connections 2024-09-19T09:42:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.007+0000 7fd39cea6640 1 -- 172.21.15.123:0/2620080056 wait complete. 2024-09-19T09:42:48.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.0 2024-09-19T09:42:48.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-09-19T09:42:48.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-09-19T09:42:48.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-19T09:42:48.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-09-19T09:42:48.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.092+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd6e8005580 con 0x7fd70815a760 2024-09-19T09:42:48.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.092+0000 7fd6fdffb640 1 -- 172.21.15.123:0/2846932774 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6f8059a80 con 0x7fd70815a760 2024-09-19T09:42:48.095 INFO:teuthology.orchestra.run.smithi123.stdout:64424509444 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd6ec06c2b0 msgr2=0x7fd6ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd6ec06c2b0 0x7fd6ec06e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd70000abe0 tx=0x7fd700009230 comp rx=0 tx=0).stop 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 msgr2=0x7fd70814ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd70814ff70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c7b0 tx=0x7fd6f800cc70 comp rx=0 tx=0).stop 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 shutdown_connections 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70815a760 0x7fd70814ff70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd6ec06c2b0 0x7fd6ec06e770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd708151520 0x7fd70814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 --2- 172.21.15.123:0/2846932774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7080c9740 0x7fd7080c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:48.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 >> 172.21.15.123:0/2846932774 conn(0x7fd70806ed00 msgr2=0x7fd7080c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:48.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 shutdown_connections 2024-09-19T09:42:48.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:48.095+0000 7fd70f265640 1 -- 172.21.15.123:0/2846932774 wait complete. 2024-09-19T09:42:48.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-09-19T09:42:48.249 INFO:tasks.ceph.mds.e.smithi123.stderr:2024-09-19T09:42:48.248+0000 7fe2ce87c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:42:48.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T09:42:48.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T09:42:49.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T09:42:49.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T09:42:49.018 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T09:42:49.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T09:42:49.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T09:42:49.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.126+0000 7f504f59e640 1 Processor -- start 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.126+0000 7f504f59e640 1 -- start start 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.127+0000 7f504f59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5050151540 0x7f5050157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.127+0000 7f504f59e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50500c7130 con 0x7f5050151160 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.127+0000 7f504f59e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50500c7410 con 0x7f505006c910 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.127+0000 7f504f59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f50500c81d0 con 0x7f5050151540 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.128+0000 7f504e59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5050151160 0x7f5050158440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58802/0 (socket says 172.21.15.123:58802) 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.128+0000 7f504e59c640 1 -- 172.21.15.123:0/397115317 learned_addr learned my addr 172.21.15.123:0/397115317 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:49.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.128+0000 7f504dd9b640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5050151540 0x7f5050157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.128+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905094690 0 0) 0x7f50500c7410 con 0x7f505006c910 2024-09-19T09:42:49.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.128+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5038003520 con 0x7f505006c910 2024-09-19T09:42:49.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.128+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783946168 0 0) 0x7f50500c7130 con 0x7f5050151160 2024-09-19T09:42:49.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50500c7410 con 0x7f5050151160 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 820061518 0 0) 0x7f5038003520 con 0x7f505006c910 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5050151540 msgr2=0x7f5050157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5050151540 0x7f5050157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 >> v1:172.21.15.123:6789/0 conn(0x7f5050151160 legacy=0x7f5050158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50500c76f0 con 0x7f505006c910 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.129+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f50480019f0 con 0x7f505006c910 2024-09-19T09:42:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 >> v1:172.21.15.194:6789/0 conn(0x7f505006c910 legacy=0x7f505006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038003b70 0x7f5038003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5038004800 0x7f5038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504e59c640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038003b70 0x7f5038003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f503800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50500c81d0 con 0x7f5038003b70 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f503800c060 con 0x7f5038004800 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f503800c260 con 0x7f50380051c0 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.130+0000 7f504ed9d640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f503800ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.131+0000 7f504ed9d640 1 -- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5038004800 msgr2=0x7f5038004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:42:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.131+0000 7f504ed9d640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5038004800 0x7f5038004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.131+0000 7f504ed9d640 1 -- 172.21.15.123:0/397115317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038003b70 msgr2=0x7f5038003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.131+0000 7f504ed9d640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5038003b70 0x7f5038003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.131+0000 7f504ed9d640 1 -- 172.21.15.123:0/397115317 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5038003520 con 0x7f50380051c0 2024-09-19T09:42:49.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.132+0000 7f504ed9d640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f503800ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f504800c490 tx=0x7f5038005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c91ceffdf2e221 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.132+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048033070 con 0x7f50380051c0 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.132+0000 7f504d59a640 1 -- 172.21.15.123:0/397115317 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504802f400 con 0x7f50380051c0 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.133+0000 7f504f59e640 1 -- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 msgr2=0x7f503800ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.133+0000 7f504f59e640 1 --2- 172.21.15.123:0/397115317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f503800ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f504800c490 tx=0x7f5038005830 comp rx=0 tx=0).stop 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.134+0000 7f504ed9d640 1 -- 172.21.15.123:0/397115317 reap_dead start 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.134+0000 7f504f59e640 1 -- 172.21.15.123:0/397115317 shutdown_connections 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.134+0000 7f504f59e640 1 -- 172.21.15.123:0/397115317 >> 172.21.15.123:0/397115317 conn(0x7f50500c9100 msgr2=0x7f50500c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.134+0000 7f504f59e640 1 -- 172.21.15.123:0/397115317 shutdown_connections 2024-09-19T09:42:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.134+0000 7f504f59e640 1 -- 172.21.15.123:0/397115317 wait complete. 2024-09-19T09:42:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.136+0000 7f504f59e640 1 Processor -- start 2024-09-19T09:42:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.137+0000 7f504f59e640 1 -- start start 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504f59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f505014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504f59e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5050072dd0 0x7f5050070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504f59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5050147e60 0x7f50500c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504f59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50500c7d40 con 0x7f5050147e60 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504f59e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f505006cec0 con 0x7f5050072dd0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504f59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5050158b50 con 0x7f50380051c0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504e59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f505014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504e59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f505014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49404/0 (socket says 172.21.15.123:49404) 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504e59c640 1 -- 172.21.15.123:0/1239619280 learned_addr learned my addr 172.21.15.123:0/1239619280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.138+0000 7f504ed9d640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5050147e60 0x7f50500c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.139+0000 7f504e59c640 1 -- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5050072dd0 msgr2=0x7f5050070ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.139+0000 7f504e59c640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5050072dd0 0x7f5050070ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.139+0000 7f504e59c640 1 -- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5050147e60 msgr2=0x7f50500c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.139+0000 7f504e59c640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5050147e60 0x7f50500c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.139+0000 7f504e59c640 1 -- 172.21.15.123:0/1239619280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505014ee90 con 0x7f50380051c0 2024-09-19T09:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.139+0000 7f504e59c640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f505014ff30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f504000f910 tx=0x7f504000fdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.140+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504000eab0 con 0x7f50380051c0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.140+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504000ec50 con 0x7f50380051c0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.140+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504000ee40 con 0x7f50380051c0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.140+0000 7f504f59e640 1 -- 172.21.15.123:0/1239619280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505014f170 con 0x7f50380051c0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.140+0000 7f504f59e640 1 -- 172.21.15.123:0/1239619280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f505014f730 con 0x7f50380051c0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.142+0000 7f504f59e640 1 -- 172.21.15.123:0/1239619280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5034005290 con 0x7f50380051c0 2024-09-19T09:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.143+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f504003c440 con 0x7f50380051c0 2024-09-19T09:42:49.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.144+0000 7f503effd640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f503006c3b0 0x7f503006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.144+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f504008c120 con 0x7f50380051c0 2024-09-19T09:42:49.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.145+0000 7f504dd9b640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f503006c3b0 0x7f503006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.145+0000 7f504dd9b640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f503006c3b0 0x7f503006e870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f505014cf10 tx=0x7f5044008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.147+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f504001e030 con 0x7f50380051c0 2024-09-19T09:42:49.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.158+0000 7f1016544640 1 Processor -- start 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.158+0000 7f1016544640 1 -- start start 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1016544640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1010151160 0x7f1010156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1016544640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f101006cd10 0x7f101015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1016544640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1010157860 con 0x7f101015aa10 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1016544640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1010157b20 con 0x7f101006cd10 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1016544640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f1010157e00 con 0x7f1010151160 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1014d41640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f101006cd10 0x7f101015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1014d41640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f101006cd10 0x7f101015a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60212/0 (socket says 172.21.15.123:60212) 2024-09-19T09:42:49.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.160+0000 7f1014d41640 1 -- 172.21.15.123:0/275284308 learned_addr learned my addr 172.21.15.123:0/275284308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.161+0000 7f1014d41640 1 -- 172.21.15.123:0/275284308 >> v2:172.21.15.194:3300/0 conn(0x7f1010151160 msgr2=0x7f1010156f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:42:49.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.161+0000 7f1014d41640 1 --2- 172.21.15.123:0/275284308 >> v2:172.21.15.194:3300/0 conn(0x7f1010151160 0x7f1010156f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.161+0000 7f1014d41640 1 -- 172.21.15.123:0/275284308 >> v1:172.21.15.123:6789/0 conn(0x7f101015aa10 legacy=0x7f10100c7b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:42:49.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.161+0000 7f1014d41640 1 -- 172.21.15.123:0/275284308 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10100c70a0 con 0x7f101006cd10 2024-09-19T09:42:49.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.162+0000 7f1014d41640 1 --2- 172.21.15.123:0/275284308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101006cd10 0x7f101015a4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1010077540 tx=0x7f100802be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c66403f08ab2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.163+0000 7f1007fff640 1 -- 172.21.15.123:0/275284308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100802c780 con 0x7f101006cd10 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.163+0000 7f1007fff640 1 -- 172.21.15.123:0/275284308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100802c920 con 0x7f101006cd10 2024-09-19T09:42:49.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 -- 172.21.15.123:0/275284308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101006cd10 msgr2=0x7f101015a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 --2- 172.21.15.123:0/275284308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101006cd10 0x7f101015a4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1010077540 tx=0x7f100802be80 comp rx=0 tx=0).stop 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 -- 172.21.15.123:0/275284308 shutdown_connections 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 --2- 172.21.15.123:0/275284308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101006cd10 0x7f101015a4d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 --2- 172.21.15.123:0/275284308 >> v2:172.21.15.194:3300/0 conn(0x7f1010151160 0x7f1010156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 -- 172.21.15.123:0/275284308 >> 172.21.15.123:0/275284308 conn(0x7f10100c9100 msgr2=0x7f10100c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.164+0000 7f1016544640 1 -- 172.21.15.123:0/275284308 shutdown_connections 2024-09-19T09:42:49.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.165+0000 7f1016544640 1 -- 172.21.15.123:0/275284308 wait complete. 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.166+0000 7f1016544640 1 Processor -- start 2024-09-19T09:42:49.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.166+0000 7f1016544640 1 -- start start 2024-09-19T09:42:49.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1016544640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f101006cd10 0x7f10100cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1016544640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 0x7f10100728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1016544640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f101015aa10 0x7f101014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1016544640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10101574a0 con 0x7f1010151160 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1016544640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f10100c7660 con 0x7f101006cd10 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1016544640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1010157620 con 0x7f101015aa10 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1014d41640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 0x7f10100728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1014d41640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 0x7f10100728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60218/0 (socket says 172.21.15.123:60218) 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1014d41640 1 -- 172.21.15.123:0/3094800678 learned_addr learned my addr 172.21.15.123:0/3094800678 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.168+0000 7f1015542640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f101006cd10 0x7f10100cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.169+0000 7f1014d41640 1 -- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f101015aa10 msgr2=0x7f101014eb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.169+0000 7f1014d41640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f101015aa10 0x7f101014eb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.169+0000 7f1014d41640 1 -- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f101006cd10 msgr2=0x7f10100cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.169+0000 7f1014d41640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f101006cd10 0x7f10100cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.169+0000 7f1014d41640 1 -- 172.21.15.123:0/3094800678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1010155da0 con 0x7f1010151160 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.169+0000 7f1014d41640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 0x7f10100728e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f100800d3c0 tx=0x7f1008004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.171+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008041030 con 0x7f1010151160 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.171+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10080046f0 con 0x7f1010151160 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.171+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10100719b0 con 0x7f1010151160 2024-09-19T09:42:49.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.171+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100803d660 con 0x7f1010151160 2024-09-19T09:42:49.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.171+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1010156a70 con 0x7f1010151160 2024-09-19T09:42:49.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.173+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff0005290 con 0x7f1010151160 2024-09-19T09:42:49.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.175+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1008044070 con 0x7f1010151160 2024-09-19T09:42:49.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.176+0000 7f1005ffb640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0ff406c3b0 0x7f0ff406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.176+0000 7f1015542640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0ff406c3b0 0x7f0ff406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.177+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f10080acc20 con 0x7f1010151160 2024-09-19T09:42:49.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.177+0000 7f1015542640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0ff406c3b0 0x7f0ff406e870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f100c006fd0 tx=0x7f100c0090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.183+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f100804b070 con 0x7f1010151160 2024-09-19T09:42:49.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.187+0000 7fb92dca6640 1 Processor -- start 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.187+0000 7fb92dca6640 1 -- start start 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.188+0000 7fb92dca6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb92815a760 0x7fb9281571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.188+0000 7fb92dca6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb928072580 0x7fb928072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.188+0000 7fb92dca6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb928158120 con 0x7fb928151520 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.188+0000 7fb92dca6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb9280c75e0 con 0x7fb928072580 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.188+0000 7fb92dca6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb9280720f0 con 0x7fb92815a760 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb92815a760 0x7fb9281571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb92815a760 0x7fb9281571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49412/0 (socket says 172.21.15.123:49412) 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb926ffd640 1 -- 172.21.15.123:0/2356538956 learned_addr learned my addr 172.21.15.123:0/2356538956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb927fff640 1 --2- 172.21.15.123:0/2356538956 >> v2:172.21.15.194:3300/0 conn(0x7fb928072580 0x7fb928072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb927fff640 1 -- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb92815a760 msgr2=0x7fb9281571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb927fff640 1 --2- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb92815a760 0x7fb9281571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb927fff640 1 -- 172.21.15.123:0/2356538956 >> v1:172.21.15.123:6789/0 conn(0x7fb928151520 legacy=0x7fb9280c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb927fff640 1 -- 172.21.15.123:0/2356538956 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb928157880 con 0x7fb928072580 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.187+0000 7fb25ce2b640 1 Processor -- start 2024-09-19T09:42:49.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.187+0000 7fb25ce2b640 1 -- start start 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb25ce2b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb250046950 0x7fb250046d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb25ce2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250047490 0x7fb2500ed370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb25ce2b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb250007490 con 0x7fb2500068c0 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb25ce2b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb2500e2f00 con 0x7fb250046950 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb25ce2b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb250007770 con 0x7fb250047490 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb256ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb2500068c0 0x7fb2500e3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58822/0 (socket says 172.21.15.123:58822) 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.189+0000 7fb256ffd640 1 -- 172.21.15.123:0/870574737 learned_addr learned my addr 172.21.15.123:0/870574737 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:49.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7ff4bb467640 1 Processor -- start 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fb257fff640 1 --2- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250047490 0x7fb2500ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fb2577fe640 1 --2- 172.21.15.123:0/870574737 >> v2:172.21.15.194:3300/0 conn(0x7fb250046950 0x7fb250046d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fb2577fe640 1 -- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250047490 msgr2=0x7fb2500ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fb2577fe640 1 --2- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250047490 0x7fb2500ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fb2577fe640 1 -- 172.21.15.123:0/870574737 >> v1:172.21.15.123:6789/0 conn(0x7fb2500068c0 legacy=0x7fb2500e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fb2577fe640 1 -- 172.21.15.123:0/870574737 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb250007a50 con 0x7fb250046950 2024-09-19T09:42:49.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7ff4bb467640 1 -- start start 2024-09-19T09:42:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fb927fff640 1 --2- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb928072580 0x7fb928072a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009fb0 tx=0x7fb91c02e750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb0e3c2edaed463e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fe7657d8640 1 Processor -- start 2024-09-19T09:42:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.190+0000 7fe7657d8640 1 -- start start 2024-09-19T09:42:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe7657d8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe7580dcd90 0x7fe758045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe7657d8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75804a680 0x7fe75804aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe7657d8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7580e5f30 0x7fe7580e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe7657d8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe758044d40 con 0x7fe7580e5f30 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe7657d8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fe7580dd170 con 0x7fe7580dcd90 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe7657d8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe7580e6d30 con 0x7fe75804a680 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.191+0000 7fe75f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7580e5f30 0x7fe7580e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7580e5f30 0x7fe7580e63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60226/0 (socket says 172.21.15.123:60226) 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75effd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe7580dcd90 0x7fe758045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 -- 172.21.15.123:0/1704871706 learned_addr learned my addr 172.21.15.123:0/1704871706 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fb9267fc640 1 -- 172.21.15.123:0/2356538956 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c03a070 con 0x7fb928072580 2024-09-19T09:42:49.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75e7fc640 1 --2- 172.21.15.123:0/1704871706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75804a680 0x7fe75804aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4bb467640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac050470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4bb467640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff4ac0e1b90 0x7ff4ac0e2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4bb467640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4ac0e2640 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4bb467640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ac049b10 con 0x7ff4ac0e1b90 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4bb467640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac0e2920 con 0x7ff4ac005a00 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 -- 172.21.15.123:0/1704871706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75804a680 msgr2=0x7fe75804aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/1704871706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75804a680 0x7fe75804aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 -- 172.21.15.123:0/1704871706 >> v2:172.21.15.194:3300/0 conn(0x7fe7580dcd90 msgr2=0x7fe758045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/1704871706 >> v2:172.21.15.194:3300/0 conn(0x7fe7580dcd90 0x7fe758045d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4bac66640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff4ac0e1b90 0x7ff4ac0e2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fb9267fc640 1 -- 172.21.15.123:0/2356538956 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c033710 con 0x7fb928072580 2024-09-19T09:42:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fb9267fc640 1 -- 172.21.15.123:0/2356538956 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c033ae0 con 0x7fb928072580 2024-09-19T09:42:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4ba465640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff4ac0d8a20 0x7ff4ac04a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58836/0 (socket says 172.21.15.123:58836) 2024-09-19T09:42:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4ba465640 1 -- 172.21.15.123:0/3802869757 learned_addr learned my addr 172.21.15.123:0/3802869757 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7ff4b9c64640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac050470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.192+0000 7fe75f7fe640 1 -- 172.21.15.123:0/1704871706 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe758044f90 con 0x7fe7580e5f30 2024-09-19T09:42:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7fb2577fe640 1 --2- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250046950 0x7fb250046d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2440097a0 tx=0x7fb24402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65fccb42d7177994 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7fb92dca6640 1 -- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb928072580 msgr2=0x7fb928072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7fb92dca6640 1 --2- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb928072580 0x7fb928072a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009fb0 tx=0x7fb91c02e750 comp rx=0 tx=0).stop 2024-09-19T09:42:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7fb2567fc640 1 -- 172.21.15.123:0/870574737 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244037070 con 0x7fb250046950 2024-09-19T09:42:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7fb2567fc640 1 -- 172.21.15.123:0/870574737 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb244032440 con 0x7fb250046950 2024-09-19T09:42:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7fb2567fc640 1 -- 172.21.15.123:0/870574737 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244032850 con 0x7fb250046950 2024-09-19T09:42:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7ff4bac66640 1 -- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 msgr2=0x7ff4ac050470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7ff4bac66640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac050470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7ff4bac66640 1 -- 172.21.15.123:0/3802869757 >> v1:172.21.15.123:6789/0 conn(0x7ff4ac0d8a20 legacy=0x7ff4ac04a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7ff4bac66640 1 -- 172.21.15.123:0/3802869757 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac049d60 con 0x7ff4ac0e1b90 2024-09-19T09:42:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.193+0000 7ff4b9c64640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac050470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/1704871706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7580e5f30 0x7fe7580e63c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe76006a090 tx=0x7fe7600a7320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0e2e9553f1be2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fe75dffb640 1 -- 172.21.15.123:0/1704871706 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600b4070 con 0x7fe7580e5f30 2024-09-19T09:42:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7ff4bac66640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 0x7ff4ac0e2020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4051220 tx=0x7ff4b40a7270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2416241842df5f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fe75dffb640 1 -- 172.21.15.123:0/1704871706 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600af680 con 0x7fe7580e5f30 2024-09-19T09:42:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fe75dffb640 1 -- 172.21.15.123:0/1704871706 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600afaf0 con 0x7fe7580e5f30 2024-09-19T09:42:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fb25ce2b640 1 -- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250046950 msgr2=0x7fb250046d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250046950 0x7fb250046d30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2440097a0 tx=0x7fb24402a250 comp rx=0 tx=0).stop 2024-09-19T09:42:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fb92dca6640 1 -- 172.21.15.123:0/2356538956 shutdown_connections 2024-09-19T09:42:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fb92dca6640 1 --2- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb928072580 0x7fb928072a30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fb92dca6640 1 --2- 172.21.15.123:0/2356538956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb92815a760 0x7fb9281571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7fb92dca6640 1 -- 172.21.15.123:0/2356538956 >> 172.21.15.123:0/2356538956 conn(0x7fb92806ed00 msgr2=0x7fb92806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7f047539f640 1 Processor -- start 2024-09-19T09:42:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7ff4b9463640 1 -- 172.21.15.123:0/3802869757 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40b4070 con 0x7ff4ac0e1b90 2024-09-19T09:42:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7f047539f640 1 -- start start 2024-09-19T09:42:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7ff4b9463640 1 -- 172.21.15.123:0/3802869757 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b40af440 con 0x7ff4ac0e1b90 2024-09-19T09:42:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.194+0000 7ff4b9463640 1 -- 172.21.15.123:0/3802869757 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40af8b0 con 0x7ff4ac0e1b90 2024-09-19T09:42:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7fb25ce2b640 1 -- 172.21.15.123:0/870574737 shutdown_connections 2024-09-19T09:42:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250047490 0x7fb2500ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/870574737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250046950 0x7fb250046d30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7fb25ce2b640 1 -- 172.21.15.123:0/870574737 >> 172.21.15.123:0/870574737 conn(0x7fb250050d60 msgr2=0x7fb250051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7fb25ce2b640 1 -- 172.21.15.123:0/870574737 shutdown_connections 2024-09-19T09:42:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7fb25ce2b640 1 -- 172.21.15.123:0/870574737 wait complete. 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7ff4bb467640 1 -- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 msgr2=0x7ff4ac0e2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7ff4bb467640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 0x7ff4ac0e2020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4051220 tx=0x7ff4b40a7270 comp rx=0 tx=0).stop 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7ff4bb467640 1 -- 172.21.15.123:0/3802869757 shutdown_connections 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7ff4bb467640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 0x7ff4ac0e2020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7ff4bb467640 1 --2- 172.21.15.123:0/3802869757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac050470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.195+0000 7ff4bb467640 1 -- 172.21.15.123:0/3802869757 >> 172.21.15.123:0/3802869757 conn(0x7ff4ac054080 msgr2=0x7ff4ac054460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 -- 172.21.15.123:0/1704871706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7580e5f30 msgr2=0x7fe7580e63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 --2- 172.21.15.123:0/1704871706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7580e5f30 0x7fe7580e63c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe76006a090 tx=0x7fe7600a7320 comp rx=0 tx=0).stop 2024-09-19T09:42:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f047539f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f0470073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f047539f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0470073970 0x7f047015c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f047539f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04700c5c30 con 0x7f0470152e50 2024-09-19T09:42:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f047539f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f047015c280 con 0x7f0470073970 2024-09-19T09:42:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f047539f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f04700c5ed0 con 0x7f04700c8890 2024-09-19T09:42:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f046ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0470152e50 0x7f04700711e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58842/0 (socket says 172.21.15.123:58842) 2024-09-19T09:42:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7ff4bb467640 1 -- 172.21.15.123:0/3802869757 shutdown_connections 2024-09-19T09:42:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f046ffff640 1 -- 172.21.15.123:0/3121039381 learned_addr learned my addr 172.21.15.123:0/3121039381 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 -- 172.21.15.123:0/1704871706 shutdown_connections 2024-09-19T09:42:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 --2- 172.21.15.123:0/1704871706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7580e5f30 0x7fe7580e63c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 --2- 172.21.15.123:0/1704871706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75804a680 0x7fe75804aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 --2- 172.21.15.123:0/1704871706 >> v2:172.21.15.194:3300/0 conn(0x7fe7580dcd90 0x7fe758045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 -- 172.21.15.123:0/1704871706 >> 172.21.15.123:0/1704871706 conn(0x7fe75804fc50 msgr2=0x7fe758050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f046f7fe640 1 --2- 172.21.15.123:0/3121039381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f0470073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 -- 172.21.15.123:0/1704871706 shutdown_connections 2024-09-19T09:42:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fe7657d8640 1 -- 172.21.15.123:0/1704871706 wait complete. 2024-09-19T09:42:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7fb25ce2b640 1 Processor -- start 2024-09-19T09:42:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f046f7fe640 1 -- 172.21.15.123:0/3121039381 >> v2:172.21.15.123:3300/0 conn(0x7f0470073970 msgr2=0x7f047015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7f0474b9e640 1 --2- 172.21.15.123:0/3121039381 >> v2:172.21.15.123:3300/0 conn(0x7f0470073970 0x7f047015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7f046f7fe640 1 --2- 172.21.15.123:0/3121039381 >> v2:172.21.15.123:3300/0 conn(0x7f0470073970 0x7f047015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7f046f7fe640 1 -- 172.21.15.123:0/3121039381 >> v1:172.21.15.123:6789/0 conn(0x7f0470152e50 legacy=0x7f04700711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7fb25ce2b640 1 -- start start 2024-09-19T09:42:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7fb92dca6640 1 -- 172.21.15.123:0/2356538956 shutdown_connections 2024-09-19T09:42:49.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.196+0000 7ff4bb467640 1 -- 172.21.15.123:0/3802869757 wait complete. 2024-09-19T09:42:49.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7f046f7fe640 1 -- 172.21.15.123:0/3121039381 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04700c61b0 con 0x7f04700c8890 2024-09-19T09:42:49.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7f0474b9e640 1 --2- 172.21.15.123:0/3121039381 >> v2:172.21.15.123:3300/0 conn(0x7f0470073970 0x7f047015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:49.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.198+0000 7ff4bb467640 1 Processor -- start 2024-09-19T09:42:49.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.198+0000 7fb25ce2b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 0x7fb2500c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.198+0000 7fb25ce2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250046950 0x7fb2500be470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.198+0000 7fe7657d8640 1 Processor -- start 2024-09-19T09:42:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.198+0000 7fb25ce2b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250047490 0x7fb2500be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb25ce2b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb25004b6e0 con 0x7fb2500068c0 2024-09-19T09:42:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fe7657d8640 1 -- start start 2024-09-19T09:42:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb2577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 0x7fb2500c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.198+0000 7ff4bb467640 1 -- start start 2024-09-19T09:42:49.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb2577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 0x7fb2500c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60232/0 (socket says 172.21.15.123:60232) 2024-09-19T09:42:49.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7f046f7fe640 1 --2- 172.21.15.123:0/3121039381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f0470073430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f04600097a0 tx=0x7f046002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d4bf79257bf092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb2577fe640 1 -- 172.21.15.123:0/288902427 learned_addr learned my addr 172.21.15.123:0/288902427 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb256ffd640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250046950 0x7fb2500be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.197+0000 7fb92dca6640 1 -- 172.21.15.123:0/2356538956 wait complete. 2024-09-19T09:42:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7ff4bb467640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac0e1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7ff4bb467640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 0x7ff4ac0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb257fff640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250047490 0x7fb2500be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7f046effd640 1 -- 172.21.15.123:0/3121039381 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460037070 con 0x7f04700c8890 2024-09-19T09:42:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb250007d30 con 0x7fb250047490 2024-09-19T09:42:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7f046effd640 1 -- 172.21.15.123:0/3121039381 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0460032440 con 0x7f04700c8890 2024-09-19T09:42:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb25004b860 con 0x7fb250046950 2024-09-19T09:42:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7f046effd640 1 -- 172.21.15.123:0/3121039381 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460037070 con 0x7f04700c8890 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7ff4bb467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 0x7ff4ac0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7ff4bb467640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac04ef20 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7ff4bb467640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac04a320 con 0x7ff4ac0e1b90 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7ff4bb467640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac04f0a0 con 0x7ff4ac005a00 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 0x7ff4ac0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 0x7ff4ac0cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60234/0 (socket says 172.21.15.123:60234) 2024-09-19T09:42:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 -- 172.21.15.123:0/4110385851 learned_addr learned my addr 172.21.15.123:0/4110385851 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.199+0000 7fb92dca6640 1 Processor -- start 2024-09-19T09:42:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fb92dca6640 1 -- start start 2024-09-19T09:42:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fe7657d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75804a680 0x7fe7580c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7f047539f640 1 -- 172.21.15.123:0/3121039381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 msgr2=0x7f0470073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 -- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 msgr2=0x7ff4ac0e1330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7f047539f640 1 --2- 172.21.15.123:0/3121039381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f0470073430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f04600097a0 tx=0x7f046002a110 comp rx=0 tx=0).stop 2024-09-19T09:42:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fb2577fe640 1 -- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250046950 msgr2=0x7fb2500be470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7f047539f640 1 -- 172.21.15.123:0/3121039381 shutdown_connections 2024-09-19T09:42:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7f047539f640 1 --2- 172.21.15.123:0/3121039381 >> v2:172.21.15.123:3300/0 conn(0x7f0470073970 0x7f047015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4ba465640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac0e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac0e1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 -- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 msgr2=0x7ff4ac0c5920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 0x7ff4ac0c5920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7f047539f640 1 --2- 172.21.15.123:0/3121039381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f0470073430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7ff4b9c64640 1 -- 172.21.15.123:0/4110385851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac0c7350 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7f047539f640 1 -- 172.21.15.123:0/3121039381 >> 172.21.15.123:0/3121039381 conn(0x7f04700cb580 msgr2=0x7f04700cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fb2577fe640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250046950 0x7fb2500be470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7f047539f640 1 -- 172.21.15.123:0/3121039381 shutdown_connections 2024-09-19T09:42:49.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7f047539f640 1 -- 172.21.15.123:0/3121039381 wait complete. 2024-09-19T09:42:49.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fb2577fe640 1 -- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250047490 msgr2=0x7fb2500be9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fb2577fe640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250047490 0x7fb2500be9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb92dca6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb928072580 0x7fb928148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb92dca6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb928151520 0x7fb9281efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.200+0000 7fb2577fe640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb250035e50 con 0x7fb2500068c0 2024-09-19T09:42:49.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb92dca6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb92815a760 0x7fb9281ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb92dca6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb928071d80 con 0x7fb928072580 2024-09-19T09:42:49.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb2577fe640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 0x7fb2500c27c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb244035040 tx=0x7fb2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb92dca6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb928157e40 con 0x7fb92815a760 2024-09-19T09:42:49.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb92dca6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb9280c6c10 con 0x7fb928151520 2024-09-19T09:42:49.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb928151520 0x7fb9281efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb928151520 0x7fb9281efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49502/0 (socket says 172.21.15.123:49502) 2024-09-19T09:42:49.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb926ffd640 1 -- 172.21.15.123:0/3821334188 learned_addr learned my addr 172.21.15.123:0/3821334188 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb9277fe640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb928072580 0x7fb928148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7ff4b9c64640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 0x7ff4ac0cd110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400e7e0 tx=0x7ff4a400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fe75effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75804a680 0x7fe7580c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fe75effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75804a680 0x7fe7580c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60250/0 (socket says 172.21.15.123:60250) 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fe75effd640 1 -- 172.21.15.123:0/2581523002 learned_addr learned my addr 172.21.15.123:0/2581523002 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fe7657d8640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7580dcd90 0x7fe7580c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fe7657d8640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7580e5f30 0x7fe7580e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fb9277fe640 1 -- 172.21.15.123:0/3821334188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb928151520 msgr2=0x7fb9281efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fb9277fe640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb928151520 0x7fb9281efd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fb9277fe640 1 -- 172.21.15.123:0/3821334188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb92815a760 msgr2=0x7fb9281ee2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fb9277fe640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb92815a760 0x7fb9281ee2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fb9277fe640 1 -- 172.21.15.123:0/3821334188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9280c6390 con 0x7fb928072580 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe7657d8640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe758045830 con 0x7fe75804a680 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe7657d8640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe758045550 con 0x7fe7580e5f30 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe7657d8640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe7580e2be0 con 0x7fe7580dcd90 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7580e5f30 0x7fe7580e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 -- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7580dcd90 msgr2=0x7fe7580c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7580dcd90 0x7fe7580c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 -- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75804a680 msgr2=0x7fe7580c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75804a680 0x7fe7580c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7580ca000 con 0x7fe7580e5f30 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7fe75f7fe640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7580e5f30 0x7fe7580e1cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe7600518b0 tx=0x7fe7600749f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244041030 con 0x7fb2500068c0 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24403d4e0 con 0x7fb2500068c0 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244037040 con 0x7fb2500068c0 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2500c0fd0 con 0x7fb2500068c0 2024-09-19T09:42:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.203+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2500c3c80 con 0x7fb2500068c0 2024-09-19T09:42:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7f047539f640 1 Processor -- start 2024-09-19T09:42:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.201+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4017070 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ac0c75f0 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a400c7f0 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.202+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4021060 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.203+0000 7f047539f640 1 -- start start 2024-09-19T09:42:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.203+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ac0c7bb0 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.203+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600b4040 con 0x7fe7580e5f30 2024-09-19T09:42:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.203+0000 7fe7657d8640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7580e3b20 con 0x7fe7580e5f30 2024-09-19T09:42:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.203+0000 7fe7657d8640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7580c62c0 con 0x7fe7580e5f30 2024-09-19T09:42:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7f047539f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0470073970 0x7f0470159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7f047539f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f04701543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7f047539f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 0x7f047006e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7f047539f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04700706f0 con 0x7f0470073970 2024-09-19T09:42:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7f047539f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f04700c6770 con 0x7f0470152e50 2024-09-19T09:42:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7f047539f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0470153230 con 0x7f04700c8890 2024-09-19T09:42:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.204+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600af440 con 0x7fe7580e5f30 2024-09-19T09:42:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.205+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600afaf0 con 0x7fe7580e5f30 2024-09-19T09:42:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.205+0000 7f0474b9e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 0x7f047006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.205+0000 7f0474b9e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 0x7f047006e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56190/0 (socket says 172.21.15.123:56190) 2024-09-19T09:42:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.205+0000 7f0474b9e640 1 -- 172.21.15.123:0/3762892834 learned_addr learned my addr 172.21.15.123:0/3762892834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7f046f7fe640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f04701543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7fb9277fe640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb928072580 0x7fb928148ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c390 tx=0x7fb91800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7580e5900 con 0x7fe7580e5f30 2024-09-19T09:42:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7f0474b9e640 1 -- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 msgr2=0x7f04701543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7f0474b9e640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f04701543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7f0474b9e640 1 -- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0470073970 msgr2=0x7f0470159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7f0474b9e640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0470073970 0x7f0470159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7f0474b9e640 1 -- 172.21.15.123:0/3762892834 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0470156d50 con 0x7f0470152e50 2024-09-19T09:42:49.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7600c1030 con 0x7fe7580e5f30 2024-09-19T09:42:49.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff4a401a070 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb244044070 con 0x7fb2500068c0 2024-09-19T09:42:49.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7f0474b9e640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 0x7f047006e050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f046800cd50 tx=0x7f046800a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.206+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ac0e2020 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918017070 con 0x7fb928072580 2024-09-19T09:42:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7ff4aaffd640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff49806c2b0 0x7ff49806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7fb92dca6640 1 -- 172.21.15.123:0/3821334188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9280c6930 con 0x7fb928072580 2024-09-19T09:42:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7fb92dca6640 1 -- 172.21.15.123:0/3821334188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9281f06f0 con 0x7fb928072580 2024-09-19T09:42:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb250033660 con 0x7fb2500068c0 2024-09-19T09:42:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff4a408b420 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7ff4ba465640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff49806c2b0 0x7ff49806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.207+0000 7fb243fff640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb23c06c380 0x7fb23c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.208+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb2440aba20 con 0x7fb2500068c0 2024-09-19T09:42:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.208+0000 7fb256ffd640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb23c06c380 0x7fb23c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.208+0000 7fe7477fe640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe74c06c380 0x7fe74c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.208+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb908005290 con 0x7fb928072580 2024-09-19T09:42:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7ff4ba465640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff49806c2b0 0x7ff49806e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0005880 tx=0x7ff4b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7fe75effd640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe74c06c380 0x7fe74c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe760127fd0 con 0x7fe7580e5f30 2024-09-19T09:42:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7fb256ffd640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb23c06c380 0x7fb23c06e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb25802dd50 tx=0x7fb25806e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9180052d0 con 0x7fb928072580 2024-09-19T09:42:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918003830 con 0x7fb928072580 2024-09-19T09:42:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.209+0000 7fe75effd640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe74c06c380 0x7fe74c06e840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe750007a60 tx=0x7fe750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.210+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb91801a070 con 0x7fb928072580 2024-09-19T09:42:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046800f680 con 0x7f0470152e50 2024-09-19T09:42:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046800f840 con 0x7f0470152e50 2024-09-19T09:42:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046800fc30 con 0x7f0470152e50 2024-09-19T09:42:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0470153620 con 0x7f0470152e50 2024-09-19T09:42:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0470153be0 con 0x7f0470152e50 2024-09-19T09:42:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7fb90ffff640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb91406c380 0x7fb91406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.212+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb91808a8d0 con 0x7fb928072580 2024-09-19T09:42:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.211+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe7580e5900 con 0x7fe7580e5f30 2024-09-19T09:42:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.212+0000 7fb926ffd640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb91406c380 0x7fb91406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.212+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0470156900 con 0x7f0470152e50 2024-09-19T09:42:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.213+0000 7fb926ffd640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb91406c380 0x7fb91406e840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb928071460 tx=0x7fb92000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.213+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f04680213f0 con 0x7f0470152e50 2024-09-19T09:42:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.214+0000 7f046cff9640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f045c06c300 0x7f045c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.214+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f046808c180 con 0x7f0470152e50 2024-09-19T09:42:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.214+0000 7f046ffff640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f045c06c300 0x7f045c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.215+0000 7f046ffff640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f045c06c300 0x7f045c06e7c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0464005880 tx=0x7f0464007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.218+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0470156900 con 0x7f0470152e50 2024-09-19T09:42:49.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.218+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb244079c40 con 0x7fb2500068c0 2024-09-19T09:42:49.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.228+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb918021080 con 0x7fb928072580 2024-09-19T09:42:49.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.237+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff4a4059b10 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.267+0000 7f50c0e8d640 1 Processor -- start 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.267+0000 7f50c0e8d640 1 -- start start 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.268+0000 7f50c0e8d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc06d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.268+0000 7f50c0e8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50bc06bc10 0x7f50bc160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.268+0000 7f50c0e8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50bc15f5c0 con 0x7f50bc162bb0 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.268+0000 7f50c0e8d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50bc15fbb0 con 0x7f50bc06bc10 2024-09-19T09:42:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.268+0000 7f50c0e8d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f50bc160580 con 0x7f50bc1598c0 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.269+0000 7f50bad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50bc162bb0 0x7f50bc067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58858/0 (socket says 172.21.15.123:58858) 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.269+0000 7f50bad9d640 1 -- 172.21.15.123:0/3797186525 learned_addr learned my addr 172.21.15.123:0/3797186525 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.269+0000 7f50ba59c640 1 --2- 172.21.15.123:0/3797186525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.269+0000 7f50b9d9b640 1 --2- 172.21.15.123:0/3797186525 >> v2:172.21.15.123:3300/0 conn(0x7f50bc06bc10 0x7f50bc160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.270+0000 7f50b9d9b640 1 -- 172.21.15.123:0/3797186525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 msgr2=0x7f50bc06d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.270+0000 7f50b9d9b640 1 --2- 172.21.15.123:0/3797186525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc06d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.270+0000 7f50b9d9b640 1 -- 172.21.15.123:0/3797186525 >> v1:172.21.15.123:6789/0 conn(0x7f50bc162bb0 legacy=0x7f50bc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.270+0000 7f50b9d9b640 1 -- 172.21.15.123:0/3797186525 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc159ca0 con 0x7f50bc06bc10 2024-09-19T09:42:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.271+0000 7f50b9d9b640 1 --2- 172.21.15.123:0/3797186525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc160040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097a0 tx=0x7f50b002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac82164a6f0b352 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.272+0000 7f50b959a640 1 -- 172.21.15.123:0/3797186525 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0037070 con 0x7f50bc06bc10 2024-09-19T09:42:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.272+0000 7f50b959a640 1 -- 172.21.15.123:0/3797186525 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b002adc0 con 0x7f50bc06bc10 2024-09-19T09:42:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.272+0000 7f50b959a640 1 -- 172.21.15.123:0/3797186525 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0032660 con 0x7f50bc06bc10 2024-09-19T09:42:49.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.273+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3797186525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 msgr2=0x7f50bc160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.273+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3797186525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc160040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097a0 tx=0x7f50b002a130 comp rx=0 tx=0).stop 2024-09-19T09:42:49.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.273+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3797186525 shutdown_connections 2024-09-19T09:42:49.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.273+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3797186525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc160040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.273+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3797186525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc06d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.273+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3797186525 >> 172.21.15.123:0/3797186525 conn(0x7f50bc0703e0 msgr2=0x7f50bc0cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.274+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3797186525 shutdown_connections 2024-09-19T09:42:49.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.274+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3797186525 wait complete. 2024-09-19T09:42:49.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.276+0000 7f50c0e8d640 1 Processor -- start 2024-09-19T09:42:49.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.276+0000 7f50c0e8d640 1 -- start start 2024-09-19T09:42:49.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50c0e8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50c0e8d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50c0e8d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 0x7f50bc132000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50c0e8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc163970 con 0x7f50bc06bc10 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50c0e8d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc163690 con 0x7f50bc162bb0 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50c0e8d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f50bc15f840 con 0x7f50bc1598c0 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50bad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 0x7f50bc132000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50bad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 0x7f50bc132000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56192/0 (socket says 172.21.15.123:56192) 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50bad9d640 1 -- 172.21.15.123:0/3437749677 learned_addr learned my addr 172.21.15.123:0/3437749677 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.277+0000 7f50ba59c640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50bad9d640 1 -- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 msgr2=0x7f50bc0cd230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50bad9d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc0cd230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50bad9d640 1 -- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 msgr2=0x7f50bc147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50bad9d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50bad9d640 1 -- 172.21.15.123:0/3437749677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc14cb90 con 0x7f50bc162bb0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50ba59c640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.278+0000 7f50bad9d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 0x7f50bc132000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c700 tx=0x7f50b400cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.279+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4018070 con 0x7f50bc162bb0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.279+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40074e0 con 0x7f50bc162bb0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.279+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40049e0 con 0x7f50bc162bb0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.279+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc0cc050 con 0x7f50bc162bb0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.279+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc0cc2f0 con 0x7f50bc162bb0 2024-09-19T09:42:49.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.282+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a0005290 con 0x7f50bc162bb0 2024-09-19T09:42:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.282+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50b4004b80 con 0x7f50bc162bb0 2024-09-19T09:42:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.283+0000 7f50aaffd640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f509c06c2b0 0x7f509c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.283+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f50b408a8f0 con 0x7f50bc162bb0 2024-09-19T09:42:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.283+0000 7f50ba59c640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f509c06c2b0 0x7f509c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.284+0000 7f50ba59c640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f509c06c2b0 0x7f509c06e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e740 tx=0x7f50ac00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:49.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.291+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f50bc15f5c0 con 0x7f50bc162bb0 2024-09-19T09:42:49.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.528+0000 7f504f59e640 1 -- 172.21.15.123:0/1239619280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5034005850 con 0x7f50380051c0 2024-09-19T09:42:49.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.529+0000 7f503effd640 1 -- 172.21.15.123:0/1239619280 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f504005a870 con 0x7f50380051c0 2024-09-19T09:42:49.530 INFO:teuthology.orchestra.run.smithi123.stdout:64424509446 2024-09-19T09:42:49.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.532+0000 7f503cff9640 1 -- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f503006c3b0 msgr2=0x7f503006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.532+0000 7f503cff9640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f503006c3b0 0x7f503006e870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f505014cf10 tx=0x7f5044008040 comp rx=0 tx=0).stop 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.532+0000 7f503cff9640 1 -- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 msgr2=0x7f505014ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.532+0000 7f503cff9640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f505014ff30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f504000f910 tx=0x7f504000fdd0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.532+0000 7f503cff9640 1 -- 172.21.15.123:0/1239619280 shutdown_connections 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5050147e60 0x7f50500c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5050072dd0 0x7f5050070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f503006c3b0 0x7f503006e870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 --2- 172.21.15.123:0/1239619280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50380051c0 0x7f505014ff30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 -- 172.21.15.123:0/1239619280 >> 172.21.15.123:0/1239619280 conn(0x7f50500c9100 msgr2=0x7f50500cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 -- 172.21.15.123:0/1239619280 shutdown_connections 2024-09-19T09:42:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.533+0000 7f503cff9640 1 -- 172.21.15.123:0/1239619280 wait complete. 2024-09-19T09:42:49.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-19T09:42:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.572+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0ff0005850 con 0x7f1010151160 2024-09-19T09:42:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.573+0000 7f1005ffb640 1 -- 172.21.15.123:0/3094800678 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f100807b3a0 con 0x7f1010151160 2024-09-19T09:42:49.575 INFO:teuthology.orchestra.run.smithi123.stdout:64424509449 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0ff406c3b0 msgr2=0x7f0ff406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0ff406c3b0 0x7f0ff406e870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f100c006fd0 tx=0x7f100c0090e0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 msgr2=0x7f10100728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 0x7f10100728e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f100800d3c0 tx=0x7f1008004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 shutdown_connections 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0ff406c3b0 0x7f0ff406e870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f101015aa10 0x7f101014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1010151160 0x7f10100728e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 --2- 172.21.15.123:0/3094800678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f101006cd10 0x7f10100cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 >> 172.21.15.123:0/3094800678 conn(0x7f10100c9100 msgr2=0x7f10100c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 shutdown_connections 2024-09-19T09:42:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.576+0000 7f1016544640 1 -- 172.21.15.123:0/3094800678 wait complete. 2024-09-19T09:42:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.584+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb908005850 con 0x7fb928072580 2024-09-19T09:42:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.585+0000 7fb90ffff640 1 -- 172.21.15.123:0/3821334188 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb918058b10 con 0x7fb928072580 2024-09-19T09:42:49.587 INFO:teuthology.orchestra.run.smithi123.stdout:64424509448 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb91406c380 msgr2=0x7fb91406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb91406c380 0x7fb91406e840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb928071460 tx=0x7fb92000b040 comp rx=0 tx=0).stop 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb928072580 msgr2=0x7fb928148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb928072580 0x7fb928148ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c390 tx=0x7fb91800c850 comp rx=0 tx=0).stop 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 shutdown_connections 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb92815a760 0x7fb9281ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.587+0000 7fb90dffb640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb91406c380 0x7fb91406e840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.588+0000 7fb90dffb640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb928151520 0x7fb9281efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.588+0000 7fb90dffb640 1 --2- 172.21.15.123:0/3821334188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb928072580 0x7fb928148ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.588+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 >> 172.21.15.123:0/3821334188 conn(0x7fb92806ed00 msgr2=0x7fb9280c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.588+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 shutdown_connections 2024-09-19T09:42:49.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.588+0000 7fb90dffb640 1 -- 172.21.15.123:0/3821334188 wait complete. 2024-09-19T09:42:49.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.0 2024-09-19T09:42:49.593 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.596+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe75804b1c0 con 0x7fe7580e5f30 2024-09-19T09:42:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.597+0000 7fe7477fe640 1 -- 172.21.15.123:0/2581523002 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe7600c8020 con 0x7fe7580e5f30 2024-09-19T09:42:49.599 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-19T09:42:49.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe74c06c380 msgr2=0x7fe74c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe74c06c380 0x7fe74c06e840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe750007a60 tx=0x7fe750008040 comp rx=0 tx=0).stop 2024-09-19T09:42:49.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7580e5f30 msgr2=0x7fe7580e1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7580e5f30 0x7fe7580e1cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe7600518b0 tx=0x7fe7600749f0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 shutdown_connections 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7580e5f30 0x7fe7580e1cc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe74c06c380 0x7fe74c06e840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7580dcd90 0x7fe7580c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 --2- 172.21.15.123:0/2581523002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75804a680 0x7fe7580c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 >> 172.21.15.123:0/2581523002 conn(0x7fe75804fc50 msgr2=0x7fe7580ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0470073430 con 0x7f0470152e50 2024-09-19T09:42:49.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.1 2024-09-19T09:42:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 shutdown_connections 2024-09-19T09:42:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.600+0000 7fe7457fa640 1 -- 172.21.15.123:0/2581523002 wait complete. 2024-09-19T09:42:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.601+0000 7f046cff9640 1 -- 172.21.15.123:0/3762892834 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0468014030 con 0x7f0470152e50 2024-09-19T09:42:49.605 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:49.605 INFO:teuthology.orchestra.run.smithi123.stdout:64424509447 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f045c06c300 msgr2=0x7f045c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f045c06c300 0x7f045c06e7c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0464005880 tx=0x7f0464007a00 comp rx=0 tx=0).stop 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 msgr2=0x7f047006e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 0x7f047006e050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f046800cd50 tx=0x7f046800a650 comp rx=0 tx=0).stop 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 shutdown_connections 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0470152e50 0x7f047006e050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f045c06c300 0x7f045c06e7c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04700c8890 0x7f04701543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 --2- 172.21.15.123:0/3762892834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0470073970 0x7f0470159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 >> 172.21.15.123:0/3762892834 conn(0x7f04700cb580 msgr2=0x7f04700ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 shutdown_connections 2024-09-19T09:42:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.603+0000 7f047539f640 1 -- 172.21.15.123:0/3762892834 wait complete. 2024-09-19T09:42:49.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.613+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb250046730 con 0x7fb2500068c0 2024-09-19T09:42:49.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.613+0000 7fb243fff640 1 -- 172.21.15.123:0/288902427 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb24407df40 con 0x7fb2500068c0 2024-09-19T09:42:49.615 INFO:teuthology.orchestra.run.smithi123.stdout:64424509448 2024-09-19T09:42:49.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2024-09-19T09:42:49.617 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:49.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-09-19T09:42:49.619 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb23c06c380 msgr2=0x7fb23c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb23c06c380 0x7fb23c06e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb25802dd50 tx=0x7fb25806e040 comp rx=0 tx=0).stop 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 msgr2=0x7fb2500c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 0x7fb2500c27c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb244035040 tx=0x7fb2440046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 shutdown_connections 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb250047490 0x7fb2500be9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb23c06c380 0x7fb23c06e840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb250046950 0x7fb2500be470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 --2- 172.21.15.123:0/288902427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2500068c0 0x7fb2500c27c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 >> 172.21.15.123:0/288902427 conn(0x7fb250050d60 msgr2=0x7fb2500da790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 shutdown_connections 2024-09-19T09:42:49.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.616+0000 7fb25ce2b640 1 -- 172.21.15.123:0/288902427 wait complete. 2024-09-19T09:42:49.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.5 2024-09-19T09:42:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.630+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff4ac051240 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.631+0000 7ff4aaffd640 1 -- 172.21.15.123:0/4110385851 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4a4059410 con 0x7ff4ac0d8a20 2024-09-19T09:42:49.633 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:49.633 INFO:teuthology.orchestra.run.smithi123.stdout:64424509449 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff49806c2b0 msgr2=0x7ff49806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff49806c2b0 0x7ff49806e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0005880 tx=0x7ff4b0009040 comp rx=0 tx=0).stop 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 msgr2=0x7ff4ac0cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 0x7ff4ac0cd110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400e7e0 tx=0x7ff4a400eca0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 shutdown_connections 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ac0e1b90 0x7ff4ac0c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ac0d8a20 0x7ff4ac0cd110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff49806c2b0 0x7ff49806e770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 --2- 172.21.15.123:0/4110385851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ac005a00 0x7ff4ac0e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 >> 172.21.15.123:0/4110385851 conn(0x7ff4ac054080 msgr2=0x7ff4ac0064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 shutdown_connections 2024-09-19T09:42:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.633+0000 7ff4bb467640 1 -- 172.21.15.123:0/4110385851 wait complete. 2024-09-19T09:42:49.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.643+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f50a0005580 con 0x7f50bc162bb0 2024-09-19T09:42:49.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.644+0000 7f50aaffd640 1 -- 172.21.15.123:0/3437749677 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50b4058a00 con 0x7f50bc162bb0 2024-09-19T09:42:49.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.7 2024-09-19T09:42:49.646 INFO:teuthology.orchestra.run.smithi123.stdout:64424509446 2024-09-19T09:42:49.647 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f509c06c2b0 msgr2=0x7f509c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f509c06c2b0 0x7f509c06e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e740 tx=0x7f50ac00b040 comp rx=0 tx=0).stop 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 msgr2=0x7f50bc132000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 0x7f50bc132000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c700 tx=0x7f50b400cbc0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 shutdown_connections 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50bc162bb0 0x7f50bc132000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f509c06c2b0 0x7f509c06e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50bc1598c0 0x7f50bc0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 --2- 172.21.15.123:0/3437749677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50bc06bc10 0x7f50bc147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 >> 172.21.15.123:0/3437749677 conn(0x7f50bc0703e0 msgr2=0x7f50bc0c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 shutdown_connections 2024-09-19T09:42:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:49.646+0000 7f50c0e8d640 1 -- 172.21.15.123:0/3437749677 wait complete. 2024-09-19T09:42:49.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2024-09-19T09:42:49.658 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:50.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T09:42:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.671+0000 7fc958e65640 1 Processor -- start 2024-09-19T09:42:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.672+0000 7fc958e65640 1 -- start start 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc958e65640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc95406cc20 0x7fc95406d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc958e65640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc958e65640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95415eb50 con 0x7fc95415e680 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc958e65640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc95415f650 con 0x7fc95406cc20 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc958e65640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc95415edf0 con 0x7fc95415b780 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc95406cc20 0x7fc95406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc95406cc20 0x7fc95406d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60276/0 (socket says 172.21.15.123:60276) 2024-09-19T09:42:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 -- 172.21.15.123:0/1254633388 learned_addr learned my addr 172.21.15.123:0/1254633388 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc952d9d640 1 --2- 172.21.15.123:0/1254633388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 -- 172.21.15.123:0/1254633388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 msgr2=0x7fc95415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 --2- 172.21.15.123:0/1254633388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 -- 172.21.15.123:0/1254633388 >> v1:172.21.15.194:6789/0 conn(0x7fc95415e680 legacy=0x7fc95406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.673+0000 7fc95259c640 1 -- 172.21.15.123:0/1254633388 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95415f090 con 0x7fc95406cc20 2024-09-19T09:42:50.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.674+0000 7fc95259c640 1 --2- 172.21.15.123:0/1254633388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc95406d000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc94402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6215bc2b79c1761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.674+0000 7fc95159a640 1 -- 172.21.15.123:0/1254633388 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944037070 con 0x7fc95406cc20 2024-09-19T09:42:50.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.674+0000 7fc95159a640 1 -- 172.21.15.123:0/1254633388 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944032440 con 0x7fc95406cc20 2024-09-19T09:42:50.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.674+0000 7fc95159a640 1 -- 172.21.15.123:0/1254633388 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944032810 con 0x7fc95406cc20 2024-09-19T09:42:50.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 -- 172.21.15.123:0/1254633388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 msgr2=0x7fc95406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 --2- 172.21.15.123:0/1254633388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc95406d000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc94402a2a0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 -- 172.21.15.123:0/1254633388 shutdown_connections 2024-09-19T09:42:50.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 --2- 172.21.15.123:0/1254633388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 --2- 172.21.15.123:0/1254633388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc95406d000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 -- 172.21.15.123:0/1254633388 >> 172.21.15.123:0/1254633388 conn(0x7fc95406dc50 msgr2=0x7fc95406e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 -- 172.21.15.123:0/1254633388 shutdown_connections 2024-09-19T09:42:50.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.675+0000 7fc958e65640 1 -- 172.21.15.123:0/1254633388 wait complete. 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.676+0000 7fc958e65640 1 Processor -- start 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.676+0000 7fc958e65640 1 -- start start 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc958e65640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc9541f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc958e65640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc958e65640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc95415e680 0x7fc95415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc958e65640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc954155770 con 0x7fc95406cc20 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc958e65640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9541555f0 con 0x7fc95415e680 2024-09-19T09:42:50.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc958e65640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc954072c30 con 0x7fc95415b780 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc9541f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc9541f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60278/0 (socket says 172.21.15.123:60278) 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 -- 172.21.15.123:0/2238335744 learned_addr learned my addr 172.21.15.123:0/2238335744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc952d9d640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc95415e680 0x7fc95415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc951d9b640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 -- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 msgr2=0x7fc95415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 -- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc95415e680 msgr2=0x7fc95415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc95415e680 0x7fc95415dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.677+0000 7fc95259c640 1 -- 172.21.15.123:0/2238335744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95415c4b0 con 0x7fc95406cc20 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.678+0000 7fc95259c640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc9541f1ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc9440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.678+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944037040 con 0x7fc95406cc20 2024-09-19T09:42:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.678+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944042070 con 0x7fc95406cc20 2024-09-19T09:42:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.678+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95415c790 con 0x7fc95406cc20 2024-09-19T09:42:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.678+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944030bb0 con 0x7fc95406cc20 2024-09-19T09:42:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.678+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95415d5a0 con 0x7fc95406cc20 2024-09-19T09:42:50.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.679+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95415bbd0 con 0x7fc95406cc20 2024-09-19T09:42:50.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.679+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc944047460 con 0x7fc95406cc20 2024-09-19T09:42:50.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.680+0000 7fc94affd640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc93406c2b0 0x7fc93406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.680+0000 7fc951d9b640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc93406c2b0 0x7fc93406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.680+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc9440ac0a0 con 0x7fc95406cc20 2024-09-19T09:42:50.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.680+0000 7fc951d9b640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc93406c2b0 0x7fc93406e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc93c006fd0 tx=0x7fc93c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.684+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc944045360 con 0x7fc95406cc20 2024-09-19T09:42:50.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.850+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc954158ab0 con 0x7fc95406cc20 2024-09-19T09:42:50.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.850+0000 7fc94affd640 1 -- 172.21.15.123:0/2238335744 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc94407a810 con 0x7fc95406cc20 2024-09-19T09:42:50.852 INFO:teuthology.orchestra.run.smithi123.stdout:64424509448 2024-09-19T09:42:50.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc93406c2b0 msgr2=0x7fc93406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc93406c2b0 0x7fc93406e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc93c006fd0 tx=0x7fc93c008040 comp rx=0 tx=0).stop 2024-09-19T09:42:50.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 msgr2=0x7fc9541f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc9541f1ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc944009870 tx=0x7fc9440046c0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 shutdown_connections 2024-09-19T09:42:50.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc95415e680 0x7fc95415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc93406c2b0 0x7fc93406e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc95415b780 0x7fc95415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 --2- 172.21.15.123:0/2238335744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc95406cc20 0x7fc9541f1ba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 >> 172.21.15.123:0/2238335744 conn(0x7fc95406dc50 msgr2=0x7fc9540c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 shutdown_connections 2024-09-19T09:42:50.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.852+0000 7fc958e65640 1 -- 172.21.15.123:0/2238335744 wait complete. 2024-09-19T09:42:50.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.3 2024-09-19T09:42:50.865 DEBUG:teuthology.parallel:result is None 2024-09-19T09:42:50.865 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:42:50.865 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:50.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.960+0000 7fe6fbb78640 1 Processor -- start 2024-09-19T09:42:50.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.961+0000 7fe6fbb78640 1 -- start start 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.961+0000 7fe6fbb78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.961+0000 7fe6fbb78640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6f40c8400 0x7fe6f40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.961+0000 7fe6fbb78640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f415c240 con 0x7fe6f4155650 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.961+0000 7fe6fbb78640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f4155a30 con 0x7fe6f40c8400 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.961+0000 7fe6fbb78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f415b3e0 con 0x7fe6f40c7f40 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6f40c8400 0x7fe6f40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6f9914640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe6f4155650 0x7fe6f40cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58870/0 (socket says 172.21.15.123:58870) 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6f40c8400 0x7fe6f40cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60282/0 (socket says 172.21.15.123:60282) 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6f9914640 1 -- 172.21.15.123:0/637576530 learned_addr learned my addr 172.21.15.123:0/637576530 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 -- 172.21.15.123:0/637576530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 msgr2=0x7fe6f40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 --2- 172.21.15.123:0/637576530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 -- 172.21.15.123:0/637576530 >> v1:172.21.15.123:6789/0 conn(0x7fe6f4155650 legacy=0x7fe6f40cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 -- 172.21.15.123:0/637576530 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f415b6c0 con 0x7fe6f40c8400 2024-09-19T09:42:50.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6f8912640 1 -- 172.21.15.123:0/637576530 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950581475 0 0) 0x7fe6f415c240 con 0x7fe6f4155650 2024-09-19T09:42:50.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.962+0000 7fe6fa115640 1 --2- 172.21.15.123:0/637576530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f40c8400 0x7fe6f40cbd30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009d90 tx=0x7fe6ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9f12e360a9a72a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6f8912640 1 -- 172.21.15.123:0/637576530 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec007740 con 0x7fe6f40c8400 2024-09-19T09:42:50.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6f8912640 1 -- 172.21.15.123:0/637576530 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0078e0 con 0x7fe6f40c8400 2024-09-19T09:42:50.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6f8912640 1 -- 172.21.15.123:0/637576530 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec007cb0 con 0x7fe6f40c8400 2024-09-19T09:42:50.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 -- 172.21.15.123:0/637576530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f40c8400 msgr2=0x7fe6f40cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/637576530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f40c8400 0x7fe6f40cbd30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009d90 tx=0x7fe6ec02a660 comp rx=0 tx=0).stop 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 -- 172.21.15.123:0/637576530 shutdown_connections 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/637576530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f40c8400 0x7fe6f40cbd30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/637576530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f40cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 -- 172.21.15.123:0/637576530 >> 172.21.15.123:0/637576530 conn(0x7fe6f40cd5c0 msgr2=0x7fe6f40cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 -- 172.21.15.123:0/637576530 shutdown_connections 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.963+0000 7fe6fbb78640 1 -- 172.21.15.123:0/637576530 wait complete. 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.964+0000 7fe6fbb78640 1 Processor -- start 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.964+0000 7fe6fbb78640 1 -- start start 2024-09-19T09:42:50.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fbb78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fbb78640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6f40c8400 0x7fe6f41f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fbb78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 0x7fe6f40c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fbb78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f415bf60 con 0x7fe6f4155650 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fbb78640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f415bc80 con 0x7fe6f40c8400 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fbb78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f40ce430 con 0x7fe6f40c7f40 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 0x7fe6f40c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 0x7fe6f40c2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60284/0 (socket says 172.21.15.123:60284) 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 -- 172.21.15.123:0/1329369581 learned_addr learned my addr 172.21.15.123:0/1329369581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6f9914640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6f9113640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6f40c8400 0x7fe6f41f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 -- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 msgr2=0x7fe6f414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f414ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 -- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6f40c8400 msgr2=0x7fe6f41f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:50.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6f40c8400 0x7fe6f41f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6fa115640 1 -- 172.21.15.123:0/1329369581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f40cc710 con 0x7fe6f4155650 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6f9914640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.965+0000 7fe6f9113640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6f40c8400 0x7fe6f41f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.966+0000 7fe6fa115640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 0x7fe6f40c2ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec02ac50 tx=0x7fe6ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.966+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec040070 con 0x7fe6f4155650 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.966+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec031c90 con 0x7fe6f4155650 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.966+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec045680 con 0x7fe6f4155650 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.966+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f415ace0 con 0x7fe6f4155650 2024-09-19T09:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.966+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f41f48c0 con 0x7fe6f4155650 2024-09-19T09:42:50.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.967+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f40d0460 con 0x7fe6f4155650 2024-09-19T09:42:50.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.967+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6ec039040 con 0x7fe6f4155650 2024-09-19T09:42:50.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.968+0000 7fe6ea7fc640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe6d806c2e0 0x7fe6d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:50.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.968+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe6ec0acdd0 con 0x7fe6f4155650 2024-09-19T09:42:50.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.968+0000 7fe6f9914640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe6d806c2e0 0x7fe6d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:50.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.968+0000 7fe6f9914640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe6d806c2e0 0x7fe6d806e7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f60 tx=0x7fe6f0007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:50.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:50.972+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe6ec07b690 con 0x7fe6f4155650 2024-09-19T09:42:51.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.136+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6f40cc4c0 con 0x7fe6d806c2e0 2024-09-19T09:42:51.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.141+0000 7fe6ea7fc640 1 -- 172.21.15.123:0/1329369581 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fe6f40cc4c0 con 0x7fe6d806c2e0 2024-09-19T09:42:51.146 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:51.147 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe6d806c2e0 msgr2=0x7fe6d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe6d806c2e0 0x7fe6d806e7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f60 tx=0x7fe6f0007c10 comp rx=0 tx=0).stop 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 msgr2=0x7fe6f40c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 0x7fe6f40c2ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec02ac50 tx=0x7fe6ec004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 shutdown_connections 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f4155650 0x7fe6f40c2ee0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6f40c8400 0x7fe6f41f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe6d806c2e0 0x7fe6d806e7a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 --2- 172.21.15.123:0/1329369581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6f40c7f40 0x7fe6f414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.144+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 >> 172.21.15.123:0/1329369581 conn(0x7fe6f40cd5c0 msgr2=0x7fe6f40ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.145+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 shutdown_connections 2024-09-19T09:42:51.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.145+0000 7fe6fbb78640 1 -- 172.21.15.123:0/1329369581 wait complete. 2024-09-19T09:42:51.157 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-19T09:42:50.699255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219240,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755480,"statfs":{"total":773094113280,"available":772869611520,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002290"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208065+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:39.208065+0000","last_peered":"2024-09-19T09:42:39.208065+0000","last_clean":"2024-09-19T09:42:39.208065+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:39.208065+0000","last_undegraded":"2024-09-19T09:42:39.208065+0000","last_fullsized":"2024-09-19T09:42:39.208065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425721+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:39.425721+0000","last_peered":"2024-09-19T09:42:39.425721+0000","last_clean":"2024-09-19T09:42:39.425721+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:39.425721+0000","last_undegraded":"2024-09-19T09:42:39.425721+0000","last_fullsized":"2024-09-19T09:42:39.425721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807877+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:38.807877+0000","last_peered":"2024-09-19T09:42:38.807877+0000","last_clean":"2024-09-19T09:42:38.807877+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:38.807877+0000","last_undegraded":"2024-09-19T09:42:38.807877+0000","last_fullsized":"2024-09-19T09:42:38.807877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426221+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:39.426221+0000","last_peered":"2024-09-19T09:42:39.426221+0000","last_clean":"2024-09-19T09:42:39.426221+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:39.426221+0000","last_undegraded":"2024-09-19T09:42:39.426221+0000","last_fullsized":"2024-09-19T09:42:39.426221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207678+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:39.207678+0000","last_peered":"2024-09-19T09:42:39.207678+0000","last_clean":"2024-09-19T09:42:39.207678+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:39.207678+0000","last_undegraded":"2024-09-19T09:42:39.207678+0000","last_fullsized":"2024-09-19T09:42:39.207678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426075+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:39.426075+0000","last_peered":"2024-09-19T09:42:39.426075+0000","last_clean":"2024-09-19T09:42:39.426075+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:39.426075+0000","last_undegraded":"2024-09-19T09:42:39.426075+0000","last_fullsized":"2024-09-19T09:42:39.426075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207524+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:39.207524+0000","last_peered":"2024-09-19T09:42:39.207524+0000","last_clean":"2024-09-19T09:42:39.207524+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:39.207524+0000","last_undegraded":"2024-09-19T09:42:39.207524+0000","last_fullsized":"2024-09-19T09:42:39.207524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510378+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:38.510378+0000","last_peered":"2024-09-19T09:42:38.510378+0000","last_clean":"2024-09-19T09:42:38.510378+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:38.510378+0000","last_undegraded":"2024-09-19T09:42:38.510378+0000","last_fullsized":"2024-09-19T09:42:38.510378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208096+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:39.208096+0000","last_peered":"2024-09-19T09:42:39.208096+0000","last_clean":"2024-09-19T09:42:39.208096+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:39.208096+0000","last_undegraded":"2024-09-19T09:42:39.208096+0000","last_fullsized":"2024-09-19T09:42:39.208096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512763+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:38.512763+0000","last_peered":"2024-09-19T09:42:38.512763+0000","last_clean":"2024-09-19T09:42:38.512763+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:38.512763+0000","last_undegraded":"2024-09-19T09:42:38.512763+0000","last_fullsized":"2024-09-19T09:42:38.512763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511885+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:38.511885+0000","last_peered":"2024-09-19T09:42:38.511885+0000","last_clean":"2024-09-19T09:42:38.511885+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:38.511885+0000","last_undegraded":"2024-09-19T09:42:38.511885+0000","last_fullsized":"2024-09-19T09:42:38.511885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512418+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:38.512418+0000","last_peered":"2024-09-19T09:42:38.512418+0000","last_clean":"2024-09-19T09:42:38.512418+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:38.512418+0000","last_undegraded":"2024-09-19T09:42:38.512418+0000","last_fullsized":"2024-09-19T09:42:38.512418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510684+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:38.510684+0000","last_peered":"2024-09-19T09:42:38.510684+0000","last_clean":"2024-09-19T09:42:38.510684+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:38.510684+0000","last_undegraded":"2024-09-19T09:42:38.510684+0000","last_fullsized":"2024-09-19T09:42:38.510684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807777+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:38.807777+0000","last_peered":"2024-09-19T09:42:38.807777+0000","last_clean":"2024-09-19T09:42:38.807777+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:38.807777+0000","last_undegraded":"2024-09-19T09:42:38.807777+0000","last_fullsized":"2024-09-19T09:42:38.807777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:39.425650+0000","last_peered":"2024-09-19T09:42:39.425650+0000","last_clean":"2024-09-19T09:42:39.425650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:39.425650+0000","last_undegraded":"2024-09-19T09:42:39.425650+0000","last_fullsized":"2024-09-19T09:42:39.425650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425926+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:39.425926+0000","last_peered":"2024-09-19T09:42:39.425926+0000","last_clean":"2024-09-19T09:42:39.425926+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:39.425926+0000","last_undegraded":"2024-09-19T09:42:39.425926+0000","last_fullsized":"2024-09-19T09:42:39.425926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426684+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:39.426684+0000","last_peered":"2024-09-19T09:42:39.426684+0000","last_clean":"2024-09-19T09:42:39.426684+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:39.426684+0000","last_undegraded":"2024-09-19T09:42:39.426684+0000","last_fullsized":"2024-09-19T09:42:39.426684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924975+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:42:38.924975+0000","last_peered":"2024-09-19T09:42:38.924975+0000","last_clean":"2024-09-19T09:42:38.924975+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:42:38.924975+0000","last_undegraded":"2024-09-19T09:42:38.924975+0000","last_fullsized":"2024-09-19T09:42:38.924975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207933+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:39.207933+0000","last_peered":"2024-09-19T09:42:39.207933+0000","last_clean":"2024-09-19T09:42:39.207933+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:39.207933+0000","last_undegraded":"2024-09-19T09:42:39.207933+0000","last_fullsized":"2024-09-19T09:42:39.207933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512111+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:38.512111+0000","last_peered":"2024-09-19T09:42:38.512111+0000","last_clean":"2024-09-19T09:42:38.512111+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:38.512111+0000","last_undegraded":"2024-09-19T09:42:38.512111+0000","last_fullsized":"2024-09-19T09:42:38.512111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807900+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:38.807900+0000","last_peered":"2024-09-19T09:42:38.807900+0000","last_clean":"2024-09-19T09:42:38.807900+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:38.807900+0000","last_undegraded":"2024-09-19T09:42:38.807900+0000","last_fullsized":"2024-09-19T09:42:38.807900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426152+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:39.426152+0000","last_peered":"2024-09-19T09:42:39.426152+0000","last_clean":"2024-09-19T09:42:39.426152+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:39.426152+0000","last_undegraded":"2024-09-19T09:42:39.426152+0000","last_fullsized":"2024-09-19T09:42:39.426152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510406+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:38.510406+0000","last_peered":"2024-09-19T09:42:38.510406+0000","last_clean":"2024-09-19T09:42:38.510406+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:38.510406+0000","last_undegraded":"2024-09-19T09:42:38.510406+0000","last_fullsized":"2024-09-19T09:42:38.510406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426004+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:39.426004+0000","last_peered":"2024-09-19T09:42:39.426004+0000","last_clean":"2024-09-19T09:42:39.426004+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:39.426004+0000","last_undegraded":"2024-09-19T09:42:39.426004+0000","last_fullsized":"2024-09-19T09:42:39.426004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510568+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:38.510568+0000","last_peered":"2024-09-19T09:42:38.510568+0000","last_clean":"2024-09-19T09:42:38.510568+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:38.510568+0000","last_undegraded":"2024-09-19T09:42:38.510568+0000","last_fullsized":"2024-09-19T09:42:38.510568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512831+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:38.512831+0000","last_peered":"2024-09-19T09:42:38.512831+0000","last_clean":"2024-09-19T09:42:38.512831+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:38.512831+0000","last_undegraded":"2024-09-19T09:42:38.512831+0000","last_fullsized":"2024-09-19T09:42:38.512831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425723+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:39.425723+0000","last_peered":"2024-09-19T09:42:39.425723+0000","last_clean":"2024-09-19T09:42:39.425723+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:39.425723+0000","last_undegraded":"2024-09-19T09:42:39.425723+0000","last_fullsized":"2024-09-19T09:42:39.425723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510768+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:38.510768+0000","last_peered":"2024-09-19T09:42:38.510768+0000","last_clean":"2024-09-19T09:42:38.510768+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:38.510768+0000","last_undegraded":"2024-09-19T09:42:38.510768+0000","last_fullsized":"2024-09-19T09:42:38.510768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808033+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:38.808033+0000","last_peered":"2024-09-19T09:42:38.808033+0000","last_clean":"2024-09-19T09:42:38.808033+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:38.808033+0000","last_undegraded":"2024-09-19T09:42:38.808033+0000","last_fullsized":"2024-09-19T09:42:38.808033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426322+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:39.426322+0000","last_peered":"2024-09-19T09:42:39.426322+0000","last_clean":"2024-09-19T09:42:39.426322+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:39.426322+0000","last_undegraded":"2024-09-19T09:42:39.426322+0000","last_fullsized":"2024-09-19T09:42:39.426322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924787+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:42:38.924787+0000","last_peered":"2024-09-19T09:42:38.924787+0000","last_clean":"2024-09-19T09:42:38.924787+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:42:38.924787+0000","last_undegraded":"2024-09-19T09:42:38.924787+0000","last_fullsized":"2024-09-19T09:42:38.924787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512278+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:38.512278+0000","last_peered":"2024-09-19T09:42:38.512278+0000","last_clean":"2024-09-19T09:42:38.512278+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:38.512278+0000","last_undegraded":"2024-09-19T09:42:38.512278+0000","last_fullsized":"2024-09-19T09:42:38.512278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511859+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:38.511859+0000","last_peered":"2024-09-19T09:42:38.511859+0000","last_clean":"2024-09-19T09:42:38.511859+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:38.511859+0000","last_undegraded":"2024-09-19T09:42:38.511859+0000","last_fullsized":"2024-09-19T09:42:38.511859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510910+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:38.510910+0000","last_peered":"2024-09-19T09:42:38.510910+0000","last_clean":"2024-09-19T09:42:38.510910+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:38.510910+0000","last_undegraded":"2024-09-19T09:42:38.510910+0000","last_fullsized":"2024-09-19T09:42:38.510910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808051+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:38.808051+0000","last_peered":"2024-09-19T09:42:38.808051+0000","last_clean":"2024-09-19T09:42:38.808051+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:38.808051+0000","last_undegraded":"2024-09-19T09:42:38.808051+0000","last_fullsized":"2024-09-19T09:42:38.808051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512112+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:38.512112+0000","last_peered":"2024-09-19T09:42:38.512112+0000","last_clean":"2024-09-19T09:42:38.512112+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:38.512112+0000","last_undegraded":"2024-09-19T09:42:38.512112+0000","last_fullsized":"2024-09-19T09:42:38.512112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510468+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:38.510468+0000","last_peered":"2024-09-19T09:42:38.510468+0000","last_clean":"2024-09-19T09:42:38.510468+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:38.510468+0000","last_undegraded":"2024-09-19T09:42:38.510468+0000","last_fullsized":"2024-09-19T09:42:38.510468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510423+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:38.510423+0000","last_peered":"2024-09-19T09:42:38.510423+0000","last_clean":"2024-09-19T09:42:38.510423+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:38.510423+0000","last_undegraded":"2024-09-19T09:42:38.510423+0000","last_fullsized":"2024-09-19T09:42:38.510423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426077+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:39.426077+0000","last_peered":"2024-09-19T09:42:39.426077+0000","last_clean":"2024-09-19T09:42:39.426077+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:39.426077+0000","last_undegraded":"2024-09-19T09:42:39.426077+0000","last_fullsized":"2024-09-19T09:42:39.426077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425475+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:39.425475+0000","last_peered":"2024-09-19T09:42:39.425475+0000","last_clean":"2024-09-19T09:42:39.425475+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:39.425475+0000","last_undegraded":"2024-09-19T09:42:39.425475+0000","last_fullsized":"2024-09-19T09:42:39.425475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512425+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:38.512425+0000","last_peered":"2024-09-19T09:42:38.512425+0000","last_clean":"2024-09-19T09:42:38.512425+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:38.512425+0000","last_undegraded":"2024-09-19T09:42:38.512425+0000","last_fullsized":"2024-09-19T09:42:38.512425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426461+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:39.426461+0000","last_peered":"2024-09-19T09:42:39.426461+0000","last_clean":"2024-09-19T09:42:39.426461+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:39.426461+0000","last_undegraded":"2024-09-19T09:42:39.426461+0000","last_fullsized":"2024-09-19T09:42:39.426461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426390+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:39.426390+0000","last_peered":"2024-09-19T09:42:39.426390+0000","last_clean":"2024-09-19T09:42:39.426390+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:39.426390+0000","last_undegraded":"2024-09-19T09:42:39.426390+0000","last_fullsized":"2024-09-19T09:42:39.426390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808057+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:38.808057+0000","last_peered":"2024-09-19T09:42:38.808057+0000","last_clean":"2024-09-19T09:42:38.808057+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:38.808057+0000","last_undegraded":"2024-09-19T09:42:38.808057+0000","last_fullsized":"2024-09-19T09:42:38.808057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515580+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:42.515580+0000","last_peered":"2024-09-19T09:42:42.515580+0000","last_clean":"2024-09-19T09:42:42.515580+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:42.515580+0000","last_undegraded":"2024-09-19T09:42:42.515580+0000","last_fullsized":"2024-09-19T09:42:42.515580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512565+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:38.512565+0000","last_peered":"2024-09-19T09:42:38.512565+0000","last_clean":"2024-09-19T09:42:38.512565+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:38.512565+0000","last_undegraded":"2024-09-19T09:42:38.512565+0000","last_fullsized":"2024-09-19T09:42:38.512565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.517809+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:42.517809+0000","last_peered":"2024-09-19T09:42:42.517809+0000","last_clean":"2024-09-19T09:42:42.517809+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:42.517809+0000","last_undegraded":"2024-09-19T09:42:42.517809+0000","last_fullsized":"2024-09-19T09:42:42.517809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207581+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:39.207581+0000","last_peered":"2024-09-19T09:42:39.207581+0000","last_clean":"2024-09-19T09:42:39.207581+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:39.207581+0000","last_undegraded":"2024-09-19T09:42:39.207581+0000","last_fullsized":"2024-09-19T09:42:39.207581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515658+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:42.515658+0000","last_peered":"2024-09-19T09:42:42.515658+0000","last_clean":"2024-09-19T09:42:42.515658+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:42.515658+0000","last_undegraded":"2024-09-19T09:42:42.515658+0000","last_fullsized":"2024-09-19T09:42:42.515658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807779+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:38.807779+0000","last_peered":"2024-09-19T09:42:38.807779+0000","last_clean":"2024-09-19T09:42:38.807779+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:38.807779+0000","last_undegraded":"2024-09-19T09:42:38.807779+0000","last_fullsized":"2024-09-19T09:42:38.807779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426290+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:39.426290+0000","last_peered":"2024-09-19T09:42:39.426290+0000","last_clean":"2024-09-19T09:42:39.426290+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:39.426290+0000","last_undegraded":"2024-09-19T09:42:39.426290+0000","last_fullsized":"2024-09-19T09:42:39.426290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207825+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:39.207825+0000","last_peered":"2024-09-19T09:42:39.207825+0000","last_clean":"2024-09-19T09:42:39.207825+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:39.207825+0000","last_undegraded":"2024-09-19T09:42:39.207825+0000","last_fullsized":"2024-09-19T09:42:39.207825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511816+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:38.511816+0000","last_peered":"2024-09-19T09:42:38.511816+0000","last_clean":"2024-09-19T09:42:38.511816+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:38.511816+0000","last_undegraded":"2024-09-19T09:42:38.511816+0000","last_fullsized":"2024-09-19T09:42:38.511816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:38.512415+0000","last_peered":"2024-09-19T09:42:38.512415+0000","last_clean":"2024-09-19T09:42:38.512415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:38.512415+0000","last_undegraded":"2024-09-19T09:42:38.512415+0000","last_fullsized":"2024-09-19T09:42:38.512415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.518541+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:42:42.518541+0000","last_peered":"2024-09-19T09:42:42.518541+0000","last_clean":"2024-09-19T09:42:42.518541+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:42:42.518541+0000","last_undegraded":"2024-09-19T09:42:42.518541+0000","last_fullsized":"2024-09-19T09:42:42.518541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207561+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:39.207561+0000","last_peered":"2024-09-19T09:42:39.207561+0000","last_clean":"2024-09-19T09:42:39.207561+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:39.207561+0000","last_undegraded":"2024-09-19T09:42:39.207561+0000","last_fullsized":"2024-09-19T09:42:39.207561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512648+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:38.512648+0000","last_peered":"2024-09-19T09:42:38.512648+0000","last_clean":"2024-09-19T09:42:38.512648+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:38.512648+0000","last_undegraded":"2024-09-19T09:42:38.512648+0000","last_fullsized":"2024-09-19T09:42:38.512648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207957+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:39.207957+0000","last_peered":"2024-09-19T09:42:39.207957+0000","last_clean":"2024-09-19T09:42:39.207957+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:39.207957+0000","last_undegraded":"2024-09-19T09:42:39.207957+0000","last_fullsized":"2024-09-19T09:42:39.207957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:07.533470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.517661+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:42:42.517661+0000","last_peered":"2024-09-19T09:42:42.517661+0000","last_clean":"2024-09-19T09:42:42.517661+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:42:42.517661+0000","last_undegraded":"2024-09-19T09:42:42.517661+0000","last_fullsized":"2024-09-19T09:42:42.517661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208167+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:39.208167+0000","last_peered":"2024-09-19T09:42:39.208167+0000","last_clean":"2024-09-19T09:42:39.208167+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:39.208167+0000","last_undegraded":"2024-09-19T09:42:39.208167+0000","last_fullsized":"2024-09-19T09:42:39.208167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425782+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:39.425782+0000","last_peered":"2024-09-19T09:42:39.425782+0000","last_clean":"2024-09-19T09:42:39.425782+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:39.425782+0000","last_undegraded":"2024-09-19T09:42:39.425782+0000","last_fullsized":"2024-09-19T09:42:39.425782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426436+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:39.426436+0000","last_peered":"2024-09-19T09:42:39.426436+0000","last_clean":"2024-09-19T09:42:39.426436+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:39.426436+0000","last_undegraded":"2024-09-19T09:42:39.426436+0000","last_fullsized":"2024-09-19T09:42:39.426436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:19.189449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924791+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:42:38.924791+0000","last_peered":"2024-09-19T09:42:38.924791+0000","last_clean":"2024-09-19T09:42:38.924791+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:42:38.924791+0000","last_undegraded":"2024-09-19T09:42:38.924791+0000","last_fullsized":"2024-09-19T09:42:38.924791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207922+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:39.207922+0000","last_peered":"2024-09-19T09:42:39.207922+0000","last_clean":"2024-09-19T09:42:39.207922+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:39.207922+0000","last_undegraded":"2024-09-19T09:42:39.207922+0000","last_fullsized":"2024-09-19T09:42:39.207922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207308+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:39.207308+0000","last_peered":"2024-09-19T09:42:39.207308+0000","last_clean":"2024-09-19T09:42:39.207308+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:39.207308+0000","last_undegraded":"2024-09-19T09:42:39.207308+0000","last_fullsized":"2024-09-19T09:42:39.207308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425996+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:39.425996+0000","last_peered":"2024-09-19T09:42:39.425996+0000","last_clean":"2024-09-19T09:42:39.425996+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:39.425996+0000","last_undegraded":"2024-09-19T09:42:39.425996+0000","last_fullsized":"2024-09-19T09:42:39.425996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510573+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:38.510573+0000","last_peered":"2024-09-19T09:42:38.510573+0000","last_clean":"2024-09-19T09:42:38.510573+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:38.510573+0000","last_undegraded":"2024-09-19T09:42:38.510573+0000","last_fullsized":"2024-09-19T09:42:38.510573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207558+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:39.207558+0000","last_peered":"2024-09-19T09:42:39.207558+0000","last_clean":"2024-09-19T09:42:39.207558+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:39.207558+0000","last_undegraded":"2024-09-19T09:42:39.207558+0000","last_fullsized":"2024-09-19T09:42:39.207558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807721+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:38.807721+0000","last_peered":"2024-09-19T09:42:38.807721+0000","last_clean":"2024-09-19T09:42:38.807721+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:38.807721+0000","last_undegraded":"2024-09-19T09:42:38.807721+0000","last_fullsized":"2024-09-19T09:42:38.807721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924736+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:42:38.924736+0000","last_peered":"2024-09-19T09:42:38.924736+0000","last_clean":"2024-09-19T09:42:38.924736+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:42:38.924736+0000","last_undegraded":"2024-09-19T09:42:38.924736+0000","last_fullsized":"2024-09-19T09:42:38.924736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425500+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:39.425500+0000","last_peered":"2024-09-19T09:42:39.425500+0000","last_clean":"2024-09-19T09:42:39.425500+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:39.425500+0000","last_undegraded":"2024-09-19T09:42:39.425500+0000","last_fullsized":"2024-09-19T09:42:39.425500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426521+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:39.426521+0000","last_peered":"2024-09-19T09:42:39.426521+0000","last_clean":"2024-09-19T09:42:39.426521+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:39.426521+0000","last_undegraded":"2024-09-19T09:42:39.426521+0000","last_fullsized":"2024-09-19T09:42:39.426521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511988+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:38.511988+0000","last_peered":"2024-09-19T09:42:38.511988+0000","last_clean":"2024-09-19T09:42:38.511988+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:38.511988+0000","last_undegraded":"2024-09-19T09:42:38.511988+0000","last_fullsized":"2024-09-19T09:42:38.511988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425551+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:39.425551+0000","last_peered":"2024-09-19T09:42:39.425551+0000","last_clean":"2024-09-19T09:42:39.425551+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:39.425551+0000","last_undegraded":"2024-09-19T09:42:39.425551+0000","last_fullsized":"2024-09-19T09:42:39.425551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426479+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:39.426479+0000","last_peered":"2024-09-19T09:42:39.426479+0000","last_clean":"2024-09-19T09:42:39.426479+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:39.426479+0000","last_undegraded":"2024-09-19T09:42:39.426479+0000","last_fullsized":"2024-09-19T09:42:39.426479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208038+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:39.208038+0000","last_peered":"2024-09-19T09:42:39.208038+0000","last_clean":"2024-09-19T09:42:39.208038+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:39.208038+0000","last_undegraded":"2024-09-19T09:42:39.208038+0000","last_fullsized":"2024-09-19T09:42:39.208038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425565+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:39.425565+0000","last_peered":"2024-09-19T09:42:39.425565+0000","last_clean":"2024-09-19T09:42:39.425565+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:39.425565+0000","last_undegraded":"2024-09-19T09:42:39.425565+0000","last_fullsized":"2024-09-19T09:42:39.425565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425707+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:39.425707+0000","last_peered":"2024-09-19T09:42:39.425707+0000","last_clean":"2024-09-19T09:42:39.425707+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:39.425707+0000","last_undegraded":"2024-09-19T09:42:39.425707+0000","last_fullsized":"2024-09-19T09:42:39.425707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510775+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:38.510775+0000","last_peered":"2024-09-19T09:42:38.510775+0000","last_clean":"2024-09-19T09:42:38.510775+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:38.510775+0000","last_undegraded":"2024-09-19T09:42:38.510775+0000","last_fullsized":"2024-09-19T09:42:38.510775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516466+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:42.516466+0000","last_peered":"2024-09-19T09:42:42.516466+0000","last_clean":"2024-09-19T09:42:42.516466+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:42.516466+0000","last_undegraded":"2024-09-19T09:42:42.516466+0000","last_fullsized":"2024-09-19T09:42:42.516466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807908+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:38.807908+0000","last_peered":"2024-09-19T09:42:38.807908+0000","last_clean":"2024-09-19T09:42:38.807908+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:38.807908+0000","last_undegraded":"2024-09-19T09:42:38.807908+0000","last_fullsized":"2024-09-19T09:42:38.807908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207343+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:39.207343+0000","last_peered":"2024-09-19T09:42:39.207343+0000","last_clean":"2024-09-19T09:42:39.207343+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:39.207343+0000","last_undegraded":"2024-09-19T09:42:39.207343+0000","last_fullsized":"2024-09-19T09:42:39.207343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512166+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:38.512166+0000","last_peered":"2024-09-19T09:42:38.512166+0000","last_clean":"2024-09-19T09:42:38.512166+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:38.512166+0000","last_undegraded":"2024-09-19T09:42:38.512166+0000","last_fullsized":"2024-09-19T09:42:38.512166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425593+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:39.425593+0000","last_peered":"2024-09-19T09:42:39.425593+0000","last_clean":"2024-09-19T09:42:39.425593+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:39.425593+0000","last_undegraded":"2024-09-19T09:42:39.425593+0000","last_fullsized":"2024-09-19T09:42:39.425593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510540+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:38.510540+0000","last_peered":"2024-09-19T09:42:38.510540+0000","last_clean":"2024-09-19T09:42:38.510540+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:38.510540+0000","last_undegraded":"2024-09-19T09:42:38.510540+0000","last_fullsized":"2024-09-19T09:42:38.510540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:45.394478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425602+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:39.425602+0000","last_peered":"2024-09-19T09:42:39.425602+0000","last_clean":"2024-09-19T09:42:39.425602+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:39.425602+0000","last_undegraded":"2024-09-19T09:42:39.425602+0000","last_fullsized":"2024-09-19T09:42:39.425602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510830+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:38.510830+0000","last_peered":"2024-09-19T09:42:38.510830+0000","last_clean":"2024-09-19T09:42:38.510830+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:38.510830+0000","last_undegraded":"2024-09-19T09:42:38.510830+0000","last_fullsized":"2024-09-19T09:42:38.510830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516582+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:42.516582+0000","last_peered":"2024-09-19T09:42:42.516582+0000","last_clean":"2024-09-19T09:42:42.516582+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:42.516582+0000","last_undegraded":"2024-09-19T09:42:42.516582+0000","last_fullsized":"2024-09-19T09:42:42.516582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511970+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:38.511970+0000","last_peered":"2024-09-19T09:42:38.511970+0000","last_clean":"2024-09-19T09:42:38.511970+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:38.511970+0000","last_undegraded":"2024-09-19T09:42:38.511970+0000","last_fullsized":"2024-09-19T09:42:38.511970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426400+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:39.426400+0000","last_peered":"2024-09-19T09:42:39.426400+0000","last_clean":"2024-09-19T09:42:39.426400+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:39.426400+0000","last_undegraded":"2024-09-19T09:42:39.426400+0000","last_fullsized":"2024-09-19T09:42:39.426400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:50.680705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515634+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:42.515634+0000","last_peered":"2024-09-19T09:42:42.515634+0000","last_clean":"2024-09-19T09:42:42.515634+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:42.515634+0000","last_undegraded":"2024-09-19T09:42:42.515634+0000","last_fullsized":"2024-09-19T09:42:42.515634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426280+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:39.426280+0000","last_peered":"2024-09-19T09:42:39.426280+0000","last_clean":"2024-09-19T09:42:39.426280+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:39.426280+0000","last_undegraded":"2024-09-19T09:42:39.426280+0000","last_fullsized":"2024-09-19T09:42:39.426280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516048+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:42.516048+0000","last_peered":"2024-09-19T09:42:42.516048+0000","last_clean":"2024-09-19T09:42:42.516048+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:42.516048+0000","last_undegraded":"2024-09-19T09:42:42.516048+0000","last_fullsized":"2024-09-19T09:42:42.516048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807921+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:38.807921+0000","last_peered":"2024-09-19T09:42:38.807921+0000","last_clean":"2024-09-19T09:42:38.807921+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:38.807921+0000","last_undegraded":"2024-09-19T09:42:38.807921+0000","last_fullsized":"2024-09-19T09:42:38.807921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510741+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:38.510741+0000","last_peered":"2024-09-19T09:42:38.510741+0000","last_clean":"2024-09-19T09:42:38.510741+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:38.510741+0000","last_undegraded":"2024-09-19T09:42:38.510741+0000","last_fullsized":"2024-09-19T09:42:38.510741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510810+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:38.510810+0000","last_peered":"2024-09-19T09:42:38.510810+0000","last_clean":"2024-09-19T09:42:38.510810+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:38.510810+0000","last_undegraded":"2024-09-19T09:42:38.510810+0000","last_fullsized":"2024-09-19T09:42:38.510810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516995+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:42.516995+0000","last_peered":"2024-09-19T09:42:42.516995+0000","last_clean":"2024-09-19T09:42:42.516995+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:42.516995+0000","last_undegraded":"2024-09-19T09:42:42.516995+0000","last_fullsized":"2024-09-19T09:42:42.516995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:51.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:42:51.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 Processor -- start 2024-09-19T09:42:51.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 -- start start 2024-09-19T09:42:51.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5d8151fc0 0x7fb5d80c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb5d8072770 0x7fb5d81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d8157e20 con 0x7fb5d81523a0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d8158e20 con 0x7fb5d8151fc0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.294+0000 7fb5df21e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d8072100 con 0x7fb5d8072770 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dcfba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5d8151fc0 0x7fb5d80c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5d7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb5d81523a0 0x7fb5d80710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58886/0 (socket says 172.21.15.123:58886) 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5d7fff640 1 -- 172.21.15.123:0/523398359 learned_addr learned my addr 172.21.15.123:0/523398359 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dd7bb640 1 --2- 172.21.15.123:0/523398359 >> v2:172.21.15.194:3300/0 conn(0x7fb5d8072770 0x7fb5d81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dcfba640 1 -- 172.21.15.123:0/523398359 >> v2:172.21.15.194:3300/0 conn(0x7fb5d8072770 msgr2=0x7fb5d81588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dcfba640 1 --2- 172.21.15.123:0/523398359 >> v2:172.21.15.194:3300/0 conn(0x7fb5d8072770 0x7fb5d81588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dcfba640 1 -- 172.21.15.123:0/523398359 >> v1:172.21.15.123:6789/0 conn(0x7fb5d81523a0 legacy=0x7fb5d80710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5d77fe640 1 -- 172.21.15.123:0/523398359 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324919740 0 0) 0x7fb5d8157e20 con 0x7fb5d81523a0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dcfba640 1 -- 172.21.15.123:0/523398359 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d80723e0 con 0x7fb5d8151fc0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.295+0000 7fb5dd7bb640 1 --2- 172.21.15.123:0/523398359 >> v2:172.21.15.194:3300/0 conn(0x7fb5d8072770 0x7fb5d81588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5dcfba640 1 --2- 172.21.15.123:0/523398359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d80c88b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80cd970 tx=0x7fb5cc02c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b845285327a32cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5d77fe640 1 -- 172.21.15.123:0/523398359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc039070 con 0x7fb5d8151fc0 2024-09-19T09:42:51.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5d77fe640 1 -- 172.21.15.123:0/523398359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5cc034640 con 0x7fb5d8151fc0 2024-09-19T09:42:51.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5d77fe640 1 -- 172.21.15.123:0/523398359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc034a10 con 0x7fb5d8151fc0 2024-09-19T09:42:51.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 -- 172.21.15.123:0/523398359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 msgr2=0x7fb5d80c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 --2- 172.21.15.123:0/523398359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d80c88b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80cd970 tx=0x7fb5cc02c320 comp rx=0 tx=0).stop 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 -- 172.21.15.123:0/523398359 shutdown_connections 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 --2- 172.21.15.123:0/523398359 >> v2:172.21.15.194:3300/0 conn(0x7fb5d8072770 0x7fb5d81588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 --2- 172.21.15.123:0/523398359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d80c88b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 -- 172.21.15.123:0/523398359 >> 172.21.15.123:0/523398359 conn(0x7fb5d806ec90 msgr2=0x7fb5d806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 -- 172.21.15.123:0/523398359 shutdown_connections 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.296+0000 7fb5df21e640 1 -- 172.21.15.123:0/523398359 wait complete. 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.297+0000 7fb5df21e640 1 Processor -- start 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.297+0000 7fb5df21e640 1 -- start start 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5df21e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5d8072770 0x7fb5d8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5df21e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5df21e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5d80b9ef0 0x7fb5d815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5df21e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8071800 con 0x7fb5d8151fc0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5df21e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d81583c0 con 0x7fb5d80b9ef0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5df21e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d8071980 con 0x7fb5d8072770 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60296/0 (socket says 172.21.15.123:60296) 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.298+0000 7fb5d7fff640 1 -- 172.21.15.123:0/4006511887 learned_addr learned my addr 172.21.15.123:0/4006511887 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d7fff640 1 -- 172.21.15.123:0/4006511887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5d8072770 msgr2=0x7fb5d8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d7fff640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5d8072770 0x7fb5d8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d7fff640 1 -- 172.21.15.123:0/4006511887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5d80b9ef0 msgr2=0x7fb5d815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d7fff640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5d80b9ef0 0x7fb5d815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d7fff640 1 -- 172.21.15.123:0/4006511887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d81f0b30 con 0x7fb5d8151fc0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d7fff640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d815a8c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c500 tx=0x7fb5c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4018070 con 0x7fb5d8151fc0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c4007580 con 0x7fb5d8151fc0 2024-09-19T09:42:51.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d8159b00 con 0x7fb5d8151fc0 2024-09-19T09:42:51.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4004a20 con 0x7fb5d8151fc0 2024-09-19T09:42:51.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.299+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d815a0c0 con 0x7fb5d8151fc0 2024-09-19T09:42:51.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.300+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d815b3d0 con 0x7fb5d8151fc0 2024-09-19T09:42:51.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.300+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb5c401b070 con 0x7fb5d8151fc0 2024-09-19T09:42:51.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.301+0000 7fb5d57fa640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb5bc06c2b0 0x7fb5bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.301+0000 7fb5dcfba640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb5bc06c2b0 0x7fb5bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.301+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb5c408a6e0 con 0x7fb5d8151fc0 2024-09-19T09:42:51.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.301+0000 7fb5dcfba640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb5bc06c2b0 0x7fb5bc06e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc036000 tx=0x7fb5cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.305+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb5c4058ee0 con 0x7fb5d8151fc0 2024-09-19T09:42:51.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.467+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5d80cc910 con 0x7fb5bc06c2b0 2024-09-19T09:42:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.473+0000 7fb5d57fa640 1 -- 172.21.15.123:0/4006511887 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fb5d80cc910 con 0x7fb5bc06c2b0 2024-09-19T09:42:51.477 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:51.479 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.476+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb5bc06c2b0 msgr2=0x7fb5bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.476+0000 7fb5df21e640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb5bc06c2b0 0x7fb5bc06e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc036000 tx=0x7fb5cc02e000 comp rx=0 tx=0).stop 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.476+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 msgr2=0x7fb5d815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.476+0000 7fb5df21e640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d815a8c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c500 tx=0x7fb5c400c9c0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 shutdown_connections 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5d80b9ef0 0x7fb5d815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8151fc0 0x7fb5d815a8c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb5bc06c2b0 0x7fb5bc06e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 --2- 172.21.15.123:0/4006511887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5d8072770 0x7fb5d8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 >> 172.21.15.123:0/4006511887 conn(0x7fb5d806ec90 msgr2=0x7fb5d806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 shutdown_connections 2024-09-19T09:42:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.477+0000 7fb5df21e640 1 -- 172.21.15.123:0/4006511887 wait complete. 2024-09-19T09:42:51.489 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-19T09:42:50.699255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219240,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755480,"statfs":{"total":773094113280,"available":772869611520,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002290"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208065+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:42:39.208065+0000","last_peered":"2024-09-19T09:42:39.208065+0000","last_clean":"2024-09-19T09:42:39.208065+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:42:39.208065+0000","last_undegraded":"2024-09-19T09:42:39.208065+0000","last_fullsized":"2024-09-19T09:42:39.208065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425721+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:42:39.425721+0000","last_peered":"2024-09-19T09:42:39.425721+0000","last_clean":"2024-09-19T09:42:39.425721+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:42:39.425721+0000","last_undegraded":"2024-09-19T09:42:39.425721+0000","last_fullsized":"2024-09-19T09:42:39.425721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807877+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:42:38.807877+0000","last_peered":"2024-09-19T09:42:38.807877+0000","last_clean":"2024-09-19T09:42:38.807877+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:42:38.807877+0000","last_undegraded":"2024-09-19T09:42:38.807877+0000","last_fullsized":"2024-09-19T09:42:38.807877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426221+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:42:39.426221+0000","last_peered":"2024-09-19T09:42:39.426221+0000","last_clean":"2024-09-19T09:42:39.426221+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:42:39.426221+0000","last_undegraded":"2024-09-19T09:42:39.426221+0000","last_fullsized":"2024-09-19T09:42:39.426221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207678+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:42:39.207678+0000","last_peered":"2024-09-19T09:42:39.207678+0000","last_clean":"2024-09-19T09:42:39.207678+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:42:39.207678+0000","last_undegraded":"2024-09-19T09:42:39.207678+0000","last_fullsized":"2024-09-19T09:42:39.207678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426075+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:42:39.426075+0000","last_peered":"2024-09-19T09:42:39.426075+0000","last_clean":"2024-09-19T09:42:39.426075+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:42:39.426075+0000","last_undegraded":"2024-09-19T09:42:39.426075+0000","last_fullsized":"2024-09-19T09:42:39.426075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207524+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:42:39.207524+0000","last_peered":"2024-09-19T09:42:39.207524+0000","last_clean":"2024-09-19T09:42:39.207524+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:42:39.207524+0000","last_undegraded":"2024-09-19T09:42:39.207524+0000","last_fullsized":"2024-09-19T09:42:39.207524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510378+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:42:38.510378+0000","last_peered":"2024-09-19T09:42:38.510378+0000","last_clean":"2024-09-19T09:42:38.510378+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:42:38.510378+0000","last_undegraded":"2024-09-19T09:42:38.510378+0000","last_fullsized":"2024-09-19T09:42:38.510378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208096+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:42:39.208096+0000","last_peered":"2024-09-19T09:42:39.208096+0000","last_clean":"2024-09-19T09:42:39.208096+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:42:39.208096+0000","last_undegraded":"2024-09-19T09:42:39.208096+0000","last_fullsized":"2024-09-19T09:42:39.208096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512763+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:42:38.512763+0000","last_peered":"2024-09-19T09:42:38.512763+0000","last_clean":"2024-09-19T09:42:38.512763+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:42:38.512763+0000","last_undegraded":"2024-09-19T09:42:38.512763+0000","last_fullsized":"2024-09-19T09:42:38.512763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511885+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:42:38.511885+0000","last_peered":"2024-09-19T09:42:38.511885+0000","last_clean":"2024-09-19T09:42:38.511885+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:42:38.511885+0000","last_undegraded":"2024-09-19T09:42:38.511885+0000","last_fullsized":"2024-09-19T09:42:38.511885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512418+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:42:38.512418+0000","last_peered":"2024-09-19T09:42:38.512418+0000","last_clean":"2024-09-19T09:42:38.512418+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:42:38.512418+0000","last_undegraded":"2024-09-19T09:42:38.512418+0000","last_fullsized":"2024-09-19T09:42:38.512418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510684+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:42:38.510684+0000","last_peered":"2024-09-19T09:42:38.510684+0000","last_clean":"2024-09-19T09:42:38.510684+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:42:38.510684+0000","last_undegraded":"2024-09-19T09:42:38.510684+0000","last_fullsized":"2024-09-19T09:42:38.510684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807777+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:42:38.807777+0000","last_peered":"2024-09-19T09:42:38.807777+0000","last_clean":"2024-09-19T09:42:38.807777+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:42:38.807777+0000","last_undegraded":"2024-09-19T09:42:38.807777+0000","last_fullsized":"2024-09-19T09:42:38.807777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425650+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:42:39.425650+0000","last_peered":"2024-09-19T09:42:39.425650+0000","last_clean":"2024-09-19T09:42:39.425650+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:42:39.425650+0000","last_undegraded":"2024-09-19T09:42:39.425650+0000","last_fullsized":"2024-09-19T09:42:39.425650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425926+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:42:39.425926+0000","last_peered":"2024-09-19T09:42:39.425926+0000","last_clean":"2024-09-19T09:42:39.425926+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:42:39.425926+0000","last_undegraded":"2024-09-19T09:42:39.425926+0000","last_fullsized":"2024-09-19T09:42:39.425926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426684+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:42:39.426684+0000","last_peered":"2024-09-19T09:42:39.426684+0000","last_clean":"2024-09-19T09:42:39.426684+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:42:39.426684+0000","last_undegraded":"2024-09-19T09:42:39.426684+0000","last_fullsized":"2024-09-19T09:42:39.426684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924975+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:42:38.924975+0000","last_peered":"2024-09-19T09:42:38.924975+0000","last_clean":"2024-09-19T09:42:38.924975+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:42:38.924975+0000","last_undegraded":"2024-09-19T09:42:38.924975+0000","last_fullsized":"2024-09-19T09:42:38.924975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207933+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:42:39.207933+0000","last_peered":"2024-09-19T09:42:39.207933+0000","last_clean":"2024-09-19T09:42:39.207933+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:42:39.207933+0000","last_undegraded":"2024-09-19T09:42:39.207933+0000","last_fullsized":"2024-09-19T09:42:39.207933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512111+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:42:38.512111+0000","last_peered":"2024-09-19T09:42:38.512111+0000","last_clean":"2024-09-19T09:42:38.512111+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:42:38.512111+0000","last_undegraded":"2024-09-19T09:42:38.512111+0000","last_fullsized":"2024-09-19T09:42:38.512111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807900+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:42:38.807900+0000","last_peered":"2024-09-19T09:42:38.807900+0000","last_clean":"2024-09-19T09:42:38.807900+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:42:38.807900+0000","last_undegraded":"2024-09-19T09:42:38.807900+0000","last_fullsized":"2024-09-19T09:42:38.807900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426152+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:42:39.426152+0000","last_peered":"2024-09-19T09:42:39.426152+0000","last_clean":"2024-09-19T09:42:39.426152+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:42:39.426152+0000","last_undegraded":"2024-09-19T09:42:39.426152+0000","last_fullsized":"2024-09-19T09:42:39.426152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510406+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:42:38.510406+0000","last_peered":"2024-09-19T09:42:38.510406+0000","last_clean":"2024-09-19T09:42:38.510406+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:42:38.510406+0000","last_undegraded":"2024-09-19T09:42:38.510406+0000","last_fullsized":"2024-09-19T09:42:38.510406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426004+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:42:39.426004+0000","last_peered":"2024-09-19T09:42:39.426004+0000","last_clean":"2024-09-19T09:42:39.426004+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:42:39.426004+0000","last_undegraded":"2024-09-19T09:42:39.426004+0000","last_fullsized":"2024-09-19T09:42:39.426004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510568+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:42:38.510568+0000","last_peered":"2024-09-19T09:42:38.510568+0000","last_clean":"2024-09-19T09:42:38.510568+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:42:38.510568+0000","last_undegraded":"2024-09-19T09:42:38.510568+0000","last_fullsized":"2024-09-19T09:42:38.510568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512831+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:42:38.512831+0000","last_peered":"2024-09-19T09:42:38.512831+0000","last_clean":"2024-09-19T09:42:38.512831+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:42:38.512831+0000","last_undegraded":"2024-09-19T09:42:38.512831+0000","last_fullsized":"2024-09-19T09:42:38.512831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425723+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:42:39.425723+0000","last_peered":"2024-09-19T09:42:39.425723+0000","last_clean":"2024-09-19T09:42:39.425723+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:42:39.425723+0000","last_undegraded":"2024-09-19T09:42:39.425723+0000","last_fullsized":"2024-09-19T09:42:39.425723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510768+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:42:38.510768+0000","last_peered":"2024-09-19T09:42:38.510768+0000","last_clean":"2024-09-19T09:42:38.510768+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:42:38.510768+0000","last_undegraded":"2024-09-19T09:42:38.510768+0000","last_fullsized":"2024-09-19T09:42:38.510768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808033+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:42:38.808033+0000","last_peered":"2024-09-19T09:42:38.808033+0000","last_clean":"2024-09-19T09:42:38.808033+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:42:38.808033+0000","last_undegraded":"2024-09-19T09:42:38.808033+0000","last_fullsized":"2024-09-19T09:42:38.808033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426322+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:42:39.426322+0000","last_peered":"2024-09-19T09:42:39.426322+0000","last_clean":"2024-09-19T09:42:39.426322+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:42:39.426322+0000","last_undegraded":"2024-09-19T09:42:39.426322+0000","last_fullsized":"2024-09-19T09:42:39.426322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924787+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:42:38.924787+0000","last_peered":"2024-09-19T09:42:38.924787+0000","last_clean":"2024-09-19T09:42:38.924787+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:42:38.924787+0000","last_undegraded":"2024-09-19T09:42:38.924787+0000","last_fullsized":"2024-09-19T09:42:38.924787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512278+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:42:38.512278+0000","last_peered":"2024-09-19T09:42:38.512278+0000","last_clean":"2024-09-19T09:42:38.512278+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:42:38.512278+0000","last_undegraded":"2024-09-19T09:42:38.512278+0000","last_fullsized":"2024-09-19T09:42:38.512278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511859+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:42:38.511859+0000","last_peered":"2024-09-19T09:42:38.511859+0000","last_clean":"2024-09-19T09:42:38.511859+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:42:38.511859+0000","last_undegraded":"2024-09-19T09:42:38.511859+0000","last_fullsized":"2024-09-19T09:42:38.511859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510910+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:42:38.510910+0000","last_peered":"2024-09-19T09:42:38.510910+0000","last_clean":"2024-09-19T09:42:38.510910+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:42:38.510910+0000","last_undegraded":"2024-09-19T09:42:38.510910+0000","last_fullsized":"2024-09-19T09:42:38.510910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808051+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:42:38.808051+0000","last_peered":"2024-09-19T09:42:38.808051+0000","last_clean":"2024-09-19T09:42:38.808051+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:42:38.808051+0000","last_undegraded":"2024-09-19T09:42:38.808051+0000","last_fullsized":"2024-09-19T09:42:38.808051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512112+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:42:38.512112+0000","last_peered":"2024-09-19T09:42:38.512112+0000","last_clean":"2024-09-19T09:42:38.512112+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:42:38.512112+0000","last_undegraded":"2024-09-19T09:42:38.512112+0000","last_fullsized":"2024-09-19T09:42:38.512112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510468+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:42:38.510468+0000","last_peered":"2024-09-19T09:42:38.510468+0000","last_clean":"2024-09-19T09:42:38.510468+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:42:38.510468+0000","last_undegraded":"2024-09-19T09:42:38.510468+0000","last_fullsized":"2024-09-19T09:42:38.510468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510423+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:42:38.510423+0000","last_peered":"2024-09-19T09:42:38.510423+0000","last_clean":"2024-09-19T09:42:38.510423+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:42:38.510423+0000","last_undegraded":"2024-09-19T09:42:38.510423+0000","last_fullsized":"2024-09-19T09:42:38.510423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426077+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:42:39.426077+0000","last_peered":"2024-09-19T09:42:39.426077+0000","last_clean":"2024-09-19T09:42:39.426077+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:42:39.426077+0000","last_undegraded":"2024-09-19T09:42:39.426077+0000","last_fullsized":"2024-09-19T09:42:39.426077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425475+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:42:39.425475+0000","last_peered":"2024-09-19T09:42:39.425475+0000","last_clean":"2024-09-19T09:42:39.425475+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:42:39.425475+0000","last_undegraded":"2024-09-19T09:42:39.425475+0000","last_fullsized":"2024-09-19T09:42:39.425475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512425+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:42:38.512425+0000","last_peered":"2024-09-19T09:42:38.512425+0000","last_clean":"2024-09-19T09:42:38.512425+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:42:38.512425+0000","last_undegraded":"2024-09-19T09:42:38.512425+0000","last_fullsized":"2024-09-19T09:42:38.512425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426461+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:42:39.426461+0000","last_peered":"2024-09-19T09:42:39.426461+0000","last_clean":"2024-09-19T09:42:39.426461+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:42:39.426461+0000","last_undegraded":"2024-09-19T09:42:39.426461+0000","last_fullsized":"2024-09-19T09:42:39.426461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426390+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:42:39.426390+0000","last_peered":"2024-09-19T09:42:39.426390+0000","last_clean":"2024-09-19T09:42:39.426390+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:42:39.426390+0000","last_undegraded":"2024-09-19T09:42:39.426390+0000","last_fullsized":"2024-09-19T09:42:39.426390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.808057+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:42:38.808057+0000","last_peered":"2024-09-19T09:42:38.808057+0000","last_clean":"2024-09-19T09:42:38.808057+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:42:38.808057+0000","last_undegraded":"2024-09-19T09:42:38.808057+0000","last_fullsized":"2024-09-19T09:42:38.808057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515580+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:42:42.515580+0000","last_peered":"2024-09-19T09:42:42.515580+0000","last_clean":"2024-09-19T09:42:42.515580+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:42:42.515580+0000","last_undegraded":"2024-09-19T09:42:42.515580+0000","last_fullsized":"2024-09-19T09:42:42.515580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512565+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:42:38.512565+0000","last_peered":"2024-09-19T09:42:38.512565+0000","last_clean":"2024-09-19T09:42:38.512565+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:42:38.512565+0000","last_undegraded":"2024-09-19T09:42:38.512565+0000","last_fullsized":"2024-09-19T09:42:38.512565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.517809+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:42:42.517809+0000","last_peered":"2024-09-19T09:42:42.517809+0000","last_clean":"2024-09-19T09:42:42.517809+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:42:42.517809+0000","last_undegraded":"2024-09-19T09:42:42.517809+0000","last_fullsized":"2024-09-19T09:42:42.517809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207581+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:42:39.207581+0000","last_peered":"2024-09-19T09:42:39.207581+0000","last_clean":"2024-09-19T09:42:39.207581+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:42:39.207581+0000","last_undegraded":"2024-09-19T09:42:39.207581+0000","last_fullsized":"2024-09-19T09:42:39.207581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515658+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:42:42.515658+0000","last_peered":"2024-09-19T09:42:42.515658+0000","last_clean":"2024-09-19T09:42:42.515658+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:42:42.515658+0000","last_undegraded":"2024-09-19T09:42:42.515658+0000","last_fullsized":"2024-09-19T09:42:42.515658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807779+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:42:38.807779+0000","last_peered":"2024-09-19T09:42:38.807779+0000","last_clean":"2024-09-19T09:42:38.807779+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:42:38.807779+0000","last_undegraded":"2024-09-19T09:42:38.807779+0000","last_fullsized":"2024-09-19T09:42:38.807779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426290+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:42:39.426290+0000","last_peered":"2024-09-19T09:42:39.426290+0000","last_clean":"2024-09-19T09:42:39.426290+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:42:39.426290+0000","last_undegraded":"2024-09-19T09:42:39.426290+0000","last_fullsized":"2024-09-19T09:42:39.426290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207825+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:42:39.207825+0000","last_peered":"2024-09-19T09:42:39.207825+0000","last_clean":"2024-09-19T09:42:39.207825+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:42:39.207825+0000","last_undegraded":"2024-09-19T09:42:39.207825+0000","last_fullsized":"2024-09-19T09:42:39.207825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511816+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:42:38.511816+0000","last_peered":"2024-09-19T09:42:38.511816+0000","last_clean":"2024-09-19T09:42:38.511816+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:42:38.511816+0000","last_undegraded":"2024-09-19T09:42:38.511816+0000","last_fullsized":"2024-09-19T09:42:38.511816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512415+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:42:38.512415+0000","last_peered":"2024-09-19T09:42:38.512415+0000","last_clean":"2024-09-19T09:42:38.512415+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:42:38.512415+0000","last_undegraded":"2024-09-19T09:42:38.512415+0000","last_fullsized":"2024-09-19T09:42:38.512415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.518541+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:42:42.518541+0000","last_peered":"2024-09-19T09:42:42.518541+0000","last_clean":"2024-09-19T09:42:42.518541+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:42:42.518541+0000","last_undegraded":"2024-09-19T09:42:42.518541+0000","last_fullsized":"2024-09-19T09:42:42.518541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207561+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:42:39.207561+0000","last_peered":"2024-09-19T09:42:39.207561+0000","last_clean":"2024-09-19T09:42:39.207561+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:42:39.207561+0000","last_undegraded":"2024-09-19T09:42:39.207561+0000","last_fullsized":"2024-09-19T09:42:39.207561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512648+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:42:38.512648+0000","last_peered":"2024-09-19T09:42:38.512648+0000","last_clean":"2024-09-19T09:42:38.512648+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:42:38.512648+0000","last_undegraded":"2024-09-19T09:42:38.512648+0000","last_fullsized":"2024-09-19T09:42:38.512648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207957+0000","last_change":"2024-09-19T09:42:37.527327+0000","last_active":"2024-09-19T09:42:39.207957+0000","last_peered":"2024-09-19T09:42:39.207957+0000","last_clean":"2024-09-19T09:42:39.207957+0000","last_became_active":"2024-09-19T09:42:37.527040+0000","last_became_peered":"2024-09-19T09:42:37.527040+0000","last_unstale":"2024-09-19T09:42:39.207957+0000","last_undegraded":"2024-09-19T09:42:39.207957+0000","last_fullsized":"2024-09-19T09:42:39.207957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:07.533470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.517661+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:42:42.517661+0000","last_peered":"2024-09-19T09:42:42.517661+0000","last_clean":"2024-09-19T09:42:42.517661+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:42:42.517661+0000","last_undegraded":"2024-09-19T09:42:42.517661+0000","last_fullsized":"2024-09-19T09:42:42.517661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208167+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:42:39.208167+0000","last_peered":"2024-09-19T09:42:39.208167+0000","last_clean":"2024-09-19T09:42:39.208167+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:42:39.208167+0000","last_undegraded":"2024-09-19T09:42:39.208167+0000","last_fullsized":"2024-09-19T09:42:39.208167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425782+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:42:39.425782+0000","last_peered":"2024-09-19T09:42:39.425782+0000","last_clean":"2024-09-19T09:42:39.425782+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:42:39.425782+0000","last_undegraded":"2024-09-19T09:42:39.425782+0000","last_fullsized":"2024-09-19T09:42:39.425782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426436+0000","last_change":"2024-09-19T09:42:37.522994+0000","last_active":"2024-09-19T09:42:39.426436+0000","last_peered":"2024-09-19T09:42:39.426436+0000","last_clean":"2024-09-19T09:42:39.426436+0000","last_became_active":"2024-09-19T09:42:37.522404+0000","last_became_peered":"2024-09-19T09:42:37.522404+0000","last_unstale":"2024-09-19T09:42:39.426436+0000","last_undegraded":"2024-09-19T09:42:39.426436+0000","last_fullsized":"2024-09-19T09:42:39.426436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:19.189449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924791+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:42:38.924791+0000","last_peered":"2024-09-19T09:42:38.924791+0000","last_clean":"2024-09-19T09:42:38.924791+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:42:38.924791+0000","last_undegraded":"2024-09-19T09:42:38.924791+0000","last_fullsized":"2024-09-19T09:42:38.924791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207922+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:42:39.207922+0000","last_peered":"2024-09-19T09:42:39.207922+0000","last_clean":"2024-09-19T09:42:39.207922+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:42:39.207922+0000","last_undegraded":"2024-09-19T09:42:39.207922+0000","last_fullsized":"2024-09-19T09:42:39.207922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207308+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:42:39.207308+0000","last_peered":"2024-09-19T09:42:39.207308+0000","last_clean":"2024-09-19T09:42:39.207308+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:42:39.207308+0000","last_undegraded":"2024-09-19T09:42:39.207308+0000","last_fullsized":"2024-09-19T09:42:39.207308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425996+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:42:39.425996+0000","last_peered":"2024-09-19T09:42:39.425996+0000","last_clean":"2024-09-19T09:42:39.425996+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:42:39.425996+0000","last_undegraded":"2024-09-19T09:42:39.425996+0000","last_fullsized":"2024-09-19T09:42:39.425996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510573+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:42:38.510573+0000","last_peered":"2024-09-19T09:42:38.510573+0000","last_clean":"2024-09-19T09:42:38.510573+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:42:38.510573+0000","last_undegraded":"2024-09-19T09:42:38.510573+0000","last_fullsized":"2024-09-19T09:42:38.510573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207558+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:42:39.207558+0000","last_peered":"2024-09-19T09:42:39.207558+0000","last_clean":"2024-09-19T09:42:39.207558+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:42:39.207558+0000","last_undegraded":"2024-09-19T09:42:39.207558+0000","last_fullsized":"2024-09-19T09:42:39.207558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807721+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:42:38.807721+0000","last_peered":"2024-09-19T09:42:38.807721+0000","last_clean":"2024-09-19T09:42:38.807721+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:42:38.807721+0000","last_undegraded":"2024-09-19T09:42:38.807721+0000","last_fullsized":"2024-09-19T09:42:38.807721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.924736+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:42:38.924736+0000","last_peered":"2024-09-19T09:42:38.924736+0000","last_clean":"2024-09-19T09:42:38.924736+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:42:38.924736+0000","last_undegraded":"2024-09-19T09:42:38.924736+0000","last_fullsized":"2024-09-19T09:42:38.924736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425500+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:42:39.425500+0000","last_peered":"2024-09-19T09:42:39.425500+0000","last_clean":"2024-09-19T09:42:39.425500+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:42:39.425500+0000","last_undegraded":"2024-09-19T09:42:39.425500+0000","last_fullsized":"2024-09-19T09:42:39.425500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426521+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:42:39.426521+0000","last_peered":"2024-09-19T09:42:39.426521+0000","last_clean":"2024-09-19T09:42:39.426521+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:42:39.426521+0000","last_undegraded":"2024-09-19T09:42:39.426521+0000","last_fullsized":"2024-09-19T09:42:39.426521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511988+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:42:38.511988+0000","last_peered":"2024-09-19T09:42:38.511988+0000","last_clean":"2024-09-19T09:42:38.511988+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:42:38.511988+0000","last_undegraded":"2024-09-19T09:42:38.511988+0000","last_fullsized":"2024-09-19T09:42:38.511988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425551+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:42:39.425551+0000","last_peered":"2024-09-19T09:42:39.425551+0000","last_clean":"2024-09-19T09:42:39.425551+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:42:39.425551+0000","last_undegraded":"2024-09-19T09:42:39.425551+0000","last_fullsized":"2024-09-19T09:42:39.425551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426479+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:42:39.426479+0000","last_peered":"2024-09-19T09:42:39.426479+0000","last_clean":"2024-09-19T09:42:39.426479+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:42:39.426479+0000","last_undegraded":"2024-09-19T09:42:39.426479+0000","last_fullsized":"2024-09-19T09:42:39.426479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.208038+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:42:39.208038+0000","last_peered":"2024-09-19T09:42:39.208038+0000","last_clean":"2024-09-19T09:42:39.208038+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:42:39.208038+0000","last_undegraded":"2024-09-19T09:42:39.208038+0000","last_fullsized":"2024-09-19T09:42:39.208038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425565+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:42:39.425565+0000","last_peered":"2024-09-19T09:42:39.425565+0000","last_clean":"2024-09-19T09:42:39.425565+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:42:39.425565+0000","last_undegraded":"2024-09-19T09:42:39.425565+0000","last_fullsized":"2024-09-19T09:42:39.425565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425707+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:42:39.425707+0000","last_peered":"2024-09-19T09:42:39.425707+0000","last_clean":"2024-09-19T09:42:39.425707+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:42:39.425707+0000","last_undegraded":"2024-09-19T09:42:39.425707+0000","last_fullsized":"2024-09-19T09:42:39.425707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510775+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:42:38.510775+0000","last_peered":"2024-09-19T09:42:38.510775+0000","last_clean":"2024-09-19T09:42:38.510775+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:42:38.510775+0000","last_undegraded":"2024-09-19T09:42:38.510775+0000","last_fullsized":"2024-09-19T09:42:38.510775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516466+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:42:42.516466+0000","last_peered":"2024-09-19T09:42:42.516466+0000","last_clean":"2024-09-19T09:42:42.516466+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:42:42.516466+0000","last_undegraded":"2024-09-19T09:42:42.516466+0000","last_fullsized":"2024-09-19T09:42:42.516466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807908+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:42:38.807908+0000","last_peered":"2024-09-19T09:42:38.807908+0000","last_clean":"2024-09-19T09:42:38.807908+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:42:38.807908+0000","last_undegraded":"2024-09-19T09:42:38.807908+0000","last_fullsized":"2024-09-19T09:42:38.807908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.207343+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:42:39.207343+0000","last_peered":"2024-09-19T09:42:39.207343+0000","last_clean":"2024-09-19T09:42:39.207343+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:42:39.207343+0000","last_undegraded":"2024-09-19T09:42:39.207343+0000","last_fullsized":"2024-09-19T09:42:39.207343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.512166+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:42:38.512166+0000","last_peered":"2024-09-19T09:42:38.512166+0000","last_clean":"2024-09-19T09:42:38.512166+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:42:38.512166+0000","last_undegraded":"2024-09-19T09:42:38.512166+0000","last_fullsized":"2024-09-19T09:42:38.512166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425593+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:42:39.425593+0000","last_peered":"2024-09-19T09:42:39.425593+0000","last_clean":"2024-09-19T09:42:39.425593+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:42:39.425593+0000","last_undegraded":"2024-09-19T09:42:39.425593+0000","last_fullsized":"2024-09-19T09:42:39.425593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510540+0000","last_change":"2024-09-19T09:42:37.516217+0000","last_active":"2024-09-19T09:42:38.510540+0000","last_peered":"2024-09-19T09:42:38.510540+0000","last_clean":"2024-09-19T09:42:38.510540+0000","last_became_active":"2024-09-19T09:42:37.515940+0000","last_became_peered":"2024-09-19T09:42:37.515940+0000","last_unstale":"2024-09-19T09:42:38.510540+0000","last_undegraded":"2024-09-19T09:42:38.510540+0000","last_fullsized":"2024-09-19T09:42:38.510540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:45.394478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.425602+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:42:39.425602+0000","last_peered":"2024-09-19T09:42:39.425602+0000","last_clean":"2024-09-19T09:42:39.425602+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:42:39.425602+0000","last_undegraded":"2024-09-19T09:42:39.425602+0000","last_fullsized":"2024-09-19T09:42:39.425602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510830+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:42:38.510830+0000","last_peered":"2024-09-19T09:42:38.510830+0000","last_clean":"2024-09-19T09:42:38.510830+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:42:38.510830+0000","last_undegraded":"2024-09-19T09:42:38.510830+0000","last_fullsized":"2024-09-19T09:42:38.510830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516582+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:42:42.516582+0000","last_peered":"2024-09-19T09:42:42.516582+0000","last_clean":"2024-09-19T09:42:42.516582+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:42:42.516582+0000","last_undegraded":"2024-09-19T09:42:42.516582+0000","last_fullsized":"2024-09-19T09:42:42.516582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.511970+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:42:38.511970+0000","last_peered":"2024-09-19T09:42:38.511970+0000","last_clean":"2024-09-19T09:42:38.511970+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:42:38.511970+0000","last_undegraded":"2024-09-19T09:42:38.511970+0000","last_fullsized":"2024-09-19T09:42:38.511970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426400+0000","last_change":"2024-09-19T09:42:37.518467+0000","last_active":"2024-09-19T09:42:39.426400+0000","last_peered":"2024-09-19T09:42:39.426400+0000","last_clean":"2024-09-19T09:42:39.426400+0000","last_became_active":"2024-09-19T09:42:37.518088+0000","last_became_peered":"2024-09-19T09:42:37.518088+0000","last_unstale":"2024-09-19T09:42:39.426400+0000","last_undegraded":"2024-09-19T09:42:39.426400+0000","last_fullsized":"2024-09-19T09:42:39.426400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:50.680705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.515634+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:42:42.515634+0000","last_peered":"2024-09-19T09:42:42.515634+0000","last_clean":"2024-09-19T09:42:42.515634+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:42:42.515634+0000","last_undegraded":"2024-09-19T09:42:42.515634+0000","last_fullsized":"2024-09-19T09:42:42.515634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:39.426280+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:42:39.426280+0000","last_peered":"2024-09-19T09:42:39.426280+0000","last_clean":"2024-09-19T09:42:39.426280+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:42:39.426280+0000","last_undegraded":"2024-09-19T09:42:39.426280+0000","last_fullsized":"2024-09-19T09:42:39.426280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516048+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:42:42.516048+0000","last_peered":"2024-09-19T09:42:42.516048+0000","last_clean":"2024-09-19T09:42:42.516048+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:42:42.516048+0000","last_undegraded":"2024-09-19T09:42:42.516048+0000","last_fullsized":"2024-09-19T09:42:42.516048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.807921+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:42:38.807921+0000","last_peered":"2024-09-19T09:42:38.807921+0000","last_clean":"2024-09-19T09:42:38.807921+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:42:38.807921+0000","last_undegraded":"2024-09-19T09:42:38.807921+0000","last_fullsized":"2024-09-19T09:42:38.807921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510741+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:42:38.510741+0000","last_peered":"2024-09-19T09:42:38.510741+0000","last_clean":"2024-09-19T09:42:38.510741+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:42:38.510741+0000","last_undegraded":"2024-09-19T09:42:38.510741+0000","last_fullsized":"2024-09-19T09:42:38.510741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:38.510810+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:42:38.510810+0000","last_peered":"2024-09-19T09:42:38.510810+0000","last_clean":"2024-09-19T09:42:38.510810+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:42:38.510810+0000","last_undegraded":"2024-09-19T09:42:38.510810+0000","last_fullsized":"2024-09-19T09:42:38.510810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-19T09:42:42.516995+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:42:42.516995+0000","last_peered":"2024-09-19T09:42:42.516995+0000","last_clean":"2024-09-19T09:42:42.516995+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:42:42.516995+0000","last_undegraded":"2024-09-19T09:42:42.516995+0000","last_fullsized":"2024-09-19T09:42:42.516995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:42:51.493 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:42:51.493 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:42:51.493 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:42:51.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T09:42:51.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.624+0000 7f9cc100e640 1 Processor -- start 2024-09-19T09:42:51.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.624+0000 7f9cc100e640 1 -- start start 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cc100e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc0c4ba0 0x7f9cbc072310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cc100e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cbc0c85d0 0x7f9cbc072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cc100e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cbc073db0 con 0x7f9cbc1554d0 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cc100e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9cbc0c8f90 con 0x7f9cbc0c85d0 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cc100e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc1558b0 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cbb59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cbc0c85d0 0x7f9cbc072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cbad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9cbc1554d0 0x7f9cbc15b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58896/0 (socket says 172.21.15.123:58896) 2024-09-19T09:42:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cbad9d640 1 -- 172.21.15.123:0/2114182415 learned_addr learned my addr 172.21.15.123:0/2114182415 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cba59c640 1 --2- 172.21.15.123:0/2114182415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc0c4ba0 0x7f9cbc072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.625+0000 7f9cbb59e640 1 -- 172.21.15.123:0/2114182415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc0c4ba0 msgr2=0x7f9cbc072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cbb59e640 1 --2- 172.21.15.123:0/2114182415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc0c4ba0 0x7f9cbc072310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cbb59e640 1 -- 172.21.15.123:0/2114182415 >> v1:172.21.15.123:6789/0 conn(0x7f9cbc1554d0 legacy=0x7f9cbc15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cbb59e640 1 -- 172.21.15.123:0/2114182415 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc0c9eb0 con 0x7f9cbc0c85d0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cb9d9b640 1 -- 172.21.15.123:0/2114182415 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332471117 0 0) 0x7f9cbc073db0 con 0x7f9cbc1554d0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cbb59e640 1 --2- 172.21.15.123:0/2114182415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc072850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009d90 tx=0x7f9cb402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcaea2e92803c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cb9d9b640 1 -- 172.21.15.123:0/2114182415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007740 con 0x7f9cbc0c85d0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cb9d9b640 1 -- 172.21.15.123:0/2114182415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb40078e0 con 0x7f9cbc0c85d0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.626+0000 7f9cb9d9b640 1 -- 172.21.15.123:0/2114182415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007cb0 con 0x7f9cbc0c85d0 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 -- 172.21.15.123:0/2114182415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c85d0 msgr2=0x7f9cbc072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 --2- 172.21.15.123:0/2114182415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc072850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009d90 tx=0x7f9cb402a6f0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 -- 172.21.15.123:0/2114182415 shutdown_connections 2024-09-19T09:42:51.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 --2- 172.21.15.123:0/2114182415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc072850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 --2- 172.21.15.123:0/2114182415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc0c4ba0 0x7f9cbc072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 -- 172.21.15.123:0/2114182415 >> 172.21.15.123:0/2114182415 conn(0x7f9cbc0cdbd0 msgr2=0x7f9cbc0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 -- 172.21.15.123:0/2114182415 shutdown_connections 2024-09-19T09:42:51.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.627+0000 7f9cc100e640 1 -- 172.21.15.123:0/2114182415 wait complete. 2024-09-19T09:42:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.628+0000 7f9cc100e640 1 Processor -- start 2024-09-19T09:42:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.628+0000 7f9cc100e640 1 -- start start 2024-09-19T09:42:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cc100e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 0x7f9cbc151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cc100e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc1e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cc100e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc1554d0 0x7f9cbc1f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cc100e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c9510 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cc100e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c9230 con 0x7f9cbc0c85d0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cc100e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc06d6b0 con 0x7f9cbc1554d0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 0x7f9cbc151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 0x7f9cbc151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60302/0 (socket says 172.21.15.123:60302) 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 -- 172.21.15.123:0/1188610530 learned_addr learned my addr 172.21.15.123:0/1188610530 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cba59c640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc1e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbb59e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc1554d0 0x7f9cbc1f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 -- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc1554d0 msgr2=0x7f9cbc1f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc1554d0 0x7f9cbc1f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 -- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc0c85d0 msgr2=0x7f9cbc1e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc1e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.629+0000 7f9cbad9d640 1 -- 172.21.15.123:0/1188610530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc1f11c0 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.630+0000 7f9cbad9d640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 0x7f9cbc151670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c430 tx=0x7f9ca400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.630+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4017070 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.630+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca4005ce0 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.630+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc154230 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.630+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4007310 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.630+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1f1460 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.631+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc1f0fb0 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.631+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ca401a070 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.631+0000 7f9cb37fe640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9c9c06c2b0 0x7f9c9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.632+0000 7f9cba59c640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9c9c06c2b0 0x7f9c9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.632+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9ca408a760 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.632+0000 7f9cba59c640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9c9c06c2b0 0x7f9c9c06e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc1e6ae0 tx=0x7f9cac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.636+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9ca4058f60 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.838+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9cbc0ca470 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.838+0000 7f9cb37fe640 1 -- 172.21.15.123:0/1188610530 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9ca4058860 con 0x7f9cbc0c4ba0 2024-09-19T09:42:51.840 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:51.841 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:42:51.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9c9c06c2b0 msgr2=0x7f9c9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9c9c06c2b0 0x7f9c9c06e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc1e6ae0 tx=0x7f9cac008040 comp rx=0 tx=0).stop 2024-09-19T09:42:51.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 msgr2=0x7f9cbc151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 0x7f9cbc151670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c430 tx=0x7f9ca400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 shutdown_connections 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9c9c06c2b0 0x7f9c9c06e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cbc1554d0 0x7f9cbc1f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cbc0c85d0 0x7f9cbc1e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 --2- 172.21.15.123:0/1188610530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cbc0c4ba0 0x7f9cbc151670 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 >> 172.21.15.123:0/1188610530 conn(0x7f9cbc0cdbd0 msgr2=0x7f9cbc0cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 shutdown_connections 2024-09-19T09:42:51.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.840+0000 7f9cc100e640 1 -- 172.21.15.123:0/1188610530 wait complete. 2024-09-19T09:42:51.853 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:42:51.853 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:42:51.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.949+0000 7f20d768b640 1 Processor -- start 2024-09-19T09:42:51.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.949+0000 7f20d768b640 1 -- start start 2024-09-19T09:42:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d768b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20d015f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d768b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00c9ce0 con 0x7f20d01588e0 2024-09-19T09:42:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d768b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00c9f80 con 0x7f20d00cb670 2024-09-19T09:42:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d768b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f20d015f650 con 0x7f20d00c95e0 2024-09-19T09:42:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d5427640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f20d01588e0 0x7f20d00ca3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58898/0 (socket says 172.21.15.123:58898) 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d5427640 1 -- 172.21.15.123:0/209006818 learned_addr learned my addr 172.21.15.123:0/209006818 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20d4c26640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20d015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566541051 0 0) 0x7f20d00c9ce0 con 0x7f20d01588e0 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20bc003520 con 0x7f20d01588e0 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2550123066 0 0) 0x7f20bc003520 con 0x7f20d01588e0 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 msgr2=0x7f20d015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20d015f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 >> v1:172.21.15.194:6789/0 conn(0x7f20d00cb670 legacy=0x7f20d0165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d015b2a0 con 0x7f20d01588e0 2024-09-19T09:42:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f20cc001670 con 0x7f20d01588e0 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 >> v1:172.21.15.123:6789/0 conn(0x7f20d01588e0 legacy=0x7f20d00ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20bc0039e0 0x7f20bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20bc004390 0x7f20bc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20bc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20d015f650 con 0x7f20bc004390 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc00b9f0 con 0x7f20bc0039e0 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.950+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc00bbf0 con 0x7f20d00c95e0 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20bc004390 0x7f20bc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d5427640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20bc0039e0 0x7f20bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d5c28640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20bc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 -- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 msgr2=0x7f20bc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20bc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 -- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20bc0039e0 msgr2=0x7f20bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20bc0039e0 0x7f20bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 -- 172.21.15.123:0/209006818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc003520 con 0x7f20bc004390 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d5427640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20bc0039e0 0x7f20bc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d5c28640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20d00c95e0 0x7f20bc0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.951+0000 7f20d4c26640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20bc004390 0x7f20bc004860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ac0 tx=0x7f20bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e06497445757ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0036070 con 0x7f20bc004390 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c0031400 con 0x7f20bc004390 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20c7fff640 1 -- 172.21.15.123:0/209006818 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0009690 con 0x7f20bc004390 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d768b640 1 -- 172.21.15.123:0/209006818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20bc004390 msgr2=0x7f20bc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d768b640 1 --2- 172.21.15.123:0/209006818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20bc004390 0x7f20bc004860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ac0 tx=0x7f20bc005830 comp rx=0 tx=0).stop 2024-09-19T09:42:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d5c28640 1 -- 172.21.15.123:0/209006818 reap_dead start 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d768b640 1 -- 172.21.15.123:0/209006818 shutdown_connections 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d768b640 1 -- 172.21.15.123:0/209006818 >> 172.21.15.123:0/209006818 conn(0x7f20d0073950 msgr2=0x7f20d0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d768b640 1 -- 172.21.15.123:0/209006818 shutdown_connections 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.952+0000 7f20d768b640 1 -- 172.21.15.123:0/209006818 wait complete. 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.953+0000 7f20d768b640 1 Processor -- start 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.953+0000 7f20d768b640 1 -- start start 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d768b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20bc004390 0x7f20d00c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d768b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 0x7f20d01f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d768b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20d014a4d0 0x7f20d014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d768b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00caae0 con 0x7f20d014e690 2024-09-19T09:42:51.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d768b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f20d015b860 con 0x7f20d014a4d0 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d768b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f20d00c99e0 con 0x7f20bc004390 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 0x7f20d01f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 0x7f20d01f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60330/0 (socket says 172.21.15.123:60330) 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 -- 172.21.15.123:0/548468983 learned_addr learned my addr 172.21.15.123:0/548468983 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 -- 172.21.15.123:0/548468983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20bc004390 msgr2=0x7f20d00c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20bc004390 0x7f20d00c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 -- 172.21.15.123:0/548468983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20d014a4d0 msgr2=0x7f20d014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20d014a4d0 0x7f20d014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.954+0000 7f20d4c26640 1 -- 172.21.15.123:0/548468983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d00c7b00 con 0x7f20d014e690 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.955+0000 7f20d4c26640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 0x7f20d01f0d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20c0034040 tx=0x7f20c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.955+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0041020 con 0x7f20d014e690 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.955+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c003c470 con 0x7f20d014e690 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.955+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0036040 con 0x7f20d014e690 2024-09-19T09:42:51.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.955+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d00c7de0 con 0x7f20d014e690 2024-09-19T09:42:51.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.955+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d01f47b0 con 0x7f20d014e690 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.956+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d015c060 con 0x7f20d014e690 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.956+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f20c0044020 con 0x7f20d014e690 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.957+0000 7f20c5ffb640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f20b406c2b0 0x7f20b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.957+0000 7f20d5427640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f20b406c2b0 0x7f20b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.957+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f20c00abcf0 con 0x7f20d014e690 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.957+0000 7f20d5427640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f20b406c2b0 0x7f20b406e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001c60 tx=0x7f20cc001ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:51.961+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f20c004b030 con 0x7f20d014e690 2024-09-19T09:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.162+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20d00c8dd0 con 0x7f20d014e690 2024-09-19T09:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.162+0000 7f20c5ffb640 1 -- 172.21.15.123:0/548468983 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f20c007a460 con 0x7f20d014e690 2024-09-19T09:42:52.164 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:52.165 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.164+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f20b406c2b0 msgr2=0x7f20b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.164+0000 7f20d768b640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f20b406c2b0 0x7f20b406e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001c60 tx=0x7f20cc001ab0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.164+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 msgr2=0x7f20d01f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.164+0000 7f20d768b640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 0x7f20d01f0d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20c0034040 tx=0x7f20c0004730 comp rx=0 tx=0).stop 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 shutdown_connections 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20d014a4d0 0x7f20d014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d014e690 0x7f20d01f0d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f20b406c2b0 0x7f20b406e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 --2- 172.21.15.123:0/548468983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20bc004390 0x7f20d00c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 >> 172.21.15.123:0/548468983 conn(0x7f20d0073950 msgr2=0x7f20d01552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 shutdown_connections 2024-09-19T09:42:52.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.165+0000 7f20d768b640 1 -- 172.21.15.123:0/548468983 wait complete. 2024-09-19T09:42:52.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:42:52.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 Processor -- start 2024-09-19T09:42:52.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 -- start start 2024-09-19T09:42:52.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1284151fc0 0x7f12840c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1284072770 0x7f12841588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1284157e20 con 0x7f12841523a0 2024-09-19T09:42:52.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1284158e20 con 0x7f1284151fc0 2024-09-19T09:42:52.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.274+0000 7f128adfd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f1284072100 con 0x7f1284072770 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1284151fc0 0x7f12840c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1284151fc0 0x7f12840c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60338/0 (socket says 172.21.15.123:60338) 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 -- 172.21.15.123:0/236087504 learned_addr learned my addr 172.21.15.123:0/236087504 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f128939a640 1 --2- 172.21.15.123:0/236087504 >> v2:172.21.15.194:3300/0 conn(0x7f1284072770 0x7f12841588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 -- 172.21.15.123:0/236087504 >> v2:172.21.15.194:3300/0 conn(0x7f1284072770 msgr2=0x7f12841588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 --2- 172.21.15.123:0/236087504 >> v2:172.21.15.194:3300/0 conn(0x7f1284072770 0x7f12841588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 -- 172.21.15.123:0/236087504 >> v1:172.21.15.194:6789/0 conn(0x7f12841523a0 legacy=0x7f12840710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.275+0000 7f1288b99640 1 -- 172.21.15.123:0/236087504 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840723e0 con 0x7f1284151fc0 2024-09-19T09:42:52.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f1288b99640 1 --2- 172.21.15.123:0/236087504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840c88b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f12840cd970 tx=0x7f127802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a82b89c0e439b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f12837fe640 1 -- 172.21.15.123:0/236087504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278037070 con 0x7f1284151fc0 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f12837fe640 1 -- 172.21.15.123:0/236087504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1278032440 con 0x7f1284151fc0 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f12837fe640 1 -- 172.21.15.123:0/236087504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278032810 con 0x7f1284151fc0 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 -- 172.21.15.123:0/236087504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 msgr2=0x7f12840c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 --2- 172.21.15.123:0/236087504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840c88b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f12840cd970 tx=0x7f127802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 -- 172.21.15.123:0/236087504 shutdown_connections 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 --2- 172.21.15.123:0/236087504 >> v2:172.21.15.194:3300/0 conn(0x7f1284072770 0x7f12841588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 --2- 172.21.15.123:0/236087504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840c88b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 -- 172.21.15.123:0/236087504 >> 172.21.15.123:0/236087504 conn(0x7f128406ec90 msgr2=0x7f128406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 -- 172.21.15.123:0/236087504 shutdown_connections 2024-09-19T09:42:52.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.276+0000 7f128adfd640 1 -- 172.21.15.123:0/236087504 wait complete. 2024-09-19T09:42:52.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.277+0000 7f128adfd640 1 Processor -- start 2024-09-19T09:42:52.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.277+0000 7f128adfd640 1 -- start start 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f128adfd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1284072770 0x7f12841f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f128adfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f128adfd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12840ba8b0 0x7f1284151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f128adfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1284071800 con 0x7f1284151fc0 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f128adfd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f12841583c0 con 0x7f12840ba8b0 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f128adfd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1284071980 con 0x7f1284072770 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f1283fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f1283fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60342/0 (socket says 172.21.15.123:60342) 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.278+0000 7f1283fff640 1 -- 172.21.15.123:0/2083248074 learned_addr learned my addr 172.21.15.123:0/2083248074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1288b99640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1284072770 0x7f12841f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f128939a640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12840ba8b0 0x7f1284151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1283fff640 1 -- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1284072770 msgr2=0x7f12841f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1283fff640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1284072770 0x7f12841f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1283fff640 1 -- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12840ba8b0 msgr2=0x7f1284151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1283fff640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12840ba8b0 0x7f1284151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1283fff640 1 -- 172.21.15.123:0/2083248074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840bde40 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f1283fff640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840ccb40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f127000c400 tx=0x7f127000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700052d0 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1270005490 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270007260 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1284154ce0 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.279+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1284154f80 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.280+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128415b3d0 con 0x7f1284151fc0 2024-09-19T09:42:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.280+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1270007400 con 0x7f1284151fc0 2024-09-19T09:42:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.281+0000 7f12817fa640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f126806c2e0 0x7f126806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.281+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f127008a930 con 0x7f1284151fc0 2024-09-19T09:42:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.281+0000 7f1288b99640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f126806c2e0 0x7f126806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.281+0000 7f1288b99640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f126806c2e0 0x7f126806e7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1278034000 tx=0x7f127802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.285+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f12840bde40 con 0x7f1284151fc0 2024-09-19T09:42:52.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.481+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f128406f3d0 con 0x7f1284151fc0 2024-09-19T09:42:52.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.482+0000 7f12817fa640 1 -- 172.21.15.123:0/2083248074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f1270059130 con 0x7f1284151fc0 2024-09-19T09:42:52.484 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:52.484 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:42:52.484 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:42:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.483+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f126806c2e0 msgr2=0x7f126806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.483+0000 7f128adfd640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f126806c2e0 0x7f126806e7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1278034000 tx=0x7f127802e000 comp rx=0 tx=0).stop 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.483+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 msgr2=0x7f12840ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.483+0000 7f128adfd640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840ccb40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f127000c400 tx=0x7f127000c8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 shutdown_connections 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12840ba8b0 0x7f1284151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1284151fc0 0x7f12840ccb40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f126806c2e0 0x7f126806e7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 --2- 172.21.15.123:0/2083248074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1284072770 0x7f12841f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 >> 172.21.15.123:0/2083248074 conn(0x7f128406ec90 msgr2=0x7f1284073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 shutdown_connections 2024-09-19T09:42:52.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.484+0000 7f128adfd640 1 -- 172.21.15.123:0/2083248074 wait complete. 2024-09-19T09:42:52.496 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:42:52.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.592+0000 7fd2bf9d8640 1 Processor -- start 2024-09-19T09:42:52.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.592+0000 7fd2bf9d8640 1 -- start start 2024-09-19T09:42:52.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.593+0000 7fd2bf9d8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 0x7fd2b815bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.593+0000 7fd2bf9d8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 0x7fd2b806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.593+0000 7fd2bf9d8640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b80c8770 con 0x7fd2b806d160 2024-09-19T09:42:52.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.593+0000 7fd2bf9d8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b815c320 con 0x7fd2b80705b0 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.593+0000 7fd2bf9d8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b8073090 con 0x7fd2b80c7740 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bd774640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 0x7fd2b815bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bcf73640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 0x7fd2b806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bdf75640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd2b806d160 0x7fd2b815ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:54990/0 (socket says 172.21.15.123:54990) 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bdf75640 1 -- 172.21.15.123:0/3103294924 learned_addr learned my addr 172.21.15.123:0/3103294924 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bd774640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 0x7fd2b815bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49644/0 (socket says 172.21.15.123:49644) 2024-09-19T09:42:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bcf73640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 0x7fd2b806cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56290/0 (socket says 172.21.15.123:56290) 2024-09-19T09:42:52.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2affff640 1 -- 172.21.15.123:0/3103294924 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099044092 0 0) 0x7fd2b80c8770 con 0x7fd2b806d160 2024-09-19T09:42:52.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2affff640 1 -- 172.21.15.123:0/3103294924 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2a4003520 con 0x7fd2b806d160 2024-09-19T09:42:52.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bd774640 1 -- 172.21.15.123:0/3103294924 >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 msgr2=0x7fd2b806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bd774640 1 --2- 172.21.15.123:0/3103294924 >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 0x7fd2b806cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bd774640 1 -- 172.21.15.123:0/3103294924 >> v1:172.21.15.194:6789/0 conn(0x7fd2b806d160 legacy=0x7fd2b815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bd774640 1 -- 172.21.15.123:0/3103294924 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b80721a0 con 0x7fd2b80c7740 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.594+0000 7fd2bcf73640 1 --2- 172.21.15.123:0/3103294924 >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 0x7fd2b806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bd774640 1 --2- 172.21.15.123:0/3103294924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 0x7fd2b815bde0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40097a0 tx=0x7fd2b402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea388e96a553fd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2affff640 1 -- 172.21.15.123:0/3103294924 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4037070 con 0x7fd2b80c7740 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2affff640 1 -- 172.21.15.123:0/3103294924 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b4032440 con 0x7fd2b80c7740 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2affff640 1 -- 172.21.15.123:0/3103294924 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40327f0 con 0x7fd2b80c7740 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3103294924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 msgr2=0x7fd2b815bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3103294924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 0x7fd2b815bde0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40097a0 tx=0x7fd2b402a210 comp rx=0 tx=0).stop 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3103294924 shutdown_connections 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3103294924 >> v2:172.21.15.194:3300/0 conn(0x7fd2b80705b0 0x7fd2b806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3103294924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b80c7740 0x7fd2b815bde0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.595+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3103294924 >> 172.21.15.123:0/3103294924 conn(0x7fd2b806fa90 msgr2=0x7fd2b806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.596+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3103294924 shutdown_connections 2024-09-19T09:42:52.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.596+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3103294924 wait complete. 2024-09-19T09:42:52.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 Processor -- start 2024-09-19T09:42:52.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 -- start start 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b806d160 0x7fd2b81e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 0x7fd2b81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2b80c7740 0x7fd2b8159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8072a40 con 0x7fd2b80705b0 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8072760 con 0x7fd2b80c7740 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bf9d8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b8072d20 con 0x7fd2b806d160 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.597+0000 7fd2bcf73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 0x7fd2b81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 0x7fd2b81560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60352/0 (socket says 172.21.15.123:60352) 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 -- 172.21.15.123:0/3313951835 learned_addr learned my addr 172.21.15.123:0/3313951835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bdf75640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2b80c7740 0x7fd2b8159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bd774640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b806d160 0x7fd2b81e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 -- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b806d160 msgr2=0x7fd2b81e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b806d160 0x7fd2b81e6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 -- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2b80c7740 msgr2=0x7fd2b8159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2b80c7740 0x7fd2b8159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 -- 172.21.15.123:0/3313951835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b815ac60 con 0x7fd2b80705b0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bdf75640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2b80c7740 0x7fd2b8159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bd774640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b806d160 0x7fd2b81e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bcf73640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 0x7fd2b81560d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800ebb0 tx=0x7fd2a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8017070 con 0x7fd2b80705b0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a800cc30 con 0x7fd2b80705b0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b8144940 con 0x7fd2b80705b0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8013470 con 0x7fd2b80705b0 2024-09-19T09:42:52.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.598+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b8157500 con 0x7fd2b80705b0 2024-09-19T09:42:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.599+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b80cb680 con 0x7fd2b80705b0 2024-09-19T09:42:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.600+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2a801a070 con 0x7fd2b80705b0 2024-09-19T09:42:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.600+0000 7fd2adffb640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd29c06c2b0 0x7fd29c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.600+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a808b410 con 0x7fd2b80705b0 2024-09-19T09:42:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.600+0000 7fd2bd774640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd29c06c2b0 0x7fd29c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.601+0000 7fd2bd774640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd29c06c2b0 0x7fd29c06e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4034000 tx=0x7fd2b402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.604+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd2b80cb680 con 0x7fd2b80705b0 2024-09-19T09:42:52.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.772+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2b815bb60 con 0x7fd2b80705b0 2024-09-19T09:42:52.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.773+0000 7fd2adffb640 1 -- 172.21.15.123:0/3313951835 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16701 (secure 0 0 0) 0x7fd2b815bb60 con 0x7fd2b80705b0 2024-09-19T09:42:52.775 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:52.776 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:42:38.507234+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd29c06c2b0 msgr2=0x7fd29c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd29c06c2b0 0x7fd29c06e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4034000 tx=0x7fd2b402e000 comp rx=0 tx=0).stop 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 msgr2=0x7fd2b81560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 0x7fd2b81560d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800ebb0 tx=0x7fd2a800c520 comp rx=0 tx=0).stop 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 shutdown_connections 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2b80c7740 0x7fd2b8159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b80705b0 0x7fd2b81560d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd29c06c2b0 0x7fd29c06e770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 --2- 172.21.15.123:0/3313951835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2b806d160 0x7fd2b81e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 >> 172.21.15.123:0/3313951835 conn(0x7fd2b806fa90 msgr2=0x7fd2b80c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 shutdown_connections 2024-09-19T09:42:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.776+0000 7fd2bf9d8640 1 -- 172.21.15.123:0/3313951835 wait complete. 2024-09-19T09:42:52.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:42:52.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.885+0000 7f04c780a640 1 Processor -- start 2024-09-19T09:42:52.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.885+0000 7f04c780a640 1 -- start start 2024-09-19T09:42:52.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c780a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04c0151fc0 0x7f04c00c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c780a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04c0072770 0x7f04c01588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c780a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04c0157e20 con 0x7f04c01523a0 2024-09-19T09:42:52.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c780a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f04c0158e20 con 0x7f04c0151fc0 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c780a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f04c0072100 con 0x7f04c0072770 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04c0151fc0 0x7f04c00c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04c0151fc0 0x7f04c00c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60356/0 (socket says 172.21.15.123:60356) 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 -- 172.21.15.123:0/1106141066 learned_addr learned my addr 172.21.15.123:0/1106141066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 -- 172.21.15.123:0/1106141066 >> v2:172.21.15.194:3300/0 conn(0x7f04c0072770 msgr2=0x7f04c01588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 --2- 172.21.15.123:0/1106141066 >> v2:172.21.15.194:3300/0 conn(0x7f04c0072770 0x7f04c01588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 -- 172.21.15.123:0/1106141066 >> v1:172.21.15.194:6789/0 conn(0x7f04c01523a0 legacy=0x7f04c00710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:52.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.886+0000 7f04c55a6640 1 -- 172.21.15.123:0/1106141066 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c00723e0 con 0x7f04c0151fc0 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.887+0000 7f04c55a6640 1 --2- 172.21.15.123:0/1106141066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0151fc0 0x7f04c00c88b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04c00cd970 tx=0x7f04bc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2999e881c8d74c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.887+0000 7f04b7fff640 1 -- 172.21.15.123:0/1106141066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc036070 con 0x7f04c0151fc0 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.887+0000 7f04b7fff640 1 -- 172.21.15.123:0/1106141066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc031600 con 0x7f04c0151fc0 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.887+0000 7f04b7fff640 1 -- 172.21.15.123:0/1106141066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0319d0 con 0x7f04c0151fc0 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 -- 172.21.15.123:0/1106141066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0151fc0 msgr2=0x7f04c00c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 --2- 172.21.15.123:0/1106141066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0151fc0 0x7f04c00c88b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04c00cd970 tx=0x7f04bc02a660 comp rx=0 tx=0).stop 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 -- 172.21.15.123:0/1106141066 shutdown_connections 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 --2- 172.21.15.123:0/1106141066 >> v2:172.21.15.194:3300/0 conn(0x7f04c0072770 0x7f04c01588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 --2- 172.21.15.123:0/1106141066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0151fc0 0x7f04c00c88b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 -- 172.21.15.123:0/1106141066 >> 172.21.15.123:0/1106141066 conn(0x7f04c006ec90 msgr2=0x7f04c006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 -- 172.21.15.123:0/1106141066 shutdown_connections 2024-09-19T09:42:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.888+0000 7f04c780a640 1 -- 172.21.15.123:0/1106141066 wait complete. 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.889+0000 7f04c780a640 1 Processor -- start 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.889+0000 7f04c780a640 1 -- start start 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 0x7f04c01f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04c0151fc0 0x7f04c0150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04c014db50 0x7f04c0148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0071800 con 0x7f04c0072770 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01583c0 con 0x7f04c0151fc0 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f04c0071980 con 0x7f04c014db50 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 0x7f04c01f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 0x7f04c01f1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60360/0 (socket says 172.21.15.123:60360) 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 -- 172.21.15.123:0/3892275875 learned_addr learned my addr 172.21.15.123:0/3892275875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c4da5640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04c0151fc0 0x7f04c0150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c5da7640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04c014db50 0x7f04c0148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 -- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04c014db50 msgr2=0x7f04c0148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04c014db50 0x7f04c0148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 -- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04c0151fc0 msgr2=0x7f04c0150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04c0151fc0 0x7f04c0150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 -- 172.21.15.123:0/3892275875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c01e1930 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c55a6640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 0x7f04c01f1250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04bc034040 tx=0x7f04bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc036040 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc007680 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c01e1650 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.890+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc007a70 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.891+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c015ae90 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.892+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c00c4490 con 0x7f04c0072770 2024-09-19T09:42:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.892+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f04bc007c10 con 0x7f04c0072770 2024-09-19T09:42:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.892+0000 7f04b5ffb640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f04a406c2e0 0x7f04a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.893+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f04bc0ada80 con 0x7f04c0072770 2024-09-19T09:42:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.893+0000 7f04c4da5640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f04a406c2e0 0x7f04a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.893+0000 7f04c4da5640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f04a406c2e0 0x7f04a406e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04b0007fd0 tx=0x7f04b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:52.897+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f04bc04a060 con 0x7f04c0072770 2024-09-19T09:42:53.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.095+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04c0156110 con 0x7f04c0072770 2024-09-19T09:42:53.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.096+0000 7f04b5ffb640 1 -- 172.21.15.123:0/3892275875 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f04bc07bcf0 con 0x7f04c0072770 2024-09-19T09:42:53.098 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:42:53.098 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:42:53.098 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f04a406c2e0 msgr2=0x7f04a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f04a406c2e0 0x7f04a406e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04b0007fd0 tx=0x7f04b0009040 comp rx=0 tx=0).stop 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 msgr2=0x7f04c01f1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 0x7f04c01f1250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04bc034040 tx=0x7f04bc004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 shutdown_connections 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f04a406c2e0 0x7f04a406e7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04c014db50 0x7f04c0148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04c0151fc0 0x7f04c0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 --2- 172.21.15.123:0/3892275875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c0072770 0x7f04c01f1250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 >> 172.21.15.123:0/3892275875 conn(0x7f04c006ec90 msgr2=0x7f04c00c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 shutdown_connections 2024-09-19T09:42:53.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.098+0000 7f04c780a640 1 -- 172.21.15.123:0/3892275875 wait complete. 2024-09-19T09:42:53.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:42:36.824422+0000', 'modified': '2024-09-19T09:42:42.526063+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6839/1314641752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 1314641752}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 1314641752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4308]} 2024-09-19T09:42:53.716 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:42:53.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-19T09:42:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.815+0000 7ff8cc87b640 1 Processor -- start 2024-09-19T09:42:53.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.816+0000 7ff8cc87b640 1 -- start start 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.816+0000 7ff8cc87b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8c80c5e30 0x7ff8c815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.816+0000 7ff8cc87b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c806c050 con 0x7ff8c806c9c0 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.816+0000 7ff8cc87b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c806c330 con 0x7ff8c81581d0 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.816+0000 7ff8cc87b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c81576f0 con 0x7ff8c80c5e30 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8c80c5e30 0x7ff8c815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c6d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff8c806c9c0 0x7ff8c8071820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54906/0 (socket says 172.21.15.123:54906) 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8c80c5e30 0x7ff8c815aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32792/0 (socket says 172.21.15.123:32792) 2024-09-19T09:42:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/3404583145 learned_addr learned my addr 172.21.15.123:0/3404583145 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:42:53.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c659c640 1 -- 172.21.15.123:0/3404583145 >> v1:172.21.15.194:6789/0 conn(0x7ff8c81581d0 legacy=0x7ff8c8071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c659c640 1 -- 172.21.15.123:0/3404583145 >> v1:172.21.15.123:6789/0 conn(0x7ff8c806c9c0 legacy=0x7ff8c8071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c659c640 1 -- 172.21.15.123:0/3404583145 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81579d0 con 0x7ff8c80c5e30 2024-09-19T09:42:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.817+0000 7ff8c659c640 1 --2- 172.21.15.123:0/3404583145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815aa70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097a0 tx=0x7ff8b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da547ee65979f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8c559a640 1 -- 172.21.15.123:0/3404583145 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8037070 con 0x7ff8c80c5e30 2024-09-19T09:42:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8c559a640 1 -- 172.21.15.123:0/3404583145 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b8032440 con 0x7ff8c80c5e30 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8c559a640 1 -- 172.21.15.123:0/3404583145 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8032810 con 0x7ff8c80c5e30 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 -- 172.21.15.123:0/3404583145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 msgr2=0x7ff8c815aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 --2- 172.21.15.123:0/3404583145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815aa70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097a0 tx=0x7ff8b802a270 comp rx=0 tx=0).stop 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 -- 172.21.15.123:0/3404583145 shutdown_connections 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 --2- 172.21.15.123:0/3404583145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815aa70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 -- 172.21.15.123:0/3404583145 >> 172.21.15.123:0/3404583145 conn(0x7ff8c806ed00 msgr2=0x7ff8c806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 -- 172.21.15.123:0/3404583145 shutdown_connections 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.818+0000 7ff8cc87b640 1 -- 172.21.15.123:0/3404583145 wait complete. 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 Processor -- start 2024-09-19T09:42:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 -- start start 2024-09-19T09:42:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c806c9c0 0x7ff8c8156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8c81581d0 0x7ff8c81553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c80c4110 con 0x7ff8c80c5e30 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c815afb0 con 0x7ff8c806c9c0 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8cc87b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c806bc10 con 0x7ff8c81581d0 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8c5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8c5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32808/0 (socket says 172.21.15.123:32808) 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.820+0000 7ff8c5d9b640 1 -- 172.21.15.123:0/1516754576 learned_addr learned my addr 172.21.15.123:0/1516754576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c5d9b640 1 -- 172.21.15.123:0/1516754576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8c81581d0 msgr2=0x7ff8c81553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c806c9c0 0x7ff8c8156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8c81581d0 0x7ff8c81553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c5d9b640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8c81581d0 0x7ff8c81553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c5d9b640 1 -- 172.21.15.123:0/1516754576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c806c9c0 msgr2=0x7ff8c8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c5d9b640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8c806c9c0 0x7ff8c8156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c5d9b640 1 -- 172.21.15.123:0/1516754576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c814bff0 con 0x7ff8c80c5e30 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8c5d9b640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8c80c5e30 0x7ff8c815a1b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000d9c0 tx=0x7ff8b000de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8beffd640 1 -- 172.21.15.123:0/1516754576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b001b070 con 0x7ff8c80c5e30 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8beffd640 1 -- 172.21.15.123:0/1516754576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b000ed40 con 0x7ff8c80c5e30 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8beffd640 1 -- 172.21.15.123:0/1516754576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0016680 con 0x7ff8c80c5e30 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8cc87b640 1 -- 172.21.15.123:0/1516754576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c8158770 con 0x7ff8c80c5e30 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.821+0000 7ff8cc87b640 1 -- 172.21.15.123:0/1516754576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c8149150 con 0x7ff8c80c5e30 2024-09-19T09:42:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.823+0000 7ff8beffd640 1 -- 172.21.15.123:0/1516754576 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff8b001e070 con 0x7ff8c80c5e30 2024-09-19T09:42:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.823+0000 7ff8beffd640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff8a806c2b0 0x7ff8a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.823+0000 7ff8beffd640 1 -- 172.21.15.123:0/1516754576 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8b008d170 con 0x7ff8c80c5e30 2024-09-19T09:42:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.823+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff8a806c2b0 0x7ff8a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.823+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1516754576 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff8a806c2b0 0x7ff8a806e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8034000 tx=0x7ff8b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.824+0000 7ff8cf619740 1 Processor -- start 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.824+0000 7ff8cf619740 1 -- start start 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8cf619740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f2c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8cf619740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f2cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8cf619740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7ef0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8cf619740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c9c7e55520 con 0x55c9c7ef4b30 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8cf619740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9c7dfd3e0 con 0x55c9c7ef4750 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8cf619740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x55c9c7e514e0 con 0x55c9c7ef1f80 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7ef0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7ef0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32810/0 (socket says 172.21.15.123:32810) 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/3322170149 learned_addr learned my addr 172.21.15.123:0/3322170149 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c5d9b640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f2cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c659c640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f2c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 msgr2=0x55c9c7f2cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f2cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 msgr2=0x55c9c7f2c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f2c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/3322170149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c7e182f0 con 0x55c9c7ef4b30 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c5d9b640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f2cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c659c640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f2c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7ef0a60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0002180 tx=0x7ff8c000d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1713b011bef4414 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8a7fff640 1 -- 172.21.15.123:0/3322170149 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0018070 con 0x55c9c7ef4b30 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8a7fff640 1 -- 172.21.15.123:0/3322170149 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c0013670 con 0x55c9c7ef4b30 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.825+0000 7ff8a7fff640 1 -- 172.21.15.123:0/3322170149 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0013a40 con 0x55c9c7ef4b30 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 -- 172.21.15.123:0/3322170149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 msgr2=0x55c9c7ef0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7ef0a60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0002180 tx=0x7ff8c000d5e0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 -- 172.21.15.123:0/3322170149 shutdown_connections 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7ef0a60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f2cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 --2- 172.21.15.123:0/3322170149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f2c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 -- 172.21.15.123:0/3322170149 >> 172.21.15.123:0/3322170149 conn(0x55c9c7ef2e70 msgr2=0x55c9c7ef3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 -- 172.21.15.123:0/3322170149 shutdown_connections 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.826+0000 7ff8cf619740 1 -- 172.21.15.123:0/3322170149 wait complete. 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.827+0000 7ff8cf619740 1 -- start start 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.827+0000 7ff8cf619740 1 Processor -- start 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f27000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f11cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7f12230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c9c7ef3fe0 con 0x55c9c7ef4b30 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9c7dde450 con 0x55c9c7ef4750 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x55c9c7f2c550 con 0x55c9c7ef1f80 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 10 client.0 _ll_register_callbacks cb 0x55c9c7b67ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7f12230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7f12230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32824/0 (socket says 172.21.15.123:32824) 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/1620496923 learned_addr learned my addr 172.21.15.123:0/1620496923 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c5d9b640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f11cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f27000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 msgr2=0x55c9c7f27000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f27000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 msgr2=0x55c9c7f11cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9c7ef4750 0x55c9c7f11cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:53.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 -- 172.21.15.123:0/1620496923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c7b682d0 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c9c7ef1f80 0x55c9c7f27000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8c6d9d640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c9c7ef4b30 0x55c9c7f12230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0002230 tx=0x7ff8c0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2fc80c2d30a6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8a57fa640 1 -- 172.21.15.123:0/1620496923 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0023020 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8a57fa640 1 -- 172.21.15.123:0/1620496923 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8c0013de0 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 -- 172.21.15.123:0/1620496923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8c0013670 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8a57fa640 1 -- 172.21.15.123:0/1620496923 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff8c002d050 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 10 client.4650 fetch_fsmap learned FSMap version 8 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.828+0000 7ff8cf619740 1 -- 172.21.15.123:0/1620496923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c9c7c326b0 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8a57fa640 1 -- 172.21.15.123:0/1620496923 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c0013670 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8a57fa640 1 -- 172.21.15.123:0/1620496923 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) ==== 4712+0+0 (secure 0 0 0) 0x7ff8c0030020 con 0x55c9c7ef4b30 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8cf619740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8cf619740 10 client.4650 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8cf619740 20 client.4650 populate_metadata read hostname 'smithi123' 2024-09-19T09:42:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8cf619740 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8cf619740 4 client.4650 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8cf619740 1 -- 172.21.15.123:0/1620496923 --> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c7e62c50 con 0x55c9c7f47160 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8a57fa640 10 client.4650 ms_handle_connect on v2:172.21.15.123:6838/1314641752 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.829+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=406d6aff9d62f50a server_cookie=9a24ff4efd59a37e in_seq=0 out_seq=0 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 -- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 msgr2=0x55c9c7f52800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 -- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 msgr2=0x55c9c7f52800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 unknown :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 unknown :-1 s=BANNER_CONNECTING pgs=13 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 crc :-1 s=SESSION_RECONNECTING pgs=13 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 crc :-1 s=SESSION_RECONNECTING pgs=13 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-09-19T09:42:53.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8a57fa640 0 client.4650 ms_handle_remote_reset on v2:172.21.15.123:6838/1314641752 2024-09-19T09:42:53.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8a57fa640 10 client.4650 ms_handle_connect on v2:172.21.15.123:6838/1314641752 2024-09-19T09:42:53.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:42:53.830+0000 7ff8c659c640 1 --2- 172.21.15.123:0/1620496923 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55c9c7f47160 0x55c9c7f52800 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f65b9f52190c353 server_cookie=ed5a4b71d0b8ea8e in_seq=0 out_seq=0 2024-09-19T09:43:01.146 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:43:01.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:43:31.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:43:31.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:44:01.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:44:01.397 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:44:31.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:44:31.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:44:53.748 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-19T09:44:54.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:44:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.859+0000 7f0c93576640 1 Processor -- start 2024-09-19T09:44:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.859+0000 7f0c93576640 1 -- start start 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.860+0000 7f0c93576640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 0x7f0c8c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.860+0000 7f0c93576640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c157e20 con 0x7f0c8c1523a0 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.860+0000 7f0c93576640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c072100 con 0x7f0c8c151fc0 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.860+0000 7f0c93576640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c0723e0 con 0x7f0c8c072770 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.860+0000 7f0c90b11640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0c8c1523a0 0x7f0c8c160750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40192/0 (socket says 172.21.15.123:40192) 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.860+0000 7f0c90b11640 1 -- 172.21.15.123:0/588986863 learned_addr learned my addr 172.21.15.123:0/588986863 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 0x7f0c8c0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836753379 0 0) 0x7f0c8c157e20 con 0x7f0c8c1523a0 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c78005730 con 0x7f0c8c1523a0 2024-09-19T09:44:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3027855911 0 0) 0x7f0c78005730 con 0x7f0c8c1523a0 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 msgr2=0x7f0c8c0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 0x7f0c8c0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 >> v1:172.21.15.194:6789/0 conn(0x7f0c8c151fc0 legacy=0x7f0c8c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c1580e0 con 0x7f0c8c1523a0 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f0c7c001690 con 0x7f0c8c1523a0 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 >> v1:172.21.15.123:6789/0 conn(0x7f0c8c1523a0 legacy=0x7f0c8c160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 0x7f0c78005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006170 0x7f0c78006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c78006f50 0x7f0c780073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c0723e0 con 0x7f0c78006f50 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7800dd60 con 0x7f0c78006170 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7800df60 con 0x7f0c8c072770 2024-09-19T09:44:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c78006f50 0x7f0c780073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91312640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 0x7f0c78005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c90b11640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006170 0x7f0c78006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 -- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 msgr2=0x7f0c78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c072770 0x7f0c78005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 -- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006170 msgr2=0x7f0c78006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006170 0x7f0c78006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c91b13640 1 -- 172.21.15.123:0/588986863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c78005730 con 0x7f0c78006f50 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.861+0000 7f0c90b11640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006170 0x7f0c78006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.862+0000 7f0c91b13640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c78006f50 0x7f0c780073d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009fc0 tx=0x7f0c78007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f18169230b8e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.862+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84009c10 con 0x7f0c78006f50 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.862+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c84036070 con 0x7f0c78006f50 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.862+0000 7f0c83fff640 1 -- 172.21.15.123:0/588986863 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84031880 con 0x7f0c78006f50 2024-09-19T09:44:54.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c93576640 1 -- 172.21.15.123:0/588986863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c78006f50 msgr2=0x7f0c780073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:54.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c93576640 1 --2- 172.21.15.123:0/588986863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c78006f50 0x7f0c780073d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009fc0 tx=0x7f0c78007a40 comp rx=0 tx=0).stop 2024-09-19T09:44:54.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c91b13640 1 -- 172.21.15.123:0/588986863 reap_dead start 2024-09-19T09:44:54.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c93576640 1 -- 172.21.15.123:0/588986863 shutdown_connections 2024-09-19T09:44:54.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c93576640 1 -- 172.21.15.123:0/588986863 >> 172.21.15.123:0/588986863 conn(0x7f0c8c06ec90 msgr2=0x7f0c8c06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:54.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c93576640 1 -- 172.21.15.123:0/588986863 shutdown_connections 2024-09-19T09:44:54.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.863+0000 7f0c93576640 1 -- 172.21.15.123:0/588986863 wait complete. 2024-09-19T09:44:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.864+0000 7f0c93576640 1 Processor -- start 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.864+0000 7f0c93576640 1 -- start start 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006f50 0x7f0c8c14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 0x7f0c8c1f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c14ee70 0x7f0c8c1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c071980 con 0x7f0c8c15ada0 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c071800 con 0x7f0c78006f50 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c15b3d0 con 0x7f0c8c14ee70 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 0x7f0c8c1f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 0x7f0c8c1f0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41936/0 (socket says 172.21.15.123:41936) 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 -- 172.21.15.123:0/1305090861 learned_addr learned my addr 172.21.15.123:0/1305090861 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c91312640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006f50 0x7f0c8c14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c91b13640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c14ee70 0x7f0c8c1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 -- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c14ee70 msgr2=0x7f0c8c1f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c14ee70 0x7f0c8c1f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 -- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006f50 msgr2=0x7f0c8c14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006f50 0x7f0c8c14e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 -- 172.21.15.123:0/1305090861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c159680 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c91312640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006f50 0x7f0c8c14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c90b11640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 0x7f0c8c1f0a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00e7f0 tx=0x7f0c7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00c8d0 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c018070 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c1593a0 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.865+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00cc70 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.866+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c15a530 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.867+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c14fd70 con 0x7f0c8c15ada0 2024-09-19T09:44:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.867+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c7c01d460 con 0x7f0c8c15ada0 2024-09-19T09:44:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.867+0000 7f0c81ffb640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c7006c2e0 0x7f0c7006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.868+0000 7f0c91312640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c7006c2e0 0x7f0c7006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.868+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f0c7c08b3c0 con 0x7f0c8c15ada0 2024-09-19T09:44:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.868+0000 7f0c91312640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c7006c2e0 0x7f0c7006e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c880036b0 tx=0x7f0c88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:54.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:54.872+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0c8c14fd70 con 0x7f0c8c15ada0 2024-09-19T09:44:55.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.070+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c8c0c3800 con 0x7f0c8c15ada0 2024-09-19T09:44:55.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.071+0000 7f0c81ffb640 1 -- 172.21.15.123:0/1305090861 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f0c7c059ab0 con 0x7f0c8c15ada0 2024-09-19T09:44:55.073 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:44:55.073 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:44:55.074 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c7006c2e0 msgr2=0x7f0c7006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c7006c2e0 0x7f0c7006e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c880036b0 tx=0x7f0c88009040 comp rx=0 tx=0).stop 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 msgr2=0x7f0c8c1f0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 0x7f0c8c1f0a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00e7f0 tx=0x7f0c7c00ecb0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 shutdown_connections 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0c7006c2e0 0x7f0c7006e7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c8c14ee70 0x7f0c8c1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c8c15ada0 0x7f0c8c1f0a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 --2- 172.21.15.123:0/1305090861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c78006f50 0x7f0c8c14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 >> 172.21.15.123:0/1305090861 conn(0x7f0c8c06ec90 msgr2=0x7f0c8c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 shutdown_connections 2024-09-19T09:44:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.073+0000 7f0c93576640 1 -- 172.21.15.123:0/1305090861 wait complete. 2024-09-19T09:44:55.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:42:36.824422+0000', 'modified': '2024-09-19T09:42:42.526063+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6839/1314641752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 1314641752}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 1314641752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4308]} 2024-09-19T09:44:55.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:44:55.690 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-19T09:44:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.800+0000 7ff9d3b13640 1 Processor -- start 2024-09-19T09:44:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.800+0000 7ff9d3b13640 1 -- start start 2024-09-19T09:44:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d3b13640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff9cc152dc0 0x7ff9cc0c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d3b13640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc0c7540 0x7ff9cc1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d3b13640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9cc0c7ca0 con 0x7ff9cc159c00 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d3b13640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc0c5d50 con 0x7ff9cc152dc0 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d3b13640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc159230 con 0x7ff9cc0c7540 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d18af640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff9cc152dc0 0x7ff9cc0c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.801+0000 7ff9d10ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc0c7540 0x7ff9cc1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d20b0640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff9cc159c00 0x7ff9cc0c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:33190/0 (socket says 172.21.15.123:33190) 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d20b0640 1 -- 172.21.15.123:0/3151609250 learned_addr learned my addr 172.21.15.123:0/3151609250 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d18af640 1 --2- 172.21.15.123:0/3151609250 >> v2:172.21.15.194:3300/0 conn(0x7ff9cc152dc0 0x7ff9cc0c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:54532/0 (socket says 172.21.15.123:54532) 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d10ae640 1 -- 172.21.15.123:0/3151609250 >> v2:172.21.15.194:3300/0 conn(0x7ff9cc152dc0 msgr2=0x7ff9cc0c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d08ad640 1 -- 172.21.15.123:0/3151609250 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712615475 0 0) 0x7ff9cc0c7ca0 con 0x7ff9cc159c00 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/3151609250 >> v2:172.21.15.194:3300/0 conn(0x7ff9cc152dc0 0x7ff9cc0c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d10ae640 1 -- 172.21.15.123:0/3151609250 >> v1:172.21.15.194:6789/0 conn(0x7ff9cc159c00 legacy=0x7ff9cc0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.802+0000 7ff9d10ae640 1 -- 172.21.15.123:0/3151609250 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc073490 con 0x7ff9cc0c7540 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/3151609250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc0c7540 0x7ff9cc1596c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0097a0 tx=0x7ff9bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93764541a5a2ec3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d08ad640 1 -- 172.21.15.123:0/3151609250 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc037070 con 0x7ff9cc0c7540 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d08ad640 1 -- 172.21.15.123:0/3151609250 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc032440 con 0x7ff9cc0c7540 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d08ad640 1 -- 172.21.15.123:0/3151609250 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc032810 con 0x7ff9cc0c7540 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 -- 172.21.15.123:0/3151609250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc0c7540 msgr2=0x7ff9cc1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/3151609250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc0c7540 0x7ff9cc1596c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0097a0 tx=0x7ff9bc02a180 comp rx=0 tx=0).stop 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 -- 172.21.15.123:0/3151609250 shutdown_connections 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/3151609250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc0c7540 0x7ff9cc1596c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/3151609250 >> v2:172.21.15.194:3300/0 conn(0x7ff9cc152dc0 0x7ff9cc0c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 -- 172.21.15.123:0/3151609250 >> 172.21.15.123:0/3151609250 conn(0x7ff9cc06ed00 msgr2=0x7ff9cc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.803+0000 7ff9d3b13640 1 -- 172.21.15.123:0/3151609250 shutdown_connections 2024-09-19T09:44:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.804+0000 7ff9d3b13640 1 -- 172.21.15.123:0/3151609250 wait complete. 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 Processor -- start 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 -- start start 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9cc0c7540 0x7ff9cc1e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 0x7ff9cc0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc1e1ca0 0x7ff9cc1def30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0c7980 con 0x7ff9cc152dc0 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc073a10 con 0x7ff9cc0c7540 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d3b13640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc0ca0c0 con 0x7ff9cc1e1ca0 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d10ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 0x7ff9cc0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d10ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 0x7ff9cc0cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41948/0 (socket says 172.21.15.123:41948) 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.805+0000 7ff9d10ae640 1 -- 172.21.15.123:0/128288672 learned_addr learned my addr 172.21.15.123:0/128288672 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d18af640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9cc0c7540 0x7ff9cc1e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d20b0640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc1e1ca0 0x7ff9cc1def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d10ae640 1 -- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc1e1ca0 msgr2=0x7ff9cc1def30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc1e1ca0 0x7ff9cc1def30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d10ae640 1 -- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9cc0c7540 msgr2=0x7ff9cc1e3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9cc0c7540 0x7ff9cc1e3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d10ae640 1 -- 172.21.15.123:0/128288672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc146180 con 0x7ff9cc152dc0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 0x7ff9cc0cb960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0097a0 tx=0x7ff9bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9c27fc640 1 -- 172.21.15.123:0/128288672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc037050 con 0x7ff9cc152dc0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9c27fc640 1 -- 172.21.15.123:0/128288672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc038040 con 0x7ff9cc152dc0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc146460 con 0x7ff9cc152dc0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9c27fc640 1 -- 172.21.15.123:0/128288672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc004490 con 0x7ff9cc152dc0 2024-09-19T09:44:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.806+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc1e35d0 con 0x7ff9cc152dc0 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.808+0000 7ff9c27fc640 1 -- 172.21.15.123:0/128288672 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff9bc03c6d0 con 0x7ff9cc152dc0 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.808+0000 7ff9c27fc640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff9b006c2b0 0x7ff9b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.808+0000 7ff9c27fc640 1 -- 172.21.15.123:0/128288672 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7ff9bc0abe40 con 0x7ff9cc152dc0 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.808+0000 7ff9d18af640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff9b006c2b0 0x7ff9b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.809+0000 7ff9d18af640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff9b006c2b0 0x7ff9b006e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009ad0 tx=0x7ff9c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.809+0000 7ff9d68a4740 1 Processor -- start 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.809+0000 7ff9d68a4740 1 -- start start 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd3628bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362dd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362dda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd361f2520 con 0x55dd3628ef80 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dd3619a3e0 con 0x55dd36291b30 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x55dd361ee4e0 con 0x55dd36291750 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362dd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362dd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41962/0 (socket says 172.21.15.123:41962) 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 -- 172.21.15.123:0/1122210850 learned_addr learned my addr 172.21.15.123:0/1122210850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd3628bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d20b0640 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362dda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 -- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 msgr2=0x55dd3628bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd3628bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 -- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 msgr2=0x55dd362dda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362dda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.810+0000 7ff9d10ae640 1 -- 172.21.15.123:0/1122210850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd361b52f0 con 0x55dd3628ef80 2024-09-19T09:44:55.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.811+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362dd4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc035040 tx=0x7ff9bc079950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21566b935c07f6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.814+0000 7ff9af7fe640 1 -- 172.21.15.123:0/1122210850 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc094070 con 0x55dd3628ef80 2024-09-19T09:44:55.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.814+0000 7ff9af7fe640 1 -- 172.21.15.123:0/1122210850 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc07e270 con 0x55dd3628ef80 2024-09-19T09:44:55.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.814+0000 7ff9af7fe640 1 -- 172.21.15.123:0/1122210850 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0a7020 con 0x55dd3628ef80 2024-09-19T09:44:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1122210850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 msgr2=0x55dd362dd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362dd4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc035040 tx=0x7ff9bc079950 comp rx=0 tx=0).stop 2024-09-19T09:44:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1122210850 shutdown_connections 2024-09-19T09:44:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362dda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362dd4d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1122210850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd3628bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1122210850 >> 172.21.15.123:0/1122210850 conn(0x55dd3628fe70 msgr2=0x55dd36290270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1122210850 shutdown_connections 2024-09-19T09:44:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1122210850 wait complete. 2024-09-19T09:44:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 -- start start 2024-09-19T09:44:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.815+0000 7ff9d68a4740 1 Processor -- start 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd362c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd3617b450 con 0x55dd3628ef80 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dd362cbdc0 con 0x55dd36291b30 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x55dd362d3220 con 0x55dd36291750 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d68a4740 10 client.0 _ll_register_callbacks cb 0x55dd35f04ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d18af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.816+0000 7ff9d18af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362e8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41974/0 (socket says 172.21.15.123:41974) 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 -- 172.21.15.123:0/1329489007 learned_addr learned my addr 172.21.15.123:0/1329489007 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 -- 172.21.15.123:0/1329489007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 msgr2=0x55dd362c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd362c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 -- 172.21.15.123:0/1329489007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 msgr2=0x55dd362bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 -- 172.21.15.123:0/1329489007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd35f052d0 con 0x55dd3628ef80 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362e8b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80157e0 tx=0x7ff9c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a238d507f97c9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9acff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9acff9640 1 -- 172.21.15.123:0/1329489007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8026070 con 0x55dd3628ef80 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9acff9640 1 -- 172.21.15.123:0/1329489007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7ff9c8014960 con 0x55dd3628ef80 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9bc07e270 con 0x55dd3628ef80 2024-09-19T09:44:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9acff9640 1 -- 172.21.15.123:0/1329489007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff9c8031050 con 0x55dd3628ef80 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d68a4740 10 client.4665 fetch_fsmap learned FSMap version 8 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55dd35fcf6b0 con 0x55dd3628ef80 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.817+0000 7ff9acff9640 1 -- 172.21.15.123:0/1329489007 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc07e270 con 0x55dd3628ef80 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9acff9640 1 -- 172.21.15.123:0/1329489007 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) ==== 4712+0+0 (secure 0 0 0) 0x7ff9c8034020 con 0x55dd3628ef80 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d68a4740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d68a4740 10 client.4665 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d68a4740 20 client.4665 populate_metadata read hostname 'smithi123' 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd362f17b0 0x55dd362f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d68a4740 4 client.4665 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 --> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd361ffc50 con 0x55dd362f17b0 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd362f17b0 0x55dd362f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9acff9640 10 client.4665 ms_handle_connect on v2:172.21.15.123:6838/1314641752 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.818+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd362f17b0 0x55dd362f3ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d28547af0e38ae04 server_cookie=d3a94e3751fa6c25 in_seq=0 out_seq=0 2024-09-19T09:44:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9acff9640 1 -- 172.21.15.123:0/1329489007 <== mds.0 v2:172.21.15.123:6838/1314641752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd361ffc50 con 0x55dd362f17b0 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9acff9640 10 client.4665 handle_command_reply: tid=0 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 client.4665 shutdown 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 msgr2=0x55dd362e8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362e8b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80157e0 tx=0x7ff9c80046c0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 shutdown_connections 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd362f17b0 0x55dd362f3ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd362bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd362c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9acff9640 0 client.4665 ms_handle_reset on v2:172.21.15.123:6838/1314641752 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1329489007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362e8b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 >> 172.21.15.123:0/1329489007 conn(0x55dd3628fe70 msgr2=0x55dd36290cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 shutdown_connections 2024-09-19T09:44:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1329489007 wait complete. 2024-09-19T09:44:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.819+0000 7ff9d68a4740 20 client.4665 trim_cache size 0 max 16384 2024-09-19T09:44:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 Processor -- start 2024-09-19T09:44:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 -- start start 2024-09-19T09:44:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd3628ef80 0x55dd362e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291750 0x55dd362e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 0x55dd362beb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc072dc0 con 0x55dd36291b30 2024-09-19T09:44:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dd362c6590 con 0x55dd36291750 2024-09-19T09:44:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.837+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x55dd362cbbf0 con 0x55dd3628ef80 2024-09-19T09:44:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 0x55dd362beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 0x55dd362beb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41988/0 (socket says 172.21.15.123:41988) 2024-09-19T09:44:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 -- 172.21.15.123:0/2576448950 learned_addr learned my addr 172.21.15.123:0/2576448950 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d18af640 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd3628ef80 0x55dd362e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291750 0x55dd362e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 -- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd3628ef80 msgr2=0x55dd362e7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd3628ef80 0x55dd362e7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 -- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291750 msgr2=0x55dd362e84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291750 0x55dd362e84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 -- 172.21.15.123:0/2576448950 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd362c5250 con 0x55dd36291b30 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d18af640 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd3628ef80 0x55dd362e7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9d20b0640 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 0x55dd362beb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40072a0 tx=0x7ff9c4007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c72986f5d2d07c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9aeffd640 1 -- 172.21.15.123:0/2576448950 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c401b070 con 0x55dd36291b30 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9aeffd640 1 -- 172.21.15.123:0/2576448950 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c4001a40 con 0x55dd36291b30 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.838+0000 7ff9aeffd640 1 -- 172.21.15.123:0/2576448950 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4001e10 con 0x55dd36291b30 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 -- 172.21.15.123:0/2576448950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 msgr2=0x55dd362beb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 0x55dd362beb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40072a0 tx=0x7ff9c4007760 comp rx=0 tx=0).stop 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 -- 172.21.15.123:0/2576448950 shutdown_connections 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd36291b30 0x55dd362beb50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291750 0x55dd362e84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/2576448950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd3628ef80 0x55dd362e7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 -- 172.21.15.123:0/2576448950 >> 172.21.15.123:0/2576448950 conn(0x55dd3628fe70 msgr2=0x55dd362e2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 -- 172.21.15.123:0/2576448950 shutdown_connections 2024-09-19T09:44:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 -- 172.21.15.123:0/2576448950 wait complete. 2024-09-19T09:44:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 -- start start 2024-09-19T09:44:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.839+0000 7ff9d68a4740 1 Processor -- start 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd362c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd3634ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dd362bf940 con 0x55dd3628ef80 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dd362d2d40 con 0x55dd36291b30 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x55dd362d18f0 con 0x55dd36291750 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d68a4740 10 client.0 _ll_register_callbacks cb 0x7ff9c80119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d18af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d18af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362bf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41994/0 (socket says 172.21.15.123:41994) 2024-09-19T09:44:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.840+0000 7ff9d18af640 1 -- 172.21.15.123:0/1212350079 learned_addr learned my addr 172.21.15.123:0/1212350079 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d18af640 1 -- 172.21.15.123:0/1212350079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 msgr2=0x55dd362c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd362c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d18af640 1 -- 172.21.15.123:0/1212350079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 msgr2=0x55dd3634ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd3634ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d18af640 1 -- 172.21.15.123:0/1212350079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd362bebf0 con 0x55dd3628ef80 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d18af640 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362bf3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8008010 tx=0x7ff9c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c1b29e86657ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9acff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9acff9640 1 -- 172.21.15.123:0/1212350079 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8039070 con 0x55dd3628ef80 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9acff9640 1 -- 172.21.15.123:0/1212350079 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7ff9c802b490 con 0x55dd3628ef80 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c4001a40 con 0x55dd3628ef80 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9acff9640 1 -- 172.21.15.123:0/1212350079 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff9c8044050 con 0x55dd3628ef80 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 10 client.4671 fetch_fsmap learned FSMap version 8 2024-09-19T09:44:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55dd362ccde0 con 0x55dd3628ef80 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9acff9640 1 -- 172.21.15.123:0/1212350079 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c4001a40 con 0x55dd3628ef80 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9acff9640 1 -- 172.21.15.123:0/1212350079 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) ==== 4712+0+0 (secure 0 0 0) 0x7ff9c8047020 con 0x55dd3628ef80 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 10 client.4671 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 20 client.4671 populate_metadata read hostname 'smithi123' 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd3628df90 0x55dd36360b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 4 client.4671 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 --> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] -- command(tid 0: {"prefix": "status"}) -- 0x55dd361f9fa0 con 0x55dd3628df90 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.841+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd3628df90 0x55dd36360b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9acff9640 10 client.4671 ms_handle_connect on v2:172.21.15.123:6838/1314641752 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d10ae640 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd3628df90 0x55dd36360b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe4c429c885a84a server_cookie=e8422bcfff8fda80 in_seq=0 out_seq=0 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9acff9640 1 -- 172.21.15.123:0/1212350079 <== mds.0 v2:172.21.15.123:6838/1314641752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55dd361f9fa0 con 0x55dd3628df90 2024-09-19T09:44:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9acff9640 10 client.4671 handle_command_reply: tid=0 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 client.4671 shutdown 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 msgr2=0x55dd362bf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362bf3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8008010 tx=0x7ff9c8017000 comp rx=0 tx=0).stop 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 shutdown_connections 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:6838/1314641752,v1:172.21.15.123:6839/1314641752] conn(0x55dd3628df90 0x55dd36360b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd36291b30 0x55dd3634ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55dd36291750 0x55dd362c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9acff9640 0 client.4671 ms_handle_reset on v2:172.21.15.123:6838/1314641752 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 --2- 172.21.15.123:0/1212350079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dd3628ef80 0x55dd362bf3b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 >> 172.21.15.123:0/1212350079 conn(0x55dd3628fe70 msgr2=0x55dd3628a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 shutdown_connections 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 1 -- 172.21.15.123:0/1212350079 wait complete. 2024-09-19T09:44:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.842+0000 7ff9d68a4740 20 client.4671 trim_cache size 0 max 16384 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4308, 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 138.33490479400001, 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 8, 2024-09-19T09:44:55.852 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 25, 2024-09-19T09:44:55.853 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 23, 2024-09-19T09:44:55.853 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 143.60334420999999 2024-09-19T09:44:55.853 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:44:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff9b006c2b0 msgr2=0x7ff9b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff9b006c2b0 0x7ff9b006e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009ad0 tx=0x7ff9c8008040 comp rx=0 tx=0).stop 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 msgr2=0x7ff9cc0cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 0x7ff9cc0cb960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0097a0 tx=0x7ff9bc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 shutdown_connections 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff9b006c2b0 0x7ff9b006e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9cc1e1ca0 0x7ff9cc1def30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9cc152dc0 0x7ff9cc0cb960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 --2- 172.21.15.123:0/128288672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9cc0c7540 0x7ff9cc1e3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 >> 172.21.15.123:0/128288672 conn(0x7ff9cc06ed00 msgr2=0x7ff9cc0c6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 shutdown_connections 2024-09-19T09:44:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:55.843+0000 7ff9d3b13640 1 -- 172.21.15.123:0/128288672 wait complete. 2024-09-19T09:44:55.855 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:44:55.865 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:44:55.865 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:44:55.866 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:44:55.866 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:44:55.900 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:44:55.900 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:44:55.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:55.900 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-19T09:44:55.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:55.917 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-19T09:44:55.984 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-09-19T09:44:55.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:44:55.985 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-19T09:44:55.986 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:44:55.986 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:44:55.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:44:56.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.123+0000 7f3f7ffff640 1 Processor -- start 2024-09-19T09:44:56.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.123+0000 7f3f7ffff640 1 -- start start 2024-09-19T09:44:56.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f801550b0 0x7f3f800c6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7ffff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f800c6560 0x7f3f800cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f800cdf70 0x7f3f8015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7ffff640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8015be80 con 0x7f3f800cdf70 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7ffff640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8015f1c0 con 0x7f3f800c6560 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7ffff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8015b0c0 con 0x7f3f801550b0 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f800cdf70 0x7f3f8015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f800cdf70 0x7f3f8015e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42006/0 (socket says 172.21.15.123:42006) 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/2583166047 learned_addr learned my addr 172.21.15.123:0/2583166047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7effd640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f801550b0 0x7f3f800c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7e7fc640 1 --2- 172.21.15.123:0/2583166047 >> v2:172.21.15.194:3300/0 conn(0x7f3f800c6560 0x7f3f800cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/2583166047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f801550b0 msgr2=0x7f3f800c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f801550b0 0x7f3f800c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/2583166047 >> v2:172.21.15.194:3300/0 conn(0x7f3f800c6560 msgr2=0x7f3f800cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 --2- 172.21.15.123:0/2583166047 >> v2:172.21.15.194:3300/0 conn(0x7f3f800c6560 0x7f3f800cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/2583166047 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8015b3a0 con 0x7f3f800cdf70 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7effd640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f801550b0 0x7f3f800c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.124+0000 7f3f7e7fc640 1 --2- 172.21.15.123:0/2583166047 >> v2:172.21.15.194:3300/0 conn(0x7f3f800c6560 0x7f3f800cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7f7fe640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f800cdf70 0x7f3f8015e4a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f800d1b60 tx=0x7f3f7802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7a20ee382a0ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7dffb640 1 -- 172.21.15.123:0/2583166047 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78036070 con 0x7f3f800cdf70 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7dffb640 1 -- 172.21.15.123:0/2583166047 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f78031600 con 0x7f3f800cdf70 2024-09-19T09:44:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7dffb640 1 -- 172.21.15.123:0/2583166047 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f780319d0 con 0x7f3f800cdf70 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 -- 172.21.15.123:0/2583166047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f800cdf70 msgr2=0x7f3f8015e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f800cdf70 0x7f3f8015e4a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f800d1b60 tx=0x7f3f7802a730 comp rx=0 tx=0).stop 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 -- 172.21.15.123:0/2583166047 shutdown_connections 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f800cdf70 0x7f3f8015e4a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/2583166047 >> v2:172.21.15.194:3300/0 conn(0x7f3f800c6560 0x7f3f800cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/2583166047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f801550b0 0x7f3f800c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 -- 172.21.15.123:0/2583166047 >> 172.21.15.123:0/2583166047 conn(0x7f3f8006cd70 msgr2=0x7f3f8006d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 -- 172.21.15.123:0/2583166047 shutdown_connections 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.125+0000 7f3f7ffff640 1 -- 172.21.15.123:0/2583166047 wait complete. 2024-09-19T09:44:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.127+0000 7f3f7ffff640 1 Processor -- start 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.127+0000 7f3f7ffff640 1 -- start start 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.127+0000 7f3f7ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f800c6560 0x7f3f800b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.127+0000 7f3f7ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f800cdf70 0x7f3f801f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.127+0000 7f3f7ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 0x7f3f8015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7ffff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80155490 con 0x7f3f801550b0 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7ffff640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8015b960 con 0x7f3f800c6560 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7ffff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3f801f1310 con 0x7f3f800cdf70 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 0x7f3f8015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 0x7f3f8015cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42020/0 (socket says 172.21.15.123:42020) 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/4208830404 learned_addr learned my addr 172.21.15.123:0/4208830404 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7e7fc640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f800cdf70 0x7f3f801f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7effd640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f800c6560 0x7f3f800b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f800cdf70 msgr2=0x7f3f801f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f800cdf70 0x7f3f801f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f800c6560 msgr2=0x7f3f800b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f800c6560 0x7f3f800b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 -- 172.21.15.123:0/4208830404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f800b5f30 con 0x7f3f801550b0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7f7fe640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 0x7f3f8015cc50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009f40 tx=0x7f3f78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78036050 con 0x7f3f801550b0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f78042070 con 0x7f3f801550b0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f800b50c0 con 0x7f3f801550b0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78009510 con 0x7f3f801550b0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.128+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f800b4b00 con 0x7f3f801550b0 2024-09-19T09:44:56.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.129+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f800c5ab0 con 0x7f3f801550b0 2024-09-19T09:44:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.130+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f78007bf0 con 0x7f3f801550b0 2024-09-19T09:44:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.130+0000 7f3f67fff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3f6c06c2e0 0x7f3f6c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.130+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f3f780ac040 con 0x7f3f801550b0 2024-09-19T09:44:56.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.130+0000 7f3f7effd640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3f6c06c2e0 0x7f3f6c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:56.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.131+0000 7f3f7effd640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3f6c06c2e0 0x7f3f6c06e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f70006fd0 tx=0x7f3f70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:56.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.135+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3f7807a290 con 0x7f3f801550b0 2024-09-19T09:44:56.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.333+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f800b3570 con 0x7f3f801550b0 2024-09-19T09:44:56.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.333+0000 7f3f67fff640 1 -- 172.21.15.123:0/4208830404 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3f7807e590 con 0x7f3f801550b0 2024-09-19T09:44:56.336 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:44:56.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3f6c06c2e0 msgr2=0x7f3f6c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:56.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3f6c06c2e0 0x7f3f6c06e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f70006fd0 tx=0x7f3f70008040 comp rx=0 tx=0).stop 2024-09-19T09:44:56.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 msgr2=0x7f3f8015cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 0x7f3f8015cc50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009f40 tx=0x7f3f78004a40 comp rx=0 tx=0).stop 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 shutdown_connections 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f801550b0 0x7f3f8015cc50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3f6c06c2e0 0x7f3f6c06e7a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f800cdf70 0x7f3f801f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 --2- 172.21.15.123:0/4208830404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f800c6560 0x7f3f800b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 >> 172.21.15.123:0/4208830404 conn(0x7f3f8006cd70 msgr2=0x7f3f80073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 shutdown_connections 2024-09-19T09:44:56.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56.335+0000 7f3f7ffff640 1 -- 172.21.15.123:0/4208830404 wait complete. 2024-09-19T09:44:56.348 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:44:56.348 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:44:56.348 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-19T09:44:56.348 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:44:56.349 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:44:56.349 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:44:56.349 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:44:56.349 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:44:56.349 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:44:56.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:56.349 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-19T09:44:56.364 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:44:56.365 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:44:56.366 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:44:56.366 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:44:56.366 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:44:56.366 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-09-19T09:44:56.366 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-19T09:44:56.366 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:44:56.366 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:44:56.366 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:44:56.367 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-19T09:44:56.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:44:56.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-09-19T09:44:56.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-09-19T09:44:56.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:44:56.367 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-19T09:44:56.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:44:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:56.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:56.553 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:44:56.577 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-19T09:44:56.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:56.579 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-19T09:44:56.660 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-19T09:44:56.661 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:44:56.661 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:44:56.661 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:44:56.661 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:44:56.661 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:44:56.661 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-19T09:44:56.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:44:56.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:44:56.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:44:56.662 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-19T09:44:56.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:44:56.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:56.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:56.943 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-19T09:44:56.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:56.959 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-09-19T09:44:57.014 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:44:57.014 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-19T09:44:57.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:44:57.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:44:57.014 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-19T09:44:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:44:57.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:57.132 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:44:57.133 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-19T09:44:57.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:44:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:57.264 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:44:57.264 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-19T09:44:57.264 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-19T09:44:57.264 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:44:57.264 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-19T09:44:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:44:57.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:57.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:44:57.340 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:44:57.354 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:44:57.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:44:57.355 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:44:57.409 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-19T09:44:57.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:57.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-19T09:44:57.509 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-19T09:44:57.509 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-19T09:44:57.636 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-19T09:44:57.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-19T09:44:57.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-19T09:44:57.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 0@837baa2f-03c1-414f-aff3-ae2b21065b15.cephfs=/ 2024-09-19T09:44:57.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.123:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-19T09:44:57.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:44:57.637 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:44:57.638 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:44:57.638 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:44:57.638 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:44:57.640 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:44:57.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:44:57.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:44:57.665 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:44:57.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:44:57.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:57.768 INFO:teuthology.orchestra.run.smithi123.stdout:client4558 2024-09-19T09:44:57.768 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:44:57.768 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:44:57.785 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:44:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:44:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:57.886 INFO:teuthology.orchestra.run.smithi123.stdout:client4558 2024-09-19T09:44:57.886 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:44:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:44:58.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:58.935 INFO:teuthology.orchestra.run.smithi123.stdout:client4558 2024-09-19T09:44:58.935 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/837baa2f-03c1-414f-aff3-ae2b21065b15.client4558/status') 2024-09-19T09:44:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:44:59.000 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4558 (3)172.21.15.123:0/951327249 2024-09-19T09:44:59.000 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-09-19T09:44:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-09-19T09:44:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-09-19T09:44:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:70 bytes copied, 4.0007e-05 s, 1.7 MB/s 2024-09-19T09:44:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:44:59.008 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-19T09:44:59.022 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-19T09:44:59.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:44:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.119+0000 7f519038d640 1 Processor -- start 2024-09-19T09:44:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.119+0000 7f519038d640 1 -- start start 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.120+0000 7f519038d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51880c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.120+0000 7f519038d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51881523a0 0x7f51881588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.120+0000 7f519038d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5188157e20 con 0x7f5188072770 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.120+0000 7f519038d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5188158e20 con 0x7f51881523a0 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.120+0000 7f519038d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5188072100 con 0x7f5188151fc0 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.120+0000 7f518d928640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51881523a0 0x7f51881588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518e92a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5188072770 0x7f51880710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40206/0 (socket says 172.21.15.123:40206) 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518e92a640 1 -- 172.21.15.123:0/3920559901 learned_addr learned my addr 172.21.15.123:0/3920559901 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518d928640 1 -- 172.21.15.123:0/3920559901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 msgr2=0x7f51880c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518e129640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51880c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518d928640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51880c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518d928640 1 -- 172.21.15.123:0/3920559901 >> v1:172.21.15.123:6789/0 conn(0x7f5188072770 legacy=0x7f51880710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518d127640 1 -- 172.21.15.123:0/3920559901 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204631873 0 0) 0x7f5188157e20 con 0x7f5188072770 2024-09-19T09:44:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518d928640 1 -- 172.21.15.123:0/3920559901 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51880723e0 con 0x7f51881523a0 2024-09-19T09:44:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.121+0000 7f518e129640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51880c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f518d928640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51881523a0 0x7f51881588e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f517c009d90 tx=0x7f517c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11767205a89619a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f518d127640 1 -- 172.21.15.123:0/3920559901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c031600 con 0x7f51881523a0 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f518d127640 1 -- 172.21.15.123:0/3920559901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c0317a0 con 0x7f51881523a0 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f518d127640 1 -- 172.21.15.123:0/3920559901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c031b70 con 0x7f51881523a0 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 -- 172.21.15.123:0/3920559901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51881523a0 msgr2=0x7f51881588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51881523a0 0x7f51881588e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f517c009d90 tx=0x7f517c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 -- 172.21.15.123:0/3920559901 shutdown_connections 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51881523a0 0x7f51881588e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 --2- 172.21.15.123:0/3920559901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51880c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 -- 172.21.15.123:0/3920559901 >> 172.21.15.123:0/3920559901 conn(0x7f518806ec90 msgr2=0x7f518806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 -- 172.21.15.123:0/3920559901 shutdown_connections 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.122+0000 7f519038d640 1 -- 172.21.15.123:0/3920559901 wait complete. 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 Processor -- start 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 -- start start 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 0x7f51880ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51881f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51881f24d0 0x7f51881ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5188071800 con 0x7f5188072770 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f51881583c0 con 0x7f51881f24d0 2024-09-19T09:44:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f519038d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5188071980 con 0x7f5188151fc0 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f518e129640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 0x7f51880ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f518e129640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 0x7f51880ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42046/0 (socket says 172.21.15.123:42046) 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.124+0000 7f518e129640 1 -- 172.21.15.123:0/1339985460 learned_addr learned my addr 172.21.15.123:0/1339985460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e129640 1 -- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 msgr2=0x7f51881f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518d928640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51881f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e92a640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51881f24d0 0x7f51881ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e129640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51881f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e129640 1 -- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51881f24d0 msgr2=0x7f51881ee890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e129640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51881f24d0 0x7f51881ee890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e129640 1 -- 172.21.15.123:0/1339985460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51880c7330 con 0x7f5188072770 2024-09-19T09:44:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518d928640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51881f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e92a640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51881f24d0 0x7f51881ee890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f518e129640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 0x7f51880ccc70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f518000c820 tx=0x7f518000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180015070 con 0x7f5188072770 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51800079d0 con 0x7f5188072770 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180007da0 con 0x7f5188072770 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51880cd6f0 con 0x7f5188072770 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.125+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5188159790 con 0x7f5188072770 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.126+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518815b3d0 con 0x7f5188072770 2024-09-19T09:44:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.126+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5180018070 con 0x7f5188072770 2024-09-19T09:44:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.127+0000 7f5186ffd640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f517406c2b0 0x7f517406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.127+0000 7f518d928640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f517406c2b0 0x7f517406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.127+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f518008b2f0 con 0x7f5188072770 2024-09-19T09:44:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.127+0000 7f518d928640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f517406c2b0 0x7f517406e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f517c034000 tx=0x7f517c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.131+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5180059a70 con 0x7f5188072770 2024-09-19T09:44:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.297+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f518806f130 con 0x7f5188072770 2024-09-19T09:44:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.298+0000 7f5186ffd640 1 -- 172.21.15.123:0/1339985460 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16892 (secure 0 0 0) 0x7f5180059370 con 0x7f5188072770 2024-09-19T09:44:59.300 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:44:59.300 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:43:20.608350+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:44:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f517406c2b0 msgr2=0x7f517406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f517406c2b0 0x7f517406e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f517c034000 tx=0x7f517c02f000 comp rx=0 tx=0).stop 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 msgr2=0x7f51880ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 0x7f51880ccc70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f518000c820 tx=0x7f518000cc20 comp rx=0 tx=0).stop 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 shutdown_connections 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51881f24d0 0x7f51881ee890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f517406c2b0 0x7f517406e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5188151fc0 0x7f51881f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 --2- 172.21.15.123:0/1339985460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5188072770 0x7f51880ccc70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 >> 172.21.15.123:0/1339985460 conn(0x7f518806ec90 msgr2=0x7f5188158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 shutdown_connections 2024-09-19T09:44:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.300+0000 7f519038d640 1 -- 172.21.15.123:0/1339985460 wait complete. 2024-09-19T09:44:59.313 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:42:28.726550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:42:35.427299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:42:35.797333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:44:59.314 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:44:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.413+0000 7fa37f8d0640 1 Processor -- start 2024-09-19T09:44:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.413+0000 7fa37f8d0640 1 -- start start 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.414+0000 7fa37f8d0640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 0x7fa3780cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.414+0000 7fa37f8d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cd040 0x7fa3780cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.414+0000 7fa37f8d0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37815b580 con 0x7fa3780cdbb0 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.414+0000 7fa37f8d0640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa37815c100 con 0x7fa378155360 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.414+0000 7fa37f8d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa37815e910 con 0x7fa3780cd040 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37d66c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 0x7fa3780cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37ce6b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cd040 0x7fa3780cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37d66c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 0x7fa3780cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:54614/0 (socket says 172.21.15.123:54614) 2024-09-19T09:44:59.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37d66c640 1 -- 172.21.15.123:0/1577585624 learned_addr learned my addr 172.21.15.123:0/1577585624 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:59.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37ce6b640 1 -- 172.21.15.123:0/1577585624 >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 msgr2=0x7fa3780cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:59.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37ce6b640 1 --2- 172.21.15.123:0/1577585624 >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 0x7fa3780cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37ce6b640 1 -- 172.21.15.123:0/1577585624 >> v1:172.21.15.194:6789/0 conn(0x7fa3780cdbb0 legacy=0x7fa37815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37ce6b640 1 -- 172.21.15.123:0/1577585624 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37815b860 con 0x7fa3780cd040 2024-09-19T09:44:59.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.415+0000 7fa37d66c640 1 --2- 172.21.15.123:0/1577585624 >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 0x7fa3780cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:59.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.416+0000 7fa37ce6b640 1 --2- 172.21.15.123:0/1577585624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cd040 0x7fa3780cd670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0097a0 tx=0x7fa36c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef71af34e3888c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.416+0000 7fa377fff640 1 -- 172.21.15.123:0/1577585624 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c037070 con 0x7fa3780cd040 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.416+0000 7fa377fff640 1 -- 172.21.15.123:0/1577585624 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c032440 con 0x7fa3780cd040 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.416+0000 7fa377fff640 1 -- 172.21.15.123:0/1577585624 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c032810 con 0x7fa3780cd040 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 -- 172.21.15.123:0/1577585624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cd040 msgr2=0x7fa3780cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/1577585624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cd040 0x7fa3780cd670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0097a0 tx=0x7fa36c02a180 comp rx=0 tx=0).stop 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 -- 172.21.15.123:0/1577585624 shutdown_connections 2024-09-19T09:44:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/1577585624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cd040 0x7fa3780cd670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/1577585624 >> v2:172.21.15.194:3300/0 conn(0x7fa378155360 0x7fa3780cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 -- 172.21.15.123:0/1577585624 >> 172.21.15.123:0/1577585624 conn(0x7fa37806cb60 msgr2=0x7fa37806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 -- 172.21.15.123:0/1577585624 shutdown_connections 2024-09-19T09:44:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.417+0000 7fa37f8d0640 1 -- 172.21.15.123:0/1577585624 wait complete. 2024-09-19T09:44:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 Processor -- start 2024-09-19T09:44:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 -- start start 2024-09-19T09:44:59.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 0x7fa37815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cdbb0 0x7fa37815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa378155360 0x7fa3781f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780cbe40 con 0x7fa3780cd040 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa37815be20 con 0x7fa378155360 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.418+0000 7fa37f8d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa378155740 con 0x7fa3780cdbb0 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 0x7fa37815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 0x7fa37815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42062/0 (socket says 172.21.15.123:42062) 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 -- 172.21.15.123:0/3906688333 learned_addr learned my addr 172.21.15.123:0/3906688333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37ce6b640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cdbb0 0x7fa37815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37de6d640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa378155360 0x7fa3781f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 -- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cdbb0 msgr2=0x7fa37815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cdbb0 0x7fa37815a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 -- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa378155360 msgr2=0x7fa3781f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa378155360 0x7fa3781f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 -- 172.21.15.123:0/3906688333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3781564a0 con 0x7fa3780cd040 2024-09-19T09:44:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37d66c640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 0x7fa37815d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa36800efc0 tx=0x7fa36800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36800ce60 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa368019070 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37815d870 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.419+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368014680 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.420+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3781f41c0 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.421+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3781598c0 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.421+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa368005d10 con 0x7fa3780cd040 2024-09-19T09:44:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.421+0000 7fa375ffb640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa36406c2e0 0x7fa36406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.421+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa36808b710 con 0x7fa3780cd040 2024-09-19T09:44:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.421+0000 7fa37ce6b640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa36406c2e0 0x7fa36406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.422+0000 7fa37ce6b640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa36406c2e0 0x7fa36406e7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa36c034000 tx=0x7fa36c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.426+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa3781598c0 con 0x7fa3780cd040 2024-09-19T09:44:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.591+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3781f3fb0 con 0x7fa3780cd040 2024-09-19T09:44:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.591+0000 7fa375ffb640 1 -- 172.21.15.123:0/3906688333 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fa368010040 con 0x7fa3780cd040 2024-09-19T09:44:59.593 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa36406c2e0 msgr2=0x7fa36406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa36406c2e0 0x7fa36406e7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa36c034000 tx=0x7fa36c02e000 comp rx=0 tx=0).stop 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 msgr2=0x7fa37815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 0x7fa37815d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa36800efc0 tx=0x7fa36800c490 comp rx=0 tx=0).stop 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 shutdown_connections 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa378155360 0x7fa3781f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa36406c2e0 0x7fa36406e7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3780cdbb0 0x7fa37815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 --2- 172.21.15.123:0/3906688333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3780cd040 0x7fa37815d150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 >> 172.21.15.123:0/3906688333 conn(0x7fa37806cb60 msgr2=0x7fa378159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 shutdown_connections 2024-09-19T09:44:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.593+0000 7fa37f8d0640 1 -- 172.21.15.123:0/3906688333 wait complete. 2024-09-19T09:44:59.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:44:59.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.704+0000 7ff06445c640 1 Processor -- start 2024-09-19T09:44:59.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.704+0000 7ff06445c640 1 -- start start 2024-09-19T09:44:59.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff06445c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff05c1551d0 0x7ff05c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff06445c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c15f300 0x7ff05c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff06445c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05c15e620 con 0x7ff05c1555b0 2024-09-19T09:44:59.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff06445c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c0c5c50 con 0x7ff05c1551d0 2024-09-19T09:44:59.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff06445c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c15b5f0 con 0x7ff05c15f300 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff05c1551d0 0x7ff05c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff05c1551d0 0x7ff05c15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42064/0 (socket says 172.21.15.123:42064) 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 -- 172.21.15.123:0/3499981627 learned_addr learned my addr 172.21.15.123:0/3499981627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0629f9640 1 --2- 172.21.15.123:0/3499981627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c15f300 0x7ff05c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 -- 172.21.15.123:0/3499981627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c15f300 msgr2=0x7ff05c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 --2- 172.21.15.123:0/3499981627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c15f300 0x7ff05c06c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 -- 172.21.15.123:0/3499981627 >> v1:172.21.15.194:6789/0 conn(0x7ff05c1555b0 legacy=0x7ff05c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.705+0000 7ff0621f8640 1 -- 172.21.15.123:0/3499981627 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c15b8d0 con 0x7ff05c1551d0 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.706+0000 7ff0621f8640 1 --2- 172.21.15.123:0/3499981627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c15edc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff058009870 tx=0x7ff05802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d759f92eca8881f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.706+0000 7ff0611f6640 1 -- 172.21.15.123:0/3499981627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058037070 con 0x7ff05c1551d0 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.706+0000 7ff0611f6640 1 -- 172.21.15.123:0/3499981627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05802ae50 con 0x7ff05c1551d0 2024-09-19T09:44:59.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.706+0000 7ff0611f6640 1 -- 172.21.15.123:0/3499981627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058032860 con 0x7ff05c1551d0 2024-09-19T09:44:59.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 -- 172.21.15.123:0/3499981627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 msgr2=0x7ff05c15edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 --2- 172.21.15.123:0/3499981627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c15edc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff058009870 tx=0x7ff05802a300 comp rx=0 tx=0).stop 2024-09-19T09:44:59.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 -- 172.21.15.123:0/3499981627 shutdown_connections 2024-09-19T09:44:59.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 --2- 172.21.15.123:0/3499981627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c15f300 0x7ff05c06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 --2- 172.21.15.123:0/3499981627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c15edc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 -- 172.21.15.123:0/3499981627 >> 172.21.15.123:0/3499981627 conn(0x7ff05c0d0e10 msgr2=0x7ff05c0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 -- 172.21.15.123:0/3499981627 shutdown_connections 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.707+0000 7ff06445c640 1 -- 172.21.15.123:0/3499981627 wait complete. 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.708+0000 7ff06445c640 1 Processor -- start 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.708+0000 7ff06445c640 1 -- start start 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff06445c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff06445c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c1555b0 0x7ff05c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff06445c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff05c15f300 0x7ff05c1f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff06445c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c15e8a0 con 0x7ff05c1551d0 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff06445c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c15be90 con 0x7ff05c15f300 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff06445c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c0cd240 con 0x7ff05c1555b0 2024-09-19T09:44:59.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42076/0 (socket says 172.21.15.123:42076) 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 -- 172.21.15.123:0/3606088141 learned_addr learned my addr 172.21.15.123:0/3606088141 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0619f7640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c1555b0 0x7ff05c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0629f9640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff05c15f300 0x7ff05c1f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 -- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c1555b0 msgr2=0x7ff05c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c1555b0 0x7ff05c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 -- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff05c15f300 msgr2=0x7ff05c1f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff05c15f300 0x7ff05c1f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 -- 172.21.15.123:0/3606088141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c14afc0 con 0x7ff05c1551d0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.709+0000 7ff0621f8640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c0b4cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff05802a340 tx=0x7ff0580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.710+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058041020 con 0x7ff05c1551d0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.710+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05803c870 con 0x7ff05c1551d0 2024-09-19T09:44:59.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.710+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c0b6d50 con 0x7ff05c1551d0 2024-09-19T09:44:59.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.710+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058037040 con 0x7ff05c1551d0 2024-09-19T09:44:59.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.710+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c1f0f60 con 0x7ff05c1551d0 2024-09-19T09:44:59.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.711+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c15b080 con 0x7ff05c1551d0 2024-09-19T09:44:59.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.711+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff058044020 con 0x7ff05c1551d0 2024-09-19T09:44:59.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.711+0000 7ff052ffd640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff04006c2e0 0x7ff04006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.712+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7ff0580abc40 con 0x7ff05c1551d0 2024-09-19T09:44:59.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.712+0000 7ff0619f7640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff04006c2e0 0x7ff04006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.712+0000 7ff0619f7640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff04006c2e0 0x7ff04006e7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff05c1e77c0 tx=0x7ff04c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.716+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff05804b030 con 0x7ff05c1551d0 2024-09-19T09:44:59.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.881+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff05c068770 con 0x7ff05c1551d0 2024-09-19T09:44:59.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.881+0000 7ff052ffd640 1 -- 172.21.15.123:0/3606088141 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7ff05c0b6d50 con 0x7ff05c1551d0 2024-09-19T09:44:59.883 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-19T09:44:59.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.883+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff04006c2e0 msgr2=0x7ff04006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.883+0000 7ff06445c640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff04006c2e0 0x7ff04006e7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff05c1e77c0 tx=0x7ff04c009040 comp rx=0 tx=0).stop 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.883+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 msgr2=0x7ff05c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.883+0000 7ff06445c640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c0b4cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff05802a340 tx=0x7ff0580046c0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.883+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 shutdown_connections 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff05c15f300 0x7ff05c1f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff04006c2e0 0x7ff04006e7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff05c1555b0 0x7ff05c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 --2- 172.21.15.123:0/3606088141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff05c1551d0 0x7ff05c0b4cf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 >> 172.21.15.123:0/3606088141 conn(0x7ff05c0d0e10 msgr2=0x7ff05c1539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 shutdown_connections 2024-09-19T09:44:59.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.884+0000 7ff06445c640 1 -- 172.21.15.123:0/3606088141 wait complete. 2024-09-19T09:44:59.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:44:59.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.995+0000 7f58249fd640 1 Processor -- start 2024-09-19T09:44:59.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.995+0000 7f58249fd640 1 -- start start 2024-09-19T09:44:59.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f58249fd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f582014edd0 0x7f582015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f58249fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200724a0 0x7f58201588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f58249fd640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58200720d0 con 0x7f58200c9a30 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f58249fd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5820071110 con 0x7f582014edd0 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f58249fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5820157e10 con 0x7f58200724a0 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f581e59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f582014edd0 0x7f582015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f581e59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f582014edd0 0x7f582015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42092/0 (socket says 172.21.15.123:42092) 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.996+0000 7f581e59c640 1 -- 172.21.15.123:0/373790151 learned_addr learned my addr 172.21.15.123:0/373790151 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.997+0000 7f581ed9d640 1 --2- 172.21.15.123:0/373790151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200724a0 0x7f58201588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.997+0000 7f581e59c640 1 -- 172.21.15.123:0/373790151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200724a0 msgr2=0x7f58201588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.997+0000 7f581e59c640 1 --2- 172.21.15.123:0/373790151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200724a0 0x7f58201588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.997+0000 7f581e59c640 1 -- 172.21.15.123:0/373790151 >> v1:172.21.15.194:6789/0 conn(0x7f58200c9a30 legacy=0x7f58200c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.997+0000 7f581e59c640 1 -- 172.21.15.123:0/373790151 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5820071360 con 0x7f582014edd0 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.997+0000 7f581e59c640 1 --2- 172.21.15.123:0/373790151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582015b380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f581000d180 tx=0x7f581002c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498389338f3c5564 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f581d59a640 1 -- 172.21.15.123:0/373790151 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810009600 con 0x7f582014edd0 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f581d59a640 1 -- 172.21.15.123:0/373790151 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58100097a0 con 0x7f582014edd0 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f581d59a640 1 -- 172.21.15.123:0/373790151 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810009b70 con 0x7f582014edd0 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 -- 172.21.15.123:0/373790151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 msgr2=0x7f582015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 --2- 172.21.15.123:0/373790151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582015b380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f581000d180 tx=0x7f581002c830 comp rx=0 tx=0).stop 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 -- 172.21.15.123:0/373790151 shutdown_connections 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 --2- 172.21.15.123:0/373790151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200724a0 0x7f58201588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 --2- 172.21.15.123:0/373790151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582015b380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 -- 172.21.15.123:0/373790151 >> 172.21.15.123:0/373790151 conn(0x7f582006ed00 msgr2=0x7f582006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 -- 172.21.15.123:0/373790151 shutdown_connections 2024-09-19T09:45:00.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.998+0000 7f58249fd640 1 -- 172.21.15.123:0/373790151 wait complete. 2024-09-19T09:45:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:44:59.999+0000 7f58249fd640 1 Processor -- start 2024-09-19T09:45:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 -- start start 2024-09-19T09:45:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58200724a0 0x7f5820144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200c9a30 0x7f582014ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58201583b0 con 0x7f582014edd0 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f58201580d0 con 0x7f58200724a0 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f58249fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5820071c80 con 0x7f58200c9a30 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f581ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f581ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582014b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42100/0 (socket says 172.21.15.123:42100) 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f581ed9d640 1 -- 172.21.15.123:0/979921262 learned_addr learned my addr 172.21.15.123:0/979921262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f581e59c640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58200724a0 0x7f5820144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.000+0000 7f581dd9b640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200c9a30 0x7f582014ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f581ed9d640 1 -- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200c9a30 msgr2=0x7f582014ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f581ed9d640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200c9a30 0x7f582014ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f581ed9d640 1 -- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58200724a0 msgr2=0x7f5820144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f581ed9d640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58200724a0 0x7f5820144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f581ed9d640 1 -- 172.21.15.123:0/979921262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5820145230 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f581ed9d640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582014b360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f581800e7f0 tx=0x7f581800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5818017070 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581800c6d0 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582014d3c0 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581800cac0 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.001+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5820143fc0 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.002+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582015b380 con 0x7f582014edd0 2024-09-19T09:45:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.003+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f581801a070 con 0x7f582014edd0 2024-09-19T09:45:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.003+0000 7f5816ffd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c2b0 0x7f580006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.003+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f581808b670 con 0x7f582014edd0 2024-09-19T09:45:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.003+0000 7f581e59c640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c2b0 0x7f580006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.003+0000 7f581e59c640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c2b0 0x7f580006e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5810036000 tx=0x7f581000b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.007+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5818059690 con 0x7f582014edd0 2024-09-19T09:45:00.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.172+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f58200c3440 con 0x7f582014edd0 2024-09-19T09:45:00.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.172+0000 7f5816ffd640 1 -- 172.21.15.123:0/979921262 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f581805d990 con 0x7f582014edd0 2024-09-19T09:45:00.175 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c2b0 msgr2=0x7f580006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c2b0 0x7f580006e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5810036000 tx=0x7f581000b000 comp rx=0 tx=0).stop 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 msgr2=0x7f582014b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582014b360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f581800e7f0 tx=0x7f581800ecb0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 shutdown_connections 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582014edd0 0x7f582014b360 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c2b0 0x7f580006e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58200c9a30 0x7f582014ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 --2- 172.21.15.123:0/979921262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58200724a0 0x7f5820144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 >> 172.21.15.123:0/979921262 conn(0x7f582006ed00 msgr2=0x7f58200c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 shutdown_connections 2024-09-19T09:45:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.175+0000 7f58249fd640 1 -- 172.21.15.123:0/979921262 wait complete. 2024-09-19T09:45:00.190 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-19T09:45:00.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:45:00.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.287+0000 7f0803a27640 1 Processor -- start 2024-09-19T09:45:00.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.287+0000 7f0803a27640 1 -- start start 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0803a27640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f07fc158e30 0x7f07fc0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0803a27640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07fc06c680 0x7f07fc06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0803a27640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07fc0c6ce0 con 0x7f07fc1531e0 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0803a27640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f07fc0c61f0 con 0x7f07fc06c680 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0803a27640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f07fc0c4290 con 0x7f07fc158e30 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f08017c3640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f07fc1531e0 0x7f07fc073300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40212/0 (socket says 172.21.15.123:40212) 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f08017c3640 1 -- 172.21.15.123:0/2089556888 learned_addr learned my addr 172.21.15.123:0/2089556888 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:00.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0801fc4640 1 --2- 172.21.15.123:0/2089556888 >> v2:172.21.15.123:3300/0 conn(0x7f07fc06c680 0x7f07fc06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0800fc2640 1 --2- 172.21.15.123:0/2089556888 >> v2:172.21.15.194:3300/0 conn(0x7f07fc158e30 0x7f07fc0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f07f3fff640 1 -- 172.21.15.123:0/2089556888 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159542741 0 0) 0x7f07fc0c6ce0 con 0x7f07fc1531e0 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f07f3fff640 1 -- 172.21.15.123:0/2089556888 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e8003520 con 0x7f07fc1531e0 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0801fc4640 1 -- 172.21.15.123:0/2089556888 >> v2:172.21.15.194:3300/0 conn(0x7f07fc158e30 msgr2=0x7f07fc0c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0801fc4640 1 --2- 172.21.15.123:0/2089556888 >> v2:172.21.15.194:3300/0 conn(0x7f07fc158e30 0x7f07fc0c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0801fc4640 1 -- 172.21.15.123:0/2089556888 >> v1:172.21.15.123:6789/0 conn(0x7f07fc1531e0 legacy=0x7f07fc073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.288+0000 7f0801fc4640 1 -- 172.21.15.123:0/2089556888 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc0c6440 con 0x7f07fc06c680 2024-09-19T09:45:00.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.289+0000 7f0801fc4640 1 --2- 172.21.15.123:0/2089556888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc06c680 0x7f07fc06ca90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07fc06e210 tx=0x7f07f402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9d620d78aea3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.289+0000 7f07f3fff640 1 -- 172.21.15.123:0/2089556888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4007740 con 0x7f07fc06c680 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.289+0000 7f07f3fff640 1 -- 172.21.15.123:0/2089556888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f40078e0 con 0x7f07fc06c680 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.289+0000 7f07f3fff640 1 -- 172.21.15.123:0/2089556888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4007cb0 con 0x7f07fc06c680 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 -- 172.21.15.123:0/2089556888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc06c680 msgr2=0x7f07fc06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 --2- 172.21.15.123:0/2089556888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc06c680 0x7f07fc06ca90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07fc06e210 tx=0x7f07f402a710 comp rx=0 tx=0).stop 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 -- 172.21.15.123:0/2089556888 shutdown_connections 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 --2- 172.21.15.123:0/2089556888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc06c680 0x7f07fc06ca90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 --2- 172.21.15.123:0/2089556888 >> v2:172.21.15.194:3300/0 conn(0x7f07fc158e30 0x7f07fc0c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 -- 172.21.15.123:0/2089556888 >> 172.21.15.123:0/2089556888 conn(0x7f07fc06ec90 msgr2=0x7f07fc06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 -- 172.21.15.123:0/2089556888 shutdown_connections 2024-09-19T09:45:00.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.290+0000 7f0803a27640 1 -- 172.21.15.123:0/2089556888 wait complete. 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.291+0000 7f0803a27640 1 Processor -- start 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.291+0000 7f0803a27640 1 -- start start 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07fc06c680 0x7f07fc154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07fc1531e0 0x7f07fc0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 0x7f07fc0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc0c3f20 con 0x7f07fc158e30 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc0c6a00 con 0x7f07fc1531e0 2024-09-19T09:45:00.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc06cfd0 con 0x7f07fc06c680 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 0x7f07fc0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 0x7f07fc0cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42120/0 (socket says 172.21.15.123:42120) 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 -- 172.21.15.123:0/2819331870 learned_addr learned my addr 172.21.15.123:0/2819331870 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0800fc2640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07fc1531e0 0x7f07fc0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f08017c3640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07fc06c680 0x7f07fc154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 -- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07fc06c680 msgr2=0x7f07fc154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07fc06c680 0x7f07fc154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 -- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07fc1531e0 msgr2=0x7f07fc0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07fc1531e0 0x7f07fc0c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 -- 172.21.15.123:0/2819331870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc155180 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f08017c3640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07fc06c680 0x7f07fc154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0801fc4640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 0x7f07fc0cbb00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07f402ad00 tx=0x7f07f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4040070 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4031bc0 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc15a170 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.292+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4009450 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.293+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc15a730 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.294+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc0c3a00 con 0x7f07fc158e30 2024-09-19T09:45:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.294+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f07f4039040 con 0x7f07fc158e30 2024-09-19T09:45:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.295+0000 7f07f1ffb640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f07e006c2b0 0x7f07e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.295+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f07f40acc60 con 0x7f07fc158e30 2024-09-19T09:45:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.295+0000 7f08017c3640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f07e006c2b0 0x7f07e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.295+0000 7f08017c3640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f07e006c2b0 0x7f07e006e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005880 tx=0x7f07f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.299+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f07f4043360 con 0x7f07fc158e30 2024-09-19T09:45:00.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.461+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07fc158a80 con 0x7f07e006c2b0 2024-09-19T09:45:00.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.466+0000 7f07f1ffb640 1 -- 172.21.15.123:0/2819331870 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7f07fc158a80 con 0x7f07e006c2b0 2024-09-19T09:45:00.472 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:45:00.473 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:45:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f07e006c2b0 msgr2=0x7f07e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f07e006c2b0 0x7f07e006e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005880 tx=0x7f07f8009040 comp rx=0 tx=0).stop 2024-09-19T09:45:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 msgr2=0x7f07fc0cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 0x7f07fc0cbb00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07f402ad00 tx=0x7f07f4004a40 comp rx=0 tx=0).stop 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 shutdown_connections 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07fc158e30 0x7f07fc0cbb00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07fc1531e0 0x7f07fc0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f07e006c2b0 0x7f07e006e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.469+0000 7f0803a27640 1 --2- 172.21.15.123:0/2819331870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07fc06c680 0x7f07fc154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.470+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 >> 172.21.15.123:0/2819331870 conn(0x7f07fc06ec90 msgr2=0x7f07fc1581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.470+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 shutdown_connections 2024-09-19T09:45:00.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.470+0000 7f0803a27640 1 -- 172.21.15.123:0/2819331870 wait complete. 2024-09-19T09:45:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-19T09:44:58.731935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3317760,"data_stored":1933148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629369+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:43:20.629369+0000","last_peered":"2024-09-19T09:43:20.629369+0000","last_clean":"2024-09-19T09:43:20.629369+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:43:20.629369+0000","last_undegraded":"2024-09-19T09:43:20.629369+0000","last_fullsized":"2024-09-19T09:43:20.629369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618749+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:43:20.618749+0000","last_peered":"2024-09-19T09:43:20.618749+0000","last_clean":"2024-09-19T09:43:20.618749+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:43:20.618749+0000","last_undegraded":"2024-09-19T09:43:20.618749+0000","last_fullsized":"2024-09-19T09:43:20.618749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628301+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:43:20.628301+0000","last_peered":"2024-09-19T09:43:20.628301+0000","last_clean":"2024-09-19T09:43:20.628301+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:43:20.628301+0000","last_undegraded":"2024-09-19T09:43:20.628301+0000","last_fullsized":"2024-09-19T09:43:20.628301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628317+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:43:20.628317+0000","last_peered":"2024-09-19T09:43:20.628317+0000","last_clean":"2024-09-19T09:43:20.628317+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:43:20.628317+0000","last_undegraded":"2024-09-19T09:43:20.628317+0000","last_fullsized":"2024-09-19T09:43:20.628317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628809+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:43:20.628809+0000","last_peered":"2024-09-19T09:43:20.628809+0000","last_clean":"2024-09-19T09:43:20.628809+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:43:20.628809+0000","last_undegraded":"2024-09-19T09:43:20.628809+0000","last_fullsized":"2024-09-19T09:43:20.628809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628174+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:43:20.628174+0000","last_peered":"2024-09-19T09:43:20.628174+0000","last_clean":"2024-09-19T09:43:20.628174+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:43:20.628174+0000","last_undegraded":"2024-09-19T09:43:20.628174+0000","last_fullsized":"2024-09-19T09:43:20.628174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628150+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:43:20.628150+0000","last_peered":"2024-09-19T09:43:20.628150+0000","last_clean":"2024-09-19T09:43:20.628150+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:43:20.628150+0000","last_undegraded":"2024-09-19T09:43:20.628150+0000","last_fullsized":"2024-09-19T09:43:20.628150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615597+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:43:20.615597+0000","last_peered":"2024-09-19T09:43:20.615597+0000","last_clean":"2024-09-19T09:43:20.615597+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:43:20.615597+0000","last_undegraded":"2024-09-19T09:43:20.615597+0000","last_fullsized":"2024-09-19T09:43:20.615597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629326+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:43:20.629326+0000","last_peered":"2024-09-19T09:43:20.629326+0000","last_clean":"2024-09-19T09:43:20.629326+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:43:20.629326+0000","last_undegraded":"2024-09-19T09:43:20.629326+0000","last_fullsized":"2024-09-19T09:43:20.629326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616406+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:43:20.616406+0000","last_peered":"2024-09-19T09:43:20.616406+0000","last_clean":"2024-09-19T09:43:20.616406+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:43:20.616406+0000","last_undegraded":"2024-09-19T09:43:20.616406+0000","last_fullsized":"2024-09-19T09:43:20.616406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615708+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:43:20.615708+0000","last_peered":"2024-09-19T09:43:20.615708+0000","last_clean":"2024-09-19T09:43:20.615708+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:43:20.615708+0000","last_undegraded":"2024-09-19T09:43:20.615708+0000","last_fullsized":"2024-09-19T09:43:20.615708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616452+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:43:20.616452+0000","last_peered":"2024-09-19T09:43:20.616452+0000","last_clean":"2024-09-19T09:43:20.616452+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:43:20.616452+0000","last_undegraded":"2024-09-19T09:43:20.616452+0000","last_fullsized":"2024-09-19T09:43:20.616452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616150+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:43:20.616150+0000","last_peered":"2024-09-19T09:43:20.616150+0000","last_clean":"2024-09-19T09:43:20.616150+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:43:20.616150+0000","last_undegraded":"2024-09-19T09:43:20.616150+0000","last_fullsized":"2024-09-19T09:43:20.616150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628091+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:43:20.628091+0000","last_peered":"2024-09-19T09:43:20.628091+0000","last_clean":"2024-09-19T09:43:20.628091+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:43:20.628091+0000","last_undegraded":"2024-09-19T09:43:20.628091+0000","last_fullsized":"2024-09-19T09:43:20.628091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617840+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:43:20.617840+0000","last_peered":"2024-09-19T09:43:20.617840+0000","last_clean":"2024-09-19T09:43:20.617840+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:43:20.617840+0000","last_undegraded":"2024-09-19T09:43:20.617840+0000","last_fullsized":"2024-09-19T09:43:20.617840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628339+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:43:20.628339+0000","last_peered":"2024-09-19T09:43:20.628339+0000","last_clean":"2024-09-19T09:43:20.628339+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:43:20.628339+0000","last_undegraded":"2024-09-19T09:43:20.628339+0000","last_fullsized":"2024-09-19T09:43:20.628339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628960+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:43:20.628960+0000","last_peered":"2024-09-19T09:43:20.628960+0000","last_clean":"2024-09-19T09:43:20.628960+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:43:20.628960+0000","last_undegraded":"2024-09-19T09:43:20.628960+0000","last_fullsized":"2024-09-19T09:43:20.628960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617527+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:43:20.617527+0000","last_peered":"2024-09-19T09:43:20.617527+0000","last_clean":"2024-09-19T09:43:20.617527+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:43:20.617527+0000","last_undegraded":"2024-09-19T09:43:20.617527+0000","last_fullsized":"2024-09-19T09:43:20.617527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628848+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:43:20.628848+0000","last_peered":"2024-09-19T09:43:20.628848+0000","last_clean":"2024-09-19T09:43:20.628848+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:43:20.628848+0000","last_undegraded":"2024-09-19T09:43:20.628848+0000","last_fullsized":"2024-09-19T09:43:20.628848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615991+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:43:20.615991+0000","last_peered":"2024-09-19T09:43:20.615991+0000","last_clean":"2024-09-19T09:43:20.615991+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:43:20.615991+0000","last_undegraded":"2024-09-19T09:43:20.615991+0000","last_fullsized":"2024-09-19T09:43:20.615991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628219+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:43:20.628219+0000","last_peered":"2024-09-19T09:43:20.628219+0000","last_clean":"2024-09-19T09:43:20.628219+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:43:20.628219+0000","last_undegraded":"2024-09-19T09:43:20.628219+0000","last_fullsized":"2024-09-19T09:43:20.628219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628331+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:43:20.628331+0000","last_peered":"2024-09-19T09:43:20.628331+0000","last_clean":"2024-09-19T09:43:20.628331+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:43:20.628331+0000","last_undegraded":"2024-09-19T09:43:20.628331+0000","last_fullsized":"2024-09-19T09:43:20.628331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615837+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:43:20.615837+0000","last_peered":"2024-09-19T09:43:20.615837+0000","last_clean":"2024-09-19T09:43:20.615837+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:43:20.615837+0000","last_undegraded":"2024-09-19T09:43:20.615837+0000","last_fullsized":"2024-09-19T09:43:20.615837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628426+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:43:20.628426+0000","last_peered":"2024-09-19T09:43:20.628426+0000","last_clean":"2024-09-19T09:43:20.628426+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:43:20.628426+0000","last_undegraded":"2024-09-19T09:43:20.628426+0000","last_fullsized":"2024-09-19T09:43:20.628426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616750+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:43:20.616750+0000","last_peered":"2024-09-19T09:43:20.616750+0000","last_clean":"2024-09-19T09:43:20.616750+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:43:20.616750+0000","last_undegraded":"2024-09-19T09:43:20.616750+0000","last_fullsized":"2024-09-19T09:43:20.616750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616538+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:43:20.616538+0000","last_peered":"2024-09-19T09:43:20.616538+0000","last_clean":"2024-09-19T09:43:20.616538+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:43:20.616538+0000","last_undegraded":"2024-09-19T09:43:20.616538+0000","last_fullsized":"2024-09-19T09:43:20.616538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618099+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:43:20.618099+0000","last_peered":"2024-09-19T09:43:20.618099+0000","last_clean":"2024-09-19T09:43:20.618099+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:43:20.618099+0000","last_undegraded":"2024-09-19T09:43:20.618099+0000","last_fullsized":"2024-09-19T09:43:20.618099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616820+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:43:20.616820+0000","last_peered":"2024-09-19T09:43:20.616820+0000","last_clean":"2024-09-19T09:43:20.616820+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:43:20.616820+0000","last_undegraded":"2024-09-19T09:43:20.616820+0000","last_fullsized":"2024-09-19T09:43:20.616820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628305+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:43:20.628305+0000","last_peered":"2024-09-19T09:43:20.628305+0000","last_clean":"2024-09-19T09:43:20.628305+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:43:20.628305+0000","last_undegraded":"2024-09-19T09:43:20.628305+0000","last_fullsized":"2024-09-19T09:43:20.628305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628440+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:43:20.628440+0000","last_peered":"2024-09-19T09:43:20.628440+0000","last_clean":"2024-09-19T09:43:20.628440+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:43:20.628440+0000","last_undegraded":"2024-09-19T09:43:20.628440+0000","last_fullsized":"2024-09-19T09:43:20.628440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617591+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:43:20.617591+0000","last_peered":"2024-09-19T09:43:20.617591+0000","last_clean":"2024-09-19T09:43:20.617591+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:43:20.617591+0000","last_undegraded":"2024-09-19T09:43:20.617591+0000","last_fullsized":"2024-09-19T09:43:20.617591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615608+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:43:20.615608+0000","last_peered":"2024-09-19T09:43:20.615608+0000","last_clean":"2024-09-19T09:43:20.615608+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:43:20.615608+0000","last_undegraded":"2024-09-19T09:43:20.615608+0000","last_fullsized":"2024-09-19T09:43:20.615608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615965+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:43:20.615965+0000","last_peered":"2024-09-19T09:43:20.615965+0000","last_clean":"2024-09-19T09:43:20.615965+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:43:20.615965+0000","last_undegraded":"2024-09-19T09:43:20.615965+0000","last_fullsized":"2024-09-19T09:43:20.615965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616261+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:43:20.616261+0000","last_peered":"2024-09-19T09:43:20.616261+0000","last_clean":"2024-09-19T09:43:20.616261+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:43:20.616261+0000","last_undegraded":"2024-09-19T09:43:20.616261+0000","last_fullsized":"2024-09-19T09:43:20.616261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628314+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:43:20.628314+0000","last_peered":"2024-09-19T09:43:20.628314+0000","last_clean":"2024-09-19T09:43:20.628314+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:43:20.628314+0000","last_undegraded":"2024-09-19T09:43:20.628314+0000","last_fullsized":"2024-09-19T09:43:20.628314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615970+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:43:20.615970+0000","last_peered":"2024-09-19T09:43:20.615970+0000","last_clean":"2024-09-19T09:43:20.615970+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:43:20.615970+0000","last_undegraded":"2024-09-19T09:43:20.615970+0000","last_fullsized":"2024-09-19T09:43:20.615970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615912+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:43:20.615912+0000","last_peered":"2024-09-19T09:43:20.615912+0000","last_clean":"2024-09-19T09:43:20.615912+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:43:20.615912+0000","last_undegraded":"2024-09-19T09:43:20.615912+0000","last_fullsized":"2024-09-19T09:43:20.615912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615675+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:43:20.615675+0000","last_peered":"2024-09-19T09:43:20.615675+0000","last_clean":"2024-09-19T09:43:20.615675+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:43:20.615675+0000","last_undegraded":"2024-09-19T09:43:20.615675+0000","last_fullsized":"2024-09-19T09:43:20.615675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628399+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:43:20.628399+0000","last_peered":"2024-09-19T09:43:20.628399+0000","last_clean":"2024-09-19T09:43:20.628399+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:43:20.628399+0000","last_undegraded":"2024-09-19T09:43:20.628399+0000","last_fullsized":"2024-09-19T09:43:20.628399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617680+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:43:20.617680+0000","last_peered":"2024-09-19T09:43:20.617680+0000","last_clean":"2024-09-19T09:43:20.617680+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:43:20.617680+0000","last_undegraded":"2024-09-19T09:43:20.617680+0000","last_fullsized":"2024-09-19T09:43:20.617680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616177+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:43:20.616177+0000","last_peered":"2024-09-19T09:43:20.616177+0000","last_clean":"2024-09-19T09:43:20.616177+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:43:20.616177+0000","last_undegraded":"2024-09-19T09:43:20.616177+0000","last_fullsized":"2024-09-19T09:43:20.616177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629156+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:43:20.629156+0000","last_peered":"2024-09-19T09:43:20.629156+0000","last_clean":"2024-09-19T09:43:20.629156+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:43:20.629156+0000","last_undegraded":"2024-09-19T09:43:20.629156+0000","last_fullsized":"2024-09-19T09:43:20.629156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629204+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:43:20.629204+0000","last_peered":"2024-09-19T09:43:20.629204+0000","last_clean":"2024-09-19T09:43:20.629204+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:43:20.629204+0000","last_undegraded":"2024-09-19T09:43:20.629204+0000","last_fullsized":"2024-09-19T09:43:20.629204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628375+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:43:20.628375+0000","last_peered":"2024-09-19T09:43:20.628375+0000","last_clean":"2024-09-19T09:43:20.628375+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:43:20.628375+0000","last_undegraded":"2024-09-19T09:43:20.628375+0000","last_fullsized":"2024-09-19T09:43:20.628375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618175+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:43:20.618175+0000","last_peered":"2024-09-19T09:43:20.618175+0000","last_clean":"2024-09-19T09:43:20.618175+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:43:20.618175+0000","last_undegraded":"2024-09-19T09:43:20.618175+0000","last_fullsized":"2024-09-19T09:43:20.618175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616569+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:43:20.616569+0000","last_peered":"2024-09-19T09:43:20.616569+0000","last_clean":"2024-09-19T09:43:20.616569+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:43:20.616569+0000","last_undegraded":"2024-09-19T09:43:20.616569+0000","last_fullsized":"2024-09-19T09:43:20.616569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:44:57.635142+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:44:57.635142+0000","last_peered":"2024-09-19T09:44:57.635142+0000","last_clean":"2024-09-19T09:44:57.635142+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:44:57.635142+0000","last_undegraded":"2024-09-19T09:44:57.635142+0000","last_fullsized":"2024-09-19T09:44:57.635142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628508+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:43:20.628508+0000","last_peered":"2024-09-19T09:43:20.628508+0000","last_clean":"2024-09-19T09:43:20.628508+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:43:20.628508+0000","last_undegraded":"2024-09-19T09:43:20.628508+0000","last_fullsized":"2024-09-19T09:43:20.628508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628411+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:43:20.628411+0000","last_peered":"2024-09-19T09:43:20.628411+0000","last_clean":"2024-09-19T09:43:20.628411+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:43:20.628411+0000","last_undegraded":"2024-09-19T09:43:20.628411+0000","last_fullsized":"2024-09-19T09:43:20.628411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628178+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:43:20.628178+0000","last_peered":"2024-09-19T09:43:20.628178+0000","last_clean":"2024-09-19T09:43:20.628178+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:43:20.628178+0000","last_undegraded":"2024-09-19T09:43:20.628178+0000","last_fullsized":"2024-09-19T09:43:20.628178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628955+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:43:20.628955+0000","last_peered":"2024-09-19T09:43:20.628955+0000","last_clean":"2024-09-19T09:43:20.628955+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:43:20.628955+0000","last_undegraded":"2024-09-19T09:43:20.628955+0000","last_fullsized":"2024-09-19T09:43:20.628955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628957+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:43:20.628957+0000","last_peered":"2024-09-19T09:43:20.628957+0000","last_clean":"2024-09-19T09:43:20.628957+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:43:20.628957+0000","last_undegraded":"2024-09-19T09:43:20.628957+0000","last_fullsized":"2024-09-19T09:43:20.628957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615794+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:43:20.615794+0000","last_peered":"2024-09-19T09:43:20.615794+0000","last_clean":"2024-09-19T09:43:20.615794+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:43:20.615794+0000","last_undegraded":"2024-09-19T09:43:20.615794+0000","last_fullsized":"2024-09-19T09:43:20.615794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615713+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:43:20.615713+0000","last_peered":"2024-09-19T09:43:20.615713+0000","last_clean":"2024-09-19T09:43:20.615713+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:43:20.615713+0000","last_undegraded":"2024-09-19T09:43:20.615713+0000","last_fullsized":"2024-09-19T09:43:20.615713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617775+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:43:20.617775+0000","last_peered":"2024-09-19T09:43:20.617775+0000","last_clean":"2024-09-19T09:43:20.617775+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:43:20.617775+0000","last_undegraded":"2024-09-19T09:43:20.617775+0000","last_fullsized":"2024-09-19T09:43:20.617775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628315+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:43:20.628315+0000","last_peered":"2024-09-19T09:43:20.628315+0000","last_clean":"2024-09-19T09:43:20.628315+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:43:20.628315+0000","last_undegraded":"2024-09-19T09:43:20.628315+0000","last_fullsized":"2024-09-19T09:43:20.628315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616564+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:43:20.616564+0000","last_peered":"2024-09-19T09:43:20.616564+0000","last_clean":"2024-09-19T09:43:20.616564+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:43:20.616564+0000","last_undegraded":"2024-09-19T09:43:20.616564+0000","last_fullsized":"2024-09-19T09:43:20.616564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.623189+0000","last_change":"2024-09-19T09:43:20.619746+0000","last_active":"2024-09-19T09:43:20.623189+0000","last_peered":"2024-09-19T09:43:20.623189+0000","last_clean":"2024-09-19T09:43:20.623189+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:43:20.623189+0000","last_undegraded":"2024-09-19T09:43:20.623189+0000","last_fullsized":"2024-09-19T09:43:20.623189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:39.025798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617755+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:43:20.617755+0000","last_peered":"2024-09-19T09:43:20.617755+0000","last_clean":"2024-09-19T09:43:20.617755+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:43:20.617755+0000","last_undegraded":"2024-09-19T09:43:20.617755+0000","last_fullsized":"2024-09-19T09:43:20.617755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629450+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:43:20.629450+0000","last_peered":"2024-09-19T09:43:20.629450+0000","last_clean":"2024-09-19T09:43:20.629450+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:43:20.629450+0000","last_undegraded":"2024-09-19T09:43:20.629450+0000","last_fullsized":"2024-09-19T09:43:20.629450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618442+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:43:20.618442+0000","last_peered":"2024-09-19T09:43:20.618442+0000","last_clean":"2024-09-19T09:43:20.618442+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:43:20.618442+0000","last_undegraded":"2024-09-19T09:43:20.618442+0000","last_fullsized":"2024-09-19T09:43:20.618442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.622491+0000","last_change":"2024-09-19T09:43:20.619216+0000","last_active":"2024-09-19T09:43:20.622491+0000","last_peered":"2024-09-19T09:43:20.622491+0000","last_clean":"2024-09-19T09:43:20.622491+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:43:20.622491+0000","last_undegraded":"2024-09-19T09:43:20.622491+0000","last_fullsized":"2024-09-19T09:43:20.622491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:14.168619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617868+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:43:20.617868+0000","last_peered":"2024-09-19T09:43:20.617868+0000","last_clean":"2024-09-19T09:43:20.617868+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:43:20.617868+0000","last_undegraded":"2024-09-19T09:43:20.617868+0000","last_fullsized":"2024-09-19T09:43:20.617868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628648+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:43:20.628648+0000","last_peered":"2024-09-19T09:43:20.628648+0000","last_clean":"2024-09-19T09:43:20.628648+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:43:20.628648+0000","last_undegraded":"2024-09-19T09:43:20.628648+0000","last_fullsized":"2024-09-19T09:43:20.628648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628275+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:43:20.628275+0000","last_peered":"2024-09-19T09:43:20.628275+0000","last_clean":"2024-09-19T09:43:20.628275+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:43:20.628275+0000","last_undegraded":"2024-09-19T09:43:20.628275+0000","last_fullsized":"2024-09-19T09:43:20.628275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628645+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:43:20.628645+0000","last_peered":"2024-09-19T09:43:20.628645+0000","last_clean":"2024-09-19T09:43:20.628645+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:43:20.628645+0000","last_undegraded":"2024-09-19T09:43:20.628645+0000","last_fullsized":"2024-09-19T09:43:20.628645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616042+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:43:20.616042+0000","last_peered":"2024-09-19T09:43:20.616042+0000","last_clean":"2024-09-19T09:43:20.616042+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:43:20.616042+0000","last_undegraded":"2024-09-19T09:43:20.616042+0000","last_fullsized":"2024-09-19T09:43:20.616042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628150+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:43:20.628150+0000","last_peered":"2024-09-19T09:43:20.628150+0000","last_clean":"2024-09-19T09:43:20.628150+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:43:20.628150+0000","last_undegraded":"2024-09-19T09:43:20.628150+0000","last_fullsized":"2024-09-19T09:43:20.628150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628079+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:43:20.628079+0000","last_peered":"2024-09-19T09:43:20.628079+0000","last_clean":"2024-09-19T09:43:20.628079+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:43:20.628079+0000","last_undegraded":"2024-09-19T09:43:20.628079+0000","last_fullsized":"2024-09-19T09:43:20.628079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617681+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:43:20.617681+0000","last_peered":"2024-09-19T09:43:20.617681+0000","last_clean":"2024-09-19T09:43:20.617681+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:43:20.617681+0000","last_undegraded":"2024-09-19T09:43:20.617681+0000","last_fullsized":"2024-09-19T09:43:20.617681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617955+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:43:20.617955+0000","last_peered":"2024-09-19T09:43:20.617955+0000","last_clean":"2024-09-19T09:43:20.617955+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:43:20.617955+0000","last_undegraded":"2024-09-19T09:43:20.617955+0000","last_fullsized":"2024-09-19T09:43:20.617955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629145+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:43:20.629145+0000","last_peered":"2024-09-19T09:43:20.629145+0000","last_clean":"2024-09-19T09:43:20.629145+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:43:20.629145+0000","last_undegraded":"2024-09-19T09:43:20.629145+0000","last_fullsized":"2024-09-19T09:43:20.629145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616505+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:43:20.616505+0000","last_peered":"2024-09-19T09:43:20.616505+0000","last_clean":"2024-09-19T09:43:20.616505+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:43:20.616505+0000","last_undegraded":"2024-09-19T09:43:20.616505+0000","last_fullsized":"2024-09-19T09:43:20.616505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618185+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:43:20.618185+0000","last_peered":"2024-09-19T09:43:20.618185+0000","last_clean":"2024-09-19T09:43:20.618185+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:43:20.618185+0000","last_undegraded":"2024-09-19T09:43:20.618185+0000","last_fullsized":"2024-09-19T09:43:20.618185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628752+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:43:20.628752+0000","last_peered":"2024-09-19T09:43:20.628752+0000","last_clean":"2024-09-19T09:43:20.628752+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:43:20.628752+0000","last_undegraded":"2024-09-19T09:43:20.628752+0000","last_fullsized":"2024-09-19T09:43:20.628752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628946+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:43:20.628946+0000","last_peered":"2024-09-19T09:43:20.628946+0000","last_clean":"2024-09-19T09:43:20.628946+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:43:20.628946+0000","last_undegraded":"2024-09-19T09:43:20.628946+0000","last_fullsized":"2024-09-19T09:43:20.628946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618060+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:43:20.618060+0000","last_peered":"2024-09-19T09:43:20.618060+0000","last_clean":"2024-09-19T09:43:20.618060+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:43:20.618060+0000","last_undegraded":"2024-09-19T09:43:20.618060+0000","last_fullsized":"2024-09-19T09:43:20.618060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618814+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:43:20.618814+0000","last_peered":"2024-09-19T09:43:20.618814+0000","last_clean":"2024-09-19T09:43:20.618814+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:43:20.618814+0000","last_undegraded":"2024-09-19T09:43:20.618814+0000","last_fullsized":"2024-09-19T09:43:20.618814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616737+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:43:20.616737+0000","last_peered":"2024-09-19T09:43:20.616737+0000","last_clean":"2024-09-19T09:43:20.616737+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:43:20.616737+0000","last_undegraded":"2024-09-19T09:43:20.616737+0000","last_fullsized":"2024-09-19T09:43:20.616737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616319+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:43:20.616319+0000","last_peered":"2024-09-19T09:43:20.616319+0000","last_clean":"2024-09-19T09:43:20.616319+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:43:20.616319+0000","last_undegraded":"2024-09-19T09:43:20.616319+0000","last_fullsized":"2024-09-19T09:43:20.616319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628398+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:43:20.628398+0000","last_peered":"2024-09-19T09:43:20.628398+0000","last_clean":"2024-09-19T09:43:20.628398+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:43:20.628398+0000","last_undegraded":"2024-09-19T09:43:20.628398+0000","last_fullsized":"2024-09-19T09:43:20.628398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628098+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:43:20.628098+0000","last_peered":"2024-09-19T09:43:20.628098+0000","last_clean":"2024-09-19T09:43:20.628098+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:43:20.628098+0000","last_undegraded":"2024-09-19T09:43:20.628098+0000","last_fullsized":"2024-09-19T09:43:20.628098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616547+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:43:20.616547+0000","last_peered":"2024-09-19T09:43:20.616547+0000","last_clean":"2024-09-19T09:43:20.616547+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:43:20.616547+0000","last_undegraded":"2024-09-19T09:43:20.616547+0000","last_fullsized":"2024-09-19T09:43:20.616547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617961+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:43:20.617961+0000","last_peered":"2024-09-19T09:43:20.617961+0000","last_clean":"2024-09-19T09:43:20.617961+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:43:20.617961+0000","last_undegraded":"2024-09-19T09:43:20.617961+0000","last_fullsized":"2024-09-19T09:43:20.617961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.625330+0000","last_change":"2024-09-19T09:43:20.620289+0000","last_active":"2024-09-19T09:43:20.625330+0000","last_peered":"2024-09-19T09:43:20.625330+0000","last_clean":"2024-09-19T09:43:20.625330+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:43:20.625330+0000","last_undegraded":"2024-09-19T09:43:20.625330+0000","last_fullsized":"2024-09-19T09:43:20.625330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:36.817715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618423+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:43:20.618423+0000","last_peered":"2024-09-19T09:43:20.618423+0000","last_clean":"2024-09-19T09:43:20.618423+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:43:20.618423+0000","last_undegraded":"2024-09-19T09:43:20.618423+0000","last_fullsized":"2024-09-19T09:43:20.618423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616284+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:43:20.616284+0000","last_peered":"2024-09-19T09:43:20.616284+0000","last_clean":"2024-09-19T09:43:20.616284+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:43:20.616284+0000","last_undegraded":"2024-09-19T09:43:20.616284+0000","last_fullsized":"2024-09-19T09:43:20.616284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629070+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:43:20.629070+0000","last_peered":"2024-09-19T09:43:20.629070+0000","last_clean":"2024-09-19T09:43:20.629070+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:43:20.629070+0000","last_undegraded":"2024-09-19T09:43:20.629070+0000","last_fullsized":"2024-09-19T09:43:20.629070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615921+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:43:20.615921+0000","last_peered":"2024-09-19T09:43:20.615921+0000","last_clean":"2024-09-19T09:43:20.615921+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:43:20.615921+0000","last_undegraded":"2024-09-19T09:43:20.615921+0000","last_fullsized":"2024-09-19T09:43:20.615921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.625338+0000","last_change":"2024-09-19T09:43:20.620403+0000","last_active":"2024-09-19T09:43:20.625338+0000","last_peered":"2024-09-19T09:43:20.625338+0000","last_clean":"2024-09-19T09:43:20.625338+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:43:20.625338+0000","last_undegraded":"2024-09-19T09:43:20.625338+0000","last_fullsized":"2024-09-19T09:43:20.625338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:34.693485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628392+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:43:20.628392+0000","last_peered":"2024-09-19T09:43:20.628392+0000","last_clean":"2024-09-19T09:43:20.628392+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:43:20.628392+0000","last_undegraded":"2024-09-19T09:43:20.628392+0000","last_fullsized":"2024-09-19T09:43:20.628392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628376+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:43:20.628376+0000","last_peered":"2024-09-19T09:43:20.628376+0000","last_clean":"2024-09-19T09:43:20.628376+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:43:20.628376+0000","last_undegraded":"2024-09-19T09:43:20.628376+0000","last_fullsized":"2024-09-19T09:43:20.628376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628702+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:43:20.628702+0000","last_peered":"2024-09-19T09:43:20.628702+0000","last_clean":"2024-09-19T09:43:20.628702+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:43:20.628702+0000","last_undegraded":"2024-09-19T09:43:20.628702+0000","last_fullsized":"2024-09-19T09:43:20.628702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628415+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:43:20.628415+0000","last_peered":"2024-09-19T09:43:20.628415+0000","last_clean":"2024-09-19T09:43:20.628415+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:43:20.628415+0000","last_undegraded":"2024-09-19T09:43:20.628415+0000","last_fullsized":"2024-09-19T09:43:20.628415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616718+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:43:20.616718+0000","last_peered":"2024-09-19T09:43:20.616718+0000","last_clean":"2024-09-19T09:43:20.616718+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:43:20.616718+0000","last_undegraded":"2024-09-19T09:43:20.616718+0000","last_fullsized":"2024-09-19T09:43:20.616718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616575+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:43:20.616575+0000","last_peered":"2024-09-19T09:43:20.616575+0000","last_clean":"2024-09-19T09:43:20.616575+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:43:20.616575+0000","last_undegraded":"2024-09-19T09:43:20.616575+0000","last_fullsized":"2024-09-19T09:43:20.616575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628478+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:43:20.628478+0000","last_peered":"2024-09-19T09:43:20.628478+0000","last_clean":"2024-09-19T09:43:20.628478+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:43:20.628478+0000","last_undegraded":"2024-09-19T09:43:20.628478+0000","last_fullsized":"2024-09-19T09:43:20.628478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":684367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":95285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":93507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":93543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":95029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":93577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":684423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":93417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:45:00.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:45:00.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.619+0000 7fec9e882640 1 Processor -- start 2024-09-19T09:45:00.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.619+0000 7fec9e882640 1 -- start start 2024-09-19T09:45:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.619+0000 7fec9e882640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec980ca550 0x7fec980c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.619+0000 7fec9e882640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980c9ee0 con 0x7fec98155200 2024-09-19T09:45:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.619+0000 7fec9e882640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980ca1c0 con 0x7fec980caeb0 2024-09-19T09:45:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.619+0000 7fec9e882640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fec980cab00 con 0x7fec980ca550 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec977fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec980ca550 0x7fec980c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec977fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec980ca550 0x7fec980c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42136/0 (socket says 172.21.15.123:42136) 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec977fe640 1 -- 172.21.15.123:0/3382375407 learned_addr learned my addr 172.21.15.123:0/3382375407 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec97fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fec98155200 0x7fec980cb580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40226/0 (socket says 172.21.15.123:40226) 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec977fe640 1 -- 172.21.15.123:0/3382375407 >> v1:172.21.15.194:6789/0 conn(0x7fec980caeb0 legacy=0x7fec981658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec977fe640 1 -- 172.21.15.123:0/3382375407 >> v1:172.21.15.123:6789/0 conn(0x7fec98155200 legacy=0x7fec980cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec96ffd640 1 -- 172.21.15.123:0/3382375407 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501328684 0 0) 0x7fec980c9ee0 con 0x7fec98155200 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.620+0000 7fec977fe640 1 -- 172.21.15.123:0/3382375407 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9815b2a0 con 0x7fec980ca550 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec977fe640 1 --2- 172.21.15.123:0/3382375407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980ca550 0x7fec980c4880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fec88009870 tx=0x7fec8802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0aa6906e53790e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec96ffd640 1 -- 172.21.15.123:0/3382375407 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88037070 con 0x7fec980ca550 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec96ffd640 1 -- 172.21.15.123:0/3382375407 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec88032440 con 0x7fec980ca550 2024-09-19T09:45:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec96ffd640 1 -- 172.21.15.123:0/3382375407 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88032810 con 0x7fec980ca550 2024-09-19T09:45:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 -- 172.21.15.123:0/3382375407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980ca550 msgr2=0x7fec980c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 --2- 172.21.15.123:0/3382375407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980ca550 0x7fec980c4880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fec88009870 tx=0x7fec8802a2a0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 -- 172.21.15.123:0/3382375407 shutdown_connections 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 --2- 172.21.15.123:0/3382375407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980ca550 0x7fec980c4880 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 -- 172.21.15.123:0/3382375407 >> 172.21.15.123:0/3382375407 conn(0x7fec98070e90 msgr2=0x7fec980712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 -- 172.21.15.123:0/3382375407 shutdown_connections 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.621+0000 7fec9e882640 1 -- 172.21.15.123:0/3382375407 wait complete. 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.622+0000 7fec9e882640 1 Processor -- start 2024-09-19T09:45:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 -- start start 2024-09-19T09:45:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec980ca550 0x7fec981f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 0x7fec98156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec981f1790 0x7fec981e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec980cbe10 con 0x7fec980caeb0 2024-09-19T09:45:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fec980cbc90 con 0x7fec981f1790 2024-09-19T09:45:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec9e882640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fec9815baa0 con 0x7fec980ca550 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 0x7fec98156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 0x7fec98156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42150/0 (socket says 172.21.15.123:42150) 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.623+0000 7fec977fe640 1 -- 172.21.15.123:0/4035407613 learned_addr learned my addr 172.21.15.123:0/4035407613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec97fff640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec980ca550 0x7fec981f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec9ce1f640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec981f1790 0x7fec981e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec977fe640 1 -- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec980ca550 msgr2=0x7fec981f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec977fe640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec980ca550 0x7fec981f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec977fe640 1 -- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec981f1790 msgr2=0x7fec981e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec977fe640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec981f1790 0x7fec981e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec977fe640 1 -- 172.21.15.123:0/4035407613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec981558e0 con 0x7fec980caeb0 2024-09-19T09:45:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec9ce1f640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec981f1790 0x7fec981e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec97fff640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec980ca550 0x7fec981f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec977fe640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 0x7fec98156c60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec88000c00 tx=0x7fec880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88041070 con 0x7fec980caeb0 2024-09-19T09:45:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8803c870 con 0x7fec980caeb0 2024-09-19T09:45:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec98155bc0 con 0x7fec980caeb0 2024-09-19T09:45:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88037040 con 0x7fec980caeb0 2024-09-19T09:45:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.624+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec98156180 con 0x7fec980caeb0 2024-09-19T09:45:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.625+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9815be00 con 0x7fec980caeb0 2024-09-19T09:45:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.625+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec88044070 con 0x7fec980caeb0 2024-09-19T09:45:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.626+0000 7fec94ff9640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fec7806c2b0 0x7fec7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.626+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fec880abfc0 con 0x7fec980caeb0 2024-09-19T09:45:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.626+0000 7fec97fff640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fec7806c2b0 0x7fec7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.626+0000 7fec97fff640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fec7806c2b0 0x7fec7806e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec80000f60 tx=0x7fec80007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.630+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fec8807a7d0 con 0x7fec980caeb0 2024-09-19T09:45:00.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.794+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec981571a0 con 0x7fec7806c2b0 2024-09-19T09:45:00.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.800+0000 7fec94ff9640 1 -- 172.21.15.123:0/4035407613 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7fec981571a0 con 0x7fec7806c2b0 2024-09-19T09:45:00.807 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:45:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:45:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fec7806c2b0 msgr2=0x7fec7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fec7806c2b0 0x7fec7806e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec80000f60 tx=0x7fec80007ca0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 msgr2=0x7fec98156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 0x7fec98156c60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec88000c00 tx=0x7fec880046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 shutdown_connections 2024-09-19T09:45:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec981f1790 0x7fec981e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec980caeb0 0x7fec98156c60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fec7806c2b0 0x7fec7806e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 --2- 172.21.15.123:0/4035407613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec980ca550 0x7fec981f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 >> 172.21.15.123:0/4035407613 conn(0x7fec98070e90 msgr2=0x7fec980c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 shutdown_connections 2024-09-19T09:45:00.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.803+0000 7fec9e882640 1 -- 172.21.15.123:0/4035407613 wait complete. 2024-09-19T09:45:00.816 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-19T09:45:00.732646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3317760,"data_stored":1933148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629369+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:43:20.629369+0000","last_peered":"2024-09-19T09:43:20.629369+0000","last_clean":"2024-09-19T09:43:20.629369+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:43:20.629369+0000","last_undegraded":"2024-09-19T09:43:20.629369+0000","last_fullsized":"2024-09-19T09:43:20.629369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618749+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:43:20.618749+0000","last_peered":"2024-09-19T09:43:20.618749+0000","last_clean":"2024-09-19T09:43:20.618749+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:43:20.618749+0000","last_undegraded":"2024-09-19T09:43:20.618749+0000","last_fullsized":"2024-09-19T09:43:20.618749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628301+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:43:20.628301+0000","last_peered":"2024-09-19T09:43:20.628301+0000","last_clean":"2024-09-19T09:43:20.628301+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:43:20.628301+0000","last_undegraded":"2024-09-19T09:43:20.628301+0000","last_fullsized":"2024-09-19T09:43:20.628301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628317+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:43:20.628317+0000","last_peered":"2024-09-19T09:43:20.628317+0000","last_clean":"2024-09-19T09:43:20.628317+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:43:20.628317+0000","last_undegraded":"2024-09-19T09:43:20.628317+0000","last_fullsized":"2024-09-19T09:43:20.628317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628809+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:43:20.628809+0000","last_peered":"2024-09-19T09:43:20.628809+0000","last_clean":"2024-09-19T09:43:20.628809+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:43:20.628809+0000","last_undegraded":"2024-09-19T09:43:20.628809+0000","last_fullsized":"2024-09-19T09:43:20.628809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628174+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:43:20.628174+0000","last_peered":"2024-09-19T09:43:20.628174+0000","last_clean":"2024-09-19T09:43:20.628174+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:43:20.628174+0000","last_undegraded":"2024-09-19T09:43:20.628174+0000","last_fullsized":"2024-09-19T09:43:20.628174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628150+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:43:20.628150+0000","last_peered":"2024-09-19T09:43:20.628150+0000","last_clean":"2024-09-19T09:43:20.628150+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:43:20.628150+0000","last_undegraded":"2024-09-19T09:43:20.628150+0000","last_fullsized":"2024-09-19T09:43:20.628150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615597+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:43:20.615597+0000","last_peered":"2024-09-19T09:43:20.615597+0000","last_clean":"2024-09-19T09:43:20.615597+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:43:20.615597+0000","last_undegraded":"2024-09-19T09:43:20.615597+0000","last_fullsized":"2024-09-19T09:43:20.615597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629326+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:43:20.629326+0000","last_peered":"2024-09-19T09:43:20.629326+0000","last_clean":"2024-09-19T09:43:20.629326+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:43:20.629326+0000","last_undegraded":"2024-09-19T09:43:20.629326+0000","last_fullsized":"2024-09-19T09:43:20.629326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616406+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:43:20.616406+0000","last_peered":"2024-09-19T09:43:20.616406+0000","last_clean":"2024-09-19T09:43:20.616406+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:43:20.616406+0000","last_undegraded":"2024-09-19T09:43:20.616406+0000","last_fullsized":"2024-09-19T09:43:20.616406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615708+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:43:20.615708+0000","last_peered":"2024-09-19T09:43:20.615708+0000","last_clean":"2024-09-19T09:43:20.615708+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:43:20.615708+0000","last_undegraded":"2024-09-19T09:43:20.615708+0000","last_fullsized":"2024-09-19T09:43:20.615708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616452+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:43:20.616452+0000","last_peered":"2024-09-19T09:43:20.616452+0000","last_clean":"2024-09-19T09:43:20.616452+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:43:20.616452+0000","last_undegraded":"2024-09-19T09:43:20.616452+0000","last_fullsized":"2024-09-19T09:43:20.616452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616150+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:43:20.616150+0000","last_peered":"2024-09-19T09:43:20.616150+0000","last_clean":"2024-09-19T09:43:20.616150+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:43:20.616150+0000","last_undegraded":"2024-09-19T09:43:20.616150+0000","last_fullsized":"2024-09-19T09:43:20.616150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628091+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:43:20.628091+0000","last_peered":"2024-09-19T09:43:20.628091+0000","last_clean":"2024-09-19T09:43:20.628091+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:43:20.628091+0000","last_undegraded":"2024-09-19T09:43:20.628091+0000","last_fullsized":"2024-09-19T09:43:20.628091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617840+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:43:20.617840+0000","last_peered":"2024-09-19T09:43:20.617840+0000","last_clean":"2024-09-19T09:43:20.617840+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:43:20.617840+0000","last_undegraded":"2024-09-19T09:43:20.617840+0000","last_fullsized":"2024-09-19T09:43:20.617840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628339+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:43:20.628339+0000","last_peered":"2024-09-19T09:43:20.628339+0000","last_clean":"2024-09-19T09:43:20.628339+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:43:20.628339+0000","last_undegraded":"2024-09-19T09:43:20.628339+0000","last_fullsized":"2024-09-19T09:43:20.628339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628960+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:43:20.628960+0000","last_peered":"2024-09-19T09:43:20.628960+0000","last_clean":"2024-09-19T09:43:20.628960+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:43:20.628960+0000","last_undegraded":"2024-09-19T09:43:20.628960+0000","last_fullsized":"2024-09-19T09:43:20.628960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617713+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:43:20.617713+0000","last_peered":"2024-09-19T09:43:20.617713+0000","last_clean":"2024-09-19T09:43:20.617713+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:43:20.617713+0000","last_undegraded":"2024-09-19T09:43:20.617713+0000","last_fullsized":"2024-09-19T09:43:20.617713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628848+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:43:20.628848+0000","last_peered":"2024-09-19T09:43:20.628848+0000","last_clean":"2024-09-19T09:43:20.628848+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:43:20.628848+0000","last_undegraded":"2024-09-19T09:43:20.628848+0000","last_fullsized":"2024-09-19T09:43:20.628848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615991+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:43:20.615991+0000","last_peered":"2024-09-19T09:43:20.615991+0000","last_clean":"2024-09-19T09:43:20.615991+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:43:20.615991+0000","last_undegraded":"2024-09-19T09:43:20.615991+0000","last_fullsized":"2024-09-19T09:43:20.615991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628219+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:43:20.628219+0000","last_peered":"2024-09-19T09:43:20.628219+0000","last_clean":"2024-09-19T09:43:20.628219+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:43:20.628219+0000","last_undegraded":"2024-09-19T09:43:20.628219+0000","last_fullsized":"2024-09-19T09:43:20.628219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628331+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:43:20.628331+0000","last_peered":"2024-09-19T09:43:20.628331+0000","last_clean":"2024-09-19T09:43:20.628331+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:43:20.628331+0000","last_undegraded":"2024-09-19T09:43:20.628331+0000","last_fullsized":"2024-09-19T09:43:20.628331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615837+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:43:20.615837+0000","last_peered":"2024-09-19T09:43:20.615837+0000","last_clean":"2024-09-19T09:43:20.615837+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:43:20.615837+0000","last_undegraded":"2024-09-19T09:43:20.615837+0000","last_fullsized":"2024-09-19T09:43:20.615837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628426+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:43:20.628426+0000","last_peered":"2024-09-19T09:43:20.628426+0000","last_clean":"2024-09-19T09:43:20.628426+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:43:20.628426+0000","last_undegraded":"2024-09-19T09:43:20.628426+0000","last_fullsized":"2024-09-19T09:43:20.628426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616750+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:43:20.616750+0000","last_peered":"2024-09-19T09:43:20.616750+0000","last_clean":"2024-09-19T09:43:20.616750+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:43:20.616750+0000","last_undegraded":"2024-09-19T09:43:20.616750+0000","last_fullsized":"2024-09-19T09:43:20.616750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616538+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:43:20.616538+0000","last_peered":"2024-09-19T09:43:20.616538+0000","last_clean":"2024-09-19T09:43:20.616538+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:43:20.616538+0000","last_undegraded":"2024-09-19T09:43:20.616538+0000","last_fullsized":"2024-09-19T09:43:20.616538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618099+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:43:20.618099+0000","last_peered":"2024-09-19T09:43:20.618099+0000","last_clean":"2024-09-19T09:43:20.618099+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:43:20.618099+0000","last_undegraded":"2024-09-19T09:43:20.618099+0000","last_fullsized":"2024-09-19T09:43:20.618099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616820+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:43:20.616820+0000","last_peered":"2024-09-19T09:43:20.616820+0000","last_clean":"2024-09-19T09:43:20.616820+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:43:20.616820+0000","last_undegraded":"2024-09-19T09:43:20.616820+0000","last_fullsized":"2024-09-19T09:43:20.616820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628305+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:43:20.628305+0000","last_peered":"2024-09-19T09:43:20.628305+0000","last_clean":"2024-09-19T09:43:20.628305+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:43:20.628305+0000","last_undegraded":"2024-09-19T09:43:20.628305+0000","last_fullsized":"2024-09-19T09:43:20.628305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628440+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:43:20.628440+0000","last_peered":"2024-09-19T09:43:20.628440+0000","last_clean":"2024-09-19T09:43:20.628440+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:43:20.628440+0000","last_undegraded":"2024-09-19T09:43:20.628440+0000","last_fullsized":"2024-09-19T09:43:20.628440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617591+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:43:20.617591+0000","last_peered":"2024-09-19T09:43:20.617591+0000","last_clean":"2024-09-19T09:43:20.617591+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:43:20.617591+0000","last_undegraded":"2024-09-19T09:43:20.617591+0000","last_fullsized":"2024-09-19T09:43:20.617591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615608+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:43:20.615608+0000","last_peered":"2024-09-19T09:43:20.615608+0000","last_clean":"2024-09-19T09:43:20.615608+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:43:20.615608+0000","last_undegraded":"2024-09-19T09:43:20.615608+0000","last_fullsized":"2024-09-19T09:43:20.615608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615965+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:43:20.615965+0000","last_peered":"2024-09-19T09:43:20.615965+0000","last_clean":"2024-09-19T09:43:20.615965+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:43:20.615965+0000","last_undegraded":"2024-09-19T09:43:20.615965+0000","last_fullsized":"2024-09-19T09:43:20.615965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616261+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:43:20.616261+0000","last_peered":"2024-09-19T09:43:20.616261+0000","last_clean":"2024-09-19T09:43:20.616261+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:43:20.616261+0000","last_undegraded":"2024-09-19T09:43:20.616261+0000","last_fullsized":"2024-09-19T09:43:20.616261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628314+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:43:20.628314+0000","last_peered":"2024-09-19T09:43:20.628314+0000","last_clean":"2024-09-19T09:43:20.628314+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:43:20.628314+0000","last_undegraded":"2024-09-19T09:43:20.628314+0000","last_fullsized":"2024-09-19T09:43:20.628314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615970+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:43:20.615970+0000","last_peered":"2024-09-19T09:43:20.615970+0000","last_clean":"2024-09-19T09:43:20.615970+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:43:20.615970+0000","last_undegraded":"2024-09-19T09:43:20.615970+0000","last_fullsized":"2024-09-19T09:43:20.615970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615912+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:43:20.615912+0000","last_peered":"2024-09-19T09:43:20.615912+0000","last_clean":"2024-09-19T09:43:20.615912+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:43:20.615912+0000","last_undegraded":"2024-09-19T09:43:20.615912+0000","last_fullsized":"2024-09-19T09:43:20.615912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615675+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:43:20.615675+0000","last_peered":"2024-09-19T09:43:20.615675+0000","last_clean":"2024-09-19T09:43:20.615675+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:43:20.615675+0000","last_undegraded":"2024-09-19T09:43:20.615675+0000","last_fullsized":"2024-09-19T09:43:20.615675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628399+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:43:20.628399+0000","last_peered":"2024-09-19T09:43:20.628399+0000","last_clean":"2024-09-19T09:43:20.628399+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:43:20.628399+0000","last_undegraded":"2024-09-19T09:43:20.628399+0000","last_fullsized":"2024-09-19T09:43:20.628399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617680+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:43:20.617680+0000","last_peered":"2024-09-19T09:43:20.617680+0000","last_clean":"2024-09-19T09:43:20.617680+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:43:20.617680+0000","last_undegraded":"2024-09-19T09:43:20.617680+0000","last_fullsized":"2024-09-19T09:43:20.617680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616177+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:43:20.616177+0000","last_peered":"2024-09-19T09:43:20.616177+0000","last_clean":"2024-09-19T09:43:20.616177+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:43:20.616177+0000","last_undegraded":"2024-09-19T09:43:20.616177+0000","last_fullsized":"2024-09-19T09:43:20.616177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629156+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:43:20.629156+0000","last_peered":"2024-09-19T09:43:20.629156+0000","last_clean":"2024-09-19T09:43:20.629156+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:43:20.629156+0000","last_undegraded":"2024-09-19T09:43:20.629156+0000","last_fullsized":"2024-09-19T09:43:20.629156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629204+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:43:20.629204+0000","last_peered":"2024-09-19T09:43:20.629204+0000","last_clean":"2024-09-19T09:43:20.629204+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:43:20.629204+0000","last_undegraded":"2024-09-19T09:43:20.629204+0000","last_fullsized":"2024-09-19T09:43:20.629204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628375+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:43:20.628375+0000","last_peered":"2024-09-19T09:43:20.628375+0000","last_clean":"2024-09-19T09:43:20.628375+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:43:20.628375+0000","last_undegraded":"2024-09-19T09:43:20.628375+0000","last_fullsized":"2024-09-19T09:43:20.628375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618175+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:43:20.618175+0000","last_peered":"2024-09-19T09:43:20.618175+0000","last_clean":"2024-09-19T09:43:20.618175+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:43:20.618175+0000","last_undegraded":"2024-09-19T09:43:20.618175+0000","last_fullsized":"2024-09-19T09:43:20.618175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616569+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:43:20.616569+0000","last_peered":"2024-09-19T09:43:20.616569+0000","last_clean":"2024-09-19T09:43:20.616569+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:43:20.616569+0000","last_undegraded":"2024-09-19T09:43:20.616569+0000","last_fullsized":"2024-09-19T09:43:20.616569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:44:57.635142+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:44:57.635142+0000","last_peered":"2024-09-19T09:44:57.635142+0000","last_clean":"2024-09-19T09:44:57.635142+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:44:57.635142+0000","last_undegraded":"2024-09-19T09:44:57.635142+0000","last_fullsized":"2024-09-19T09:44:57.635142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628508+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:43:20.628508+0000","last_peered":"2024-09-19T09:43:20.628508+0000","last_clean":"2024-09-19T09:43:20.628508+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:43:20.628508+0000","last_undegraded":"2024-09-19T09:43:20.628508+0000","last_fullsized":"2024-09-19T09:43:20.628508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628411+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:43:20.628411+0000","last_peered":"2024-09-19T09:43:20.628411+0000","last_clean":"2024-09-19T09:43:20.628411+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:43:20.628411+0000","last_undegraded":"2024-09-19T09:43:20.628411+0000","last_fullsized":"2024-09-19T09:43:20.628411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628178+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:43:20.628178+0000","last_peered":"2024-09-19T09:43:20.628178+0000","last_clean":"2024-09-19T09:43:20.628178+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:43:20.628178+0000","last_undegraded":"2024-09-19T09:43:20.628178+0000","last_fullsized":"2024-09-19T09:43:20.628178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628955+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:43:20.628955+0000","last_peered":"2024-09-19T09:43:20.628955+0000","last_clean":"2024-09-19T09:43:20.628955+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:43:20.628955+0000","last_undegraded":"2024-09-19T09:43:20.628955+0000","last_fullsized":"2024-09-19T09:43:20.628955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628957+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:43:20.628957+0000","last_peered":"2024-09-19T09:43:20.628957+0000","last_clean":"2024-09-19T09:43:20.628957+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:43:20.628957+0000","last_undegraded":"2024-09-19T09:43:20.628957+0000","last_fullsized":"2024-09-19T09:43:20.628957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615794+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:43:20.615794+0000","last_peered":"2024-09-19T09:43:20.615794+0000","last_clean":"2024-09-19T09:43:20.615794+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:43:20.615794+0000","last_undegraded":"2024-09-19T09:43:20.615794+0000","last_fullsized":"2024-09-19T09:43:20.615794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615713+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:43:20.615713+0000","last_peered":"2024-09-19T09:43:20.615713+0000","last_clean":"2024-09-19T09:43:20.615713+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:43:20.615713+0000","last_undegraded":"2024-09-19T09:43:20.615713+0000","last_fullsized":"2024-09-19T09:43:20.615713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617775+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:43:20.617775+0000","last_peered":"2024-09-19T09:43:20.617775+0000","last_clean":"2024-09-19T09:43:20.617775+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:43:20.617775+0000","last_undegraded":"2024-09-19T09:43:20.617775+0000","last_fullsized":"2024-09-19T09:43:20.617775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628315+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:43:20.628315+0000","last_peered":"2024-09-19T09:43:20.628315+0000","last_clean":"2024-09-19T09:43:20.628315+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:43:20.628315+0000","last_undegraded":"2024-09-19T09:43:20.628315+0000","last_fullsized":"2024-09-19T09:43:20.628315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616564+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:43:20.616564+0000","last_peered":"2024-09-19T09:43:20.616564+0000","last_clean":"2024-09-19T09:43:20.616564+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:43:20.616564+0000","last_undegraded":"2024-09-19T09:43:20.616564+0000","last_fullsized":"2024-09-19T09:43:20.616564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.623189+0000","last_change":"2024-09-19T09:43:20.619746+0000","last_active":"2024-09-19T09:43:20.623189+0000","last_peered":"2024-09-19T09:43:20.623189+0000","last_clean":"2024-09-19T09:43:20.623189+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:43:20.623189+0000","last_undegraded":"2024-09-19T09:43:20.623189+0000","last_fullsized":"2024-09-19T09:43:20.623189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:39.025798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617755+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:43:20.617755+0000","last_peered":"2024-09-19T09:43:20.617755+0000","last_clean":"2024-09-19T09:43:20.617755+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:43:20.617755+0000","last_undegraded":"2024-09-19T09:43:20.617755+0000","last_fullsized":"2024-09-19T09:43:20.617755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629450+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:43:20.629450+0000","last_peered":"2024-09-19T09:43:20.629450+0000","last_clean":"2024-09-19T09:43:20.629450+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:43:20.629450+0000","last_undegraded":"2024-09-19T09:43:20.629450+0000","last_fullsized":"2024-09-19T09:43:20.629450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618442+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:43:20.618442+0000","last_peered":"2024-09-19T09:43:20.618442+0000","last_clean":"2024-09-19T09:43:20.618442+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:43:20.618442+0000","last_undegraded":"2024-09-19T09:43:20.618442+0000","last_fullsized":"2024-09-19T09:43:20.618442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.622491+0000","last_change":"2024-09-19T09:43:20.619216+0000","last_active":"2024-09-19T09:43:20.622491+0000","last_peered":"2024-09-19T09:43:20.622491+0000","last_clean":"2024-09-19T09:43:20.622491+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:43:20.622491+0000","last_undegraded":"2024-09-19T09:43:20.622491+0000","last_fullsized":"2024-09-19T09:43:20.622491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:14.168619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617868+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:43:20.617868+0000","last_peered":"2024-09-19T09:43:20.617868+0000","last_clean":"2024-09-19T09:43:20.617868+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:43:20.617868+0000","last_undegraded":"2024-09-19T09:43:20.617868+0000","last_fullsized":"2024-09-19T09:43:20.617868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628648+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:43:20.628648+0000","last_peered":"2024-09-19T09:43:20.628648+0000","last_clean":"2024-09-19T09:43:20.628648+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:43:20.628648+0000","last_undegraded":"2024-09-19T09:43:20.628648+0000","last_fullsized":"2024-09-19T09:43:20.628648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628275+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:43:20.628275+0000","last_peered":"2024-09-19T09:43:20.628275+0000","last_clean":"2024-09-19T09:43:20.628275+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:43:20.628275+0000","last_undegraded":"2024-09-19T09:43:20.628275+0000","last_fullsized":"2024-09-19T09:43:20.628275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628645+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:43:20.628645+0000","last_peered":"2024-09-19T09:43:20.628645+0000","last_clean":"2024-09-19T09:43:20.628645+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:43:20.628645+0000","last_undegraded":"2024-09-19T09:43:20.628645+0000","last_fullsized":"2024-09-19T09:43:20.628645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616042+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:43:20.616042+0000","last_peered":"2024-09-19T09:43:20.616042+0000","last_clean":"2024-09-19T09:43:20.616042+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:43:20.616042+0000","last_undegraded":"2024-09-19T09:43:20.616042+0000","last_fullsized":"2024-09-19T09:43:20.616042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628150+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:43:20.628150+0000","last_peered":"2024-09-19T09:43:20.628150+0000","last_clean":"2024-09-19T09:43:20.628150+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:43:20.628150+0000","last_undegraded":"2024-09-19T09:43:20.628150+0000","last_fullsized":"2024-09-19T09:43:20.628150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628079+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:43:20.628079+0000","last_peered":"2024-09-19T09:43:20.628079+0000","last_clean":"2024-09-19T09:43:20.628079+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:43:20.628079+0000","last_undegraded":"2024-09-19T09:43:20.628079+0000","last_fullsized":"2024-09-19T09:43:20.628079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617681+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:43:20.617681+0000","last_peered":"2024-09-19T09:43:20.617681+0000","last_clean":"2024-09-19T09:43:20.617681+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:43:20.617681+0000","last_undegraded":"2024-09-19T09:43:20.617681+0000","last_fullsized":"2024-09-19T09:43:20.617681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617955+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:43:20.617955+0000","last_peered":"2024-09-19T09:43:20.617955+0000","last_clean":"2024-09-19T09:43:20.617955+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:43:20.617955+0000","last_undegraded":"2024-09-19T09:43:20.617955+0000","last_fullsized":"2024-09-19T09:43:20.617955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629145+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:43:20.629145+0000","last_peered":"2024-09-19T09:43:20.629145+0000","last_clean":"2024-09-19T09:43:20.629145+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:43:20.629145+0000","last_undegraded":"2024-09-19T09:43:20.629145+0000","last_fullsized":"2024-09-19T09:43:20.629145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616505+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:43:20.616505+0000","last_peered":"2024-09-19T09:43:20.616505+0000","last_clean":"2024-09-19T09:43:20.616505+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:43:20.616505+0000","last_undegraded":"2024-09-19T09:43:20.616505+0000","last_fullsized":"2024-09-19T09:43:20.616505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618185+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:43:20.618185+0000","last_peered":"2024-09-19T09:43:20.618185+0000","last_clean":"2024-09-19T09:43:20.618185+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:43:20.618185+0000","last_undegraded":"2024-09-19T09:43:20.618185+0000","last_fullsized":"2024-09-19T09:43:20.618185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628752+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:43:20.628752+0000","last_peered":"2024-09-19T09:43:20.628752+0000","last_clean":"2024-09-19T09:43:20.628752+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:43:20.628752+0000","last_undegraded":"2024-09-19T09:43:20.628752+0000","last_fullsized":"2024-09-19T09:43:20.628752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628946+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:43:20.628946+0000","last_peered":"2024-09-19T09:43:20.628946+0000","last_clean":"2024-09-19T09:43:20.628946+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:43:20.628946+0000","last_undegraded":"2024-09-19T09:43:20.628946+0000","last_fullsized":"2024-09-19T09:43:20.628946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618060+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:43:20.618060+0000","last_peered":"2024-09-19T09:43:20.618060+0000","last_clean":"2024-09-19T09:43:20.618060+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:43:20.618060+0000","last_undegraded":"2024-09-19T09:43:20.618060+0000","last_fullsized":"2024-09-19T09:43:20.618060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618814+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:43:20.618814+0000","last_peered":"2024-09-19T09:43:20.618814+0000","last_clean":"2024-09-19T09:43:20.618814+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:43:20.618814+0000","last_undegraded":"2024-09-19T09:43:20.618814+0000","last_fullsized":"2024-09-19T09:43:20.618814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616737+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:43:20.616737+0000","last_peered":"2024-09-19T09:43:20.616737+0000","last_clean":"2024-09-19T09:43:20.616737+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:43:20.616737+0000","last_undegraded":"2024-09-19T09:43:20.616737+0000","last_fullsized":"2024-09-19T09:43:20.616737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616319+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:43:20.616319+0000","last_peered":"2024-09-19T09:43:20.616319+0000","last_clean":"2024-09-19T09:43:20.616319+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:43:20.616319+0000","last_undegraded":"2024-09-19T09:43:20.616319+0000","last_fullsized":"2024-09-19T09:43:20.616319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628398+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:43:20.628398+0000","last_peered":"2024-09-19T09:43:20.628398+0000","last_clean":"2024-09-19T09:43:20.628398+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:43:20.628398+0000","last_undegraded":"2024-09-19T09:43:20.628398+0000","last_fullsized":"2024-09-19T09:43:20.628398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628098+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:43:20.628098+0000","last_peered":"2024-09-19T09:43:20.628098+0000","last_clean":"2024-09-19T09:43:20.628098+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:43:20.628098+0000","last_undegraded":"2024-09-19T09:43:20.628098+0000","last_fullsized":"2024-09-19T09:43:20.628098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616547+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:43:20.616547+0000","last_peered":"2024-09-19T09:43:20.616547+0000","last_clean":"2024-09-19T09:43:20.616547+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:43:20.616547+0000","last_undegraded":"2024-09-19T09:43:20.616547+0000","last_fullsized":"2024-09-19T09:43:20.616547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.617961+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:43:20.617961+0000","last_peered":"2024-09-19T09:43:20.617961+0000","last_clean":"2024-09-19T09:43:20.617961+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:43:20.617961+0000","last_undegraded":"2024-09-19T09:43:20.617961+0000","last_fullsized":"2024-09-19T09:43:20.617961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.625330+0000","last_change":"2024-09-19T09:43:20.620289+0000","last_active":"2024-09-19T09:43:20.625330+0000","last_peered":"2024-09-19T09:43:20.625330+0000","last_clean":"2024-09-19T09:43:20.625330+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:43:20.625330+0000","last_undegraded":"2024-09-19T09:43:20.625330+0000","last_fullsized":"2024-09-19T09:43:20.625330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:36.817715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.618423+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:43:20.618423+0000","last_peered":"2024-09-19T09:43:20.618423+0000","last_clean":"2024-09-19T09:43:20.618423+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:43:20.618423+0000","last_undegraded":"2024-09-19T09:43:20.618423+0000","last_fullsized":"2024-09-19T09:43:20.618423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616284+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:43:20.616284+0000","last_peered":"2024-09-19T09:43:20.616284+0000","last_clean":"2024-09-19T09:43:20.616284+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:43:20.616284+0000","last_undegraded":"2024-09-19T09:43:20.616284+0000","last_fullsized":"2024-09-19T09:43:20.616284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.629070+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:43:20.629070+0000","last_peered":"2024-09-19T09:43:20.629070+0000","last_clean":"2024-09-19T09:43:20.629070+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:43:20.629070+0000","last_undegraded":"2024-09-19T09:43:20.629070+0000","last_fullsized":"2024-09-19T09:43:20.629070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.615921+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:43:20.615921+0000","last_peered":"2024-09-19T09:43:20.615921+0000","last_clean":"2024-09-19T09:43:20.615921+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:43:20.615921+0000","last_undegraded":"2024-09-19T09:43:20.615921+0000","last_fullsized":"2024-09-19T09:43:20.615921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.625338+0000","last_change":"2024-09-19T09:43:20.620403+0000","last_active":"2024-09-19T09:43:20.625338+0000","last_peered":"2024-09-19T09:43:20.625338+0000","last_clean":"2024-09-19T09:43:20.625338+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:43:20.625338+0000","last_undegraded":"2024-09-19T09:43:20.625338+0000","last_fullsized":"2024-09-19T09:43:20.625338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:34.693485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628392+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:43:20.628392+0000","last_peered":"2024-09-19T09:43:20.628392+0000","last_clean":"2024-09-19T09:43:20.628392+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:43:20.628392+0000","last_undegraded":"2024-09-19T09:43:20.628392+0000","last_fullsized":"2024-09-19T09:43:20.628392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628376+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:43:20.628376+0000","last_peered":"2024-09-19T09:43:20.628376+0000","last_clean":"2024-09-19T09:43:20.628376+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:43:20.628376+0000","last_undegraded":"2024-09-19T09:43:20.628376+0000","last_fullsized":"2024-09-19T09:43:20.628376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628702+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:43:20.628702+0000","last_peered":"2024-09-19T09:43:20.628702+0000","last_clean":"2024-09-19T09:43:20.628702+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:43:20.628702+0000","last_undegraded":"2024-09-19T09:43:20.628702+0000","last_fullsized":"2024-09-19T09:43:20.628702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628415+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:43:20.628415+0000","last_peered":"2024-09-19T09:43:20.628415+0000","last_clean":"2024-09-19T09:43:20.628415+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:43:20.628415+0000","last_undegraded":"2024-09-19T09:43:20.628415+0000","last_fullsized":"2024-09-19T09:43:20.628415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616718+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:43:20.616718+0000","last_peered":"2024-09-19T09:43:20.616718+0000","last_clean":"2024-09-19T09:43:20.616718+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:43:20.616718+0000","last_undegraded":"2024-09-19T09:43:20.616718+0000","last_fullsized":"2024-09-19T09:43:20.616718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.616575+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:43:20.616575+0000","last_peered":"2024-09-19T09:43:20.616575+0000","last_clean":"2024-09-19T09:43:20.616575+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:43:20.616575+0000","last_undegraded":"2024-09-19T09:43:20.616575+0000","last_fullsized":"2024-09-19T09:43:20.616575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:43:20.628478+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:43:20.628478+0000","last_peered":"2024-09-19T09:43:20.628478+0000","last_clean":"2024-09-19T09:43:20.628478+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:43:20.628478+0000","last_undegraded":"2024-09-19T09:43:20.628478+0000","last_fullsized":"2024-09-19T09:43:20.628478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":684367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":95285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":93507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":93543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":95029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":93577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":684423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":93417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:45:00.820 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-19T09:45:00.820 DEBUG:tasks.mon_thrash:Yielding 2024-09-19T09:45:00.820 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:45:00.833 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:45:00.834 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:45:00.834 INFO:tasks.workunit:timeout=3h 2024-09-19T09:45:00.834 INFO:tasks.workunit:cleanup=True 2024-09-19T09:45:00.834 DEBUG:teuthology.orchestra.run.smithi123:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:45:00.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:45:00.873 INFO:teuthology.orchestra.run.smithi123.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:45:00.873 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:45:00.873 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-19T09:45:00.873 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:45:00.873 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:45:00.873 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T09:45:00.874 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-19 09:42:42.509179693 +0000 2024-09-19T09:45:00.874 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-19 09:44:57.661491707 +0000 2024-09-19T09:45:00.874 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-19 09:42:42.509179693 +0000 2024-09-19T09:45:00.874 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:45:00.874 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:45:00.946 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:45:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.958+0000 7f1feb59e640 1 Processor -- start 2024-09-19T09:45:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.958+0000 7f1feb59e640 1 -- start start 2024-09-19T09:45:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1feb59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fec155210 0x7f1fec0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1feb59e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec15b1c0 con 0x7f1fec06cc20 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1feb59e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec070980 con 0x7f1fec155210 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1feb59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec15b460 con 0x7f1fec15edb0 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1fea59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fec155210 0x7f1fec0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1fe9d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1fec06cc20 0x7f1fec15e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40232/0 (socket says 172.21.15.123:40232) 2024-09-19T09:45:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.959+0000 7f1fe9d9b640 1 -- 172.21.15.123:0/1377203054 learned_addr learned my addr 172.21.15.123:0/1377203054 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fea59c640 1 -- 172.21.15.123:0/1377203054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 msgr2=0x7f1fec06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fead9d640 1 --2- 172.21.15.123:0/1377203054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fe959a640 1 -- 172.21.15.123:0/1377203054 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861703030 0 0) 0x7f1fec15b1c0 con 0x7f1fec06cc20 2024-09-19T09:45:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fea59c640 1 --2- 172.21.15.123:0/1377203054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fea59c640 1 -- 172.21.15.123:0/1377203054 >> v1:172.21.15.123:6789/0 conn(0x7f1fec06cc20 legacy=0x7f1fec15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fea59c640 1 -- 172.21.15.123:0/1377203054 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec15b740 con 0x7f1fec155210 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.960+0000 7f1fea59c640 1 --2- 172.21.15.123:0/1377203054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec0c8c90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009d90 tx=0x7f1fe402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e2f6fc84014fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1fe959a640 1 -- 172.21.15.123:0/1377203054 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4007740 con 0x7f1fec155210 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1fe959a640 1 -- 172.21.15.123:0/1377203054 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe40078e0 con 0x7f1fec155210 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1fe959a640 1 -- 172.21.15.123:0/1377203054 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4007cb0 con 0x7f1fec155210 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 -- 172.21.15.123:0/1377203054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 msgr2=0x7f1fec0c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 --2- 172.21.15.123:0/1377203054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec0c8c90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009d90 tx=0x7f1fe402a660 comp rx=0 tx=0).stop 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 -- 172.21.15.123:0/1377203054 shutdown_connections 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 --2- 172.21.15.123:0/1377203054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 --2- 172.21.15.123:0/1377203054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec0c8c90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 -- 172.21.15.123:0/1377203054 >> 172.21.15.123:0/1377203054 conn(0x7f1fec06fad0 msgr2=0x7f1fec06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 -- 172.21.15.123:0/1377203054 shutdown_connections 2024-09-19T09:45:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.961+0000 7f1feb59e640 1 -- 172.21.15.123:0/1377203054 wait complete. 2024-09-19T09:45:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 Processor -- start 2024-09-19T09:45:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 -- start start 2024-09-19T09:45:00.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec06cc20 0x7f1fec1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0ce6d0 con 0x7f1fec155210 2024-09-19T09:45:00.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec15bd00 con 0x7f1fec06cc20 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.963+0000 7f1feb59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0cb680 con 0x7f1fec15edb0 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42166/0 (socket says 172.21.15.123:42166) 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 -- 172.21.15.123:0/3241000408 learned_addr learned my addr 172.21.15.123:0/3241000408 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fea59c640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec06cc20 0x7f1fec1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fead9d640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 -- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 msgr2=0x7f1fec156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 -- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec06cc20 msgr2=0x7f1fec1571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:00.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec06cc20 0x7f1fec1571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 -- 172.21.15.123:0/3241000408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec157700 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fead9d640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fea59c640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec06cc20 0x7f1fec1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe9d9b640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec155b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c430 tx=0x7f1fd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40074e0 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd40047e0 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec158790 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4004bd0 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.964+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec15c170 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.965+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec0705f0 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.966+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1fd4011070 con 0x7f1fec155210 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.966+0000 7f1fe2ffd640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1fcc06c2b0 0x7f1fcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:00.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.966+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1fd408b110 con 0x7f1fec155210 2024-09-19T09:45:00.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.966+0000 7f1fea59c640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1fcc06c2b0 0x7f1fcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:00.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.967+0000 7f1fea59c640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1fcc06c2b0 0x7f1fcc06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4034000 tx=0x7f1fe402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:00.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:00.971+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1fd4059810 con 0x7f1fec155210 2024-09-19T09:45:00.976 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:45:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.178+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fec0cbef0 con 0x7f1fec155210 2024-09-19T09:45:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.179+0000 7f1fe2ffd640 1 -- 172.21.15.123:0/3241000408 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f1fd4059110 con 0x7f1fec155210 2024-09-19T09:45:01.181 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:45:01.181 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:45:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1fcc06c2b0 msgr2=0x7f1fcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1fcc06c2b0 0x7f1fcc06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4034000 tx=0x7f1fe402f000 comp rx=0 tx=0).stop 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 msgr2=0x7f1fec155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec155b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c430 tx=0x7f1fd400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 shutdown_connections 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1fcc06c2b0 0x7f1fcc06e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec15edb0 0x7f1fec156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fec155210 0x7f1fec155b10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 --2- 172.21.15.123:0/3241000408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec06cc20 0x7f1fec1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 >> 172.21.15.123:0/3241000408 conn(0x7f1fec06fad0 msgr2=0x7f1fec072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 shutdown_connections 2024-09-19T09:45:01.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.181+0000 7f1feb59e640 1 -- 172.21.15.123:0/3241000408 wait complete. 2024-09-19T09:45:01.194 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-19T09:45:01.194 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726739100, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-19T09:45:01.195 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:45:01.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.332+0000 7fef3fe5e640 1 Processor -- start 2024-09-19T09:45:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.332+0000 7fef3fe5e640 1 -- start start 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3fe5e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef38155270 0x7fef38072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3fe5e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3815b300 con 0x7fef380cc000 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3fe5e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3815b5e0 con 0x7fef38155650 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3fe5e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fef3815b8c0 con 0x7fef38155270 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3dbfa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef38155270 0x7fef38072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3e3fb640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef380cc000 0x7fef3815e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40236/0 (socket says 172.21.15.123:40236) 2024-09-19T09:45:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3e3fb640 1 -- 172.21.15.123:0/1773164071 learned_addr learned my addr 172.21.15.123:0/1773164071 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:01.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3dbfa640 1 -- 172.21.15.123:0/1773164071 >> v1:172.21.15.194:6789/0 conn(0x7fef38155650 legacy=0x7fef38073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3dbfa640 1 -- 172.21.15.123:0/1773164071 >> v1:172.21.15.123:6789/0 conn(0x7fef380cc000 legacy=0x7fef3815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.333+0000 7fef3dbfa640 1 -- 172.21.15.123:0/1773164071 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3815bba0 con 0x7fef38155270 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.334+0000 7fef3dbfa640 1 --2- 172.21.15.123:0/1773164071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155270 0x7fef38072230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef280097a0 tx=0x7fef2802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84e618b629665a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.334+0000 7fef3cbf8640 1 -- 172.21.15.123:0/1773164071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28037070 con 0x7fef38155270 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.334+0000 7fef3cbf8640 1 -- 172.21.15.123:0/1773164071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2802ad60 con 0x7fef38155270 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.334+0000 7fef3cbf8640 1 -- 172.21.15.123:0/1773164071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28032660 con 0x7fef38155270 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 -- 172.21.15.123:0/1773164071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155270 msgr2=0x7fef38072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/1773164071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155270 0x7fef38072230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef280097a0 tx=0x7fef2802a0d0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 -- 172.21.15.123:0/1773164071 shutdown_connections 2024-09-19T09:45:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/1773164071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155270 0x7fef38072230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 -- 172.21.15.123:0/1773164071 >> 172.21.15.123:0/1773164071 conn(0x7fef3806c9e0 msgr2=0x7fef3806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 -- 172.21.15.123:0/1773164071 shutdown_connections 2024-09-19T09:45:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.335+0000 7fef3fe5e640 1 -- 172.21.15.123:0/1773164071 wait complete. 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.336+0000 7fef3fe5e640 1 Processor -- start 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.336+0000 7fef3fe5e640 1 -- start start 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3fe5e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef380cc000 0x7fef380c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3fe5e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef38155270 0x7fef3815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3fe5e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 0x7fef380c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3fe5e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef38074020 con 0x7fef38155650 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3fe5e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fef38073ea0 con 0x7fef38155270 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3fe5e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fef380737a0 con 0x7fef380cc000 2024-09-19T09:45:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 0x7fef380c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 0x7fef380c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42196/0 (socket says 172.21.15.123:42196) 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 -- 172.21.15.123:0/2994848833 learned_addr learned my addr 172.21.15.123:0/2994848833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3dbfa640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef380cc000 0x7fef380c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3d3f9640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef38155270 0x7fef3815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 -- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef380cc000 msgr2=0x7fef380c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef380cc000 0x7fef380c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 -- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef38155270 msgr2=0x7fef3815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef38155270 0x7fef3815ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 -- 172.21.15.123:0/2994848833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3815dbb0 con 0x7fef38155650 2024-09-19T09:45:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.337+0000 7fef3e3fb640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 0x7fef380c9b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef3000caf0 tx=0x7fef300020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.338+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30018070 con 0x7fef38155650 2024-09-19T09:45:01.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.338+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3000a6e0 con 0x7fef38155650 2024-09-19T09:45:01.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.338+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3814fc10 con 0x7fef38155650 2024-09-19T09:45:01.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.338+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3000ab10 con 0x7fef38155650 2024-09-19T09:45:01.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.338+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3815e150 con 0x7fef38155650 2024-09-19T09:45:01.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.339+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3815e530 con 0x7fef38155650 2024-09-19T09:45:01.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.339+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef3001b070 con 0x7fef38155650 2024-09-19T09:45:01.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.340+0000 7fef367fc640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef2406c2b0 0x7fef2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.340+0000 7fef3dbfa640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef2406c2b0 0x7fef2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.340+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fef3008ab40 con 0x7fef38155650 2024-09-19T09:45:01.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.340+0000 7fef3dbfa640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef2406c2b0 0x7fef2406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef28034000 tx=0x7fef2802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.344+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fef3815e530 con 0x7fef38155650 2024-09-19T09:45:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.620+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef38072230 con 0x7fef38155650 2024-09-19T09:45:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.621+0000 7fef367fc640 1 -- 172.21.15.123:0/2994848833 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fef30058c70 con 0x7fef38155650 2024-09-19T09:45:01.625 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":166,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef2406c2b0 msgr2=0x7fef2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef2406c2b0 0x7fef2406e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef28034000 tx=0x7fef2802e000 comp rx=0 tx=0).stop 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 msgr2=0x7fef380c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 0x7fef380c9b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef3000caf0 tx=0x7fef300020b0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 shutdown_connections 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef38155650 0x7fef380c9b80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef38155270 0x7fef3815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef2406c2b0 0x7fef2406e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 --2- 172.21.15.123:0/2994848833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef380cc000 0x7fef380c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 >> 172.21.15.123:0/2994848833 conn(0x7fef3806c9e0 msgr2=0x7fef380cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 shutdown_connections 2024-09-19T09:45:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.623+0000 7fef3fe5e640 1 -- 172.21.15.123:0/2994848833 wait complete. 2024-09-19T09:45:01.635 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:45:01.635 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:45:01.635 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:45:01.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:45:01.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:45:01.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:45:01.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.737+0000 7fcf4b731640 1 Processor -- start 2024-09-19T09:45:01.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.737+0000 7fcf4b731640 1 -- start start 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf4b731640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf44153160 0x7fcf440caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf4b731640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 0x7fcf4406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf4b731640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf440cb530 con 0x7fcf4415c460 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf4b731640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fcf440ca880 con 0x7fcf44153160 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf4b731640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcf44153540 con 0x7fcf440c3bd0 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf49cce640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcf4415c460 0x7fcf440731d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40240/0 (socket says 172.21.15.123:40240) 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf49cce640 1 -- 172.21.15.123:0/2224896177 learned_addr learned my addr 172.21.15.123:0/2224896177 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf48ccc640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 0x7fcf4406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf494cd640 1 --2- 172.21.15.123:0/2224896177 >> v2:172.21.15.194:3300/0 conn(0x7fcf44153160 0x7fcf440caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601315104 0 0) 0x7fcf440cb530 con 0x7fcf4415c460 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.738+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30003520 con 0x7fcf4415c460 2024-09-19T09:45:01.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 886369598 0 0) 0x7fcf30003520 con 0x7fcf4415c460 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 msgr2=0x7fcf4406f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 0x7fcf4406f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 >> v2:172.21.15.194:3300/0 conn(0x7fcf44153160 msgr2=0x7fcf440caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 --2- 172.21.15.123:0/2224896177 >> v2:172.21.15.194:3300/0 conn(0x7fcf44153160 0x7fcf440caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4406ecd0 con 0x7fcf4415c460 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fcf3c0019f0 con 0x7fcf4415c460 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 >> v1:172.21.15.123:6789/0 conn(0x7fcf4415c460 legacy=0x7fcf440731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 0x7fcf300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf30003f30 0x7fcf30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf30004d40 0x7fcf300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf440ca880 con 0x7fcf30004d40 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf44153540 con 0x7fcf30003f30 2024-09-19T09:45:01.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3000b9c0 con 0x7fcf440c3bd0 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf49cce640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf30004d40 0x7fcf300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf494cd640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 0x7fcf300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf48ccc640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf30003f30 0x7fcf30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf49cce640 1 -- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 msgr2=0x7fcf300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf49cce640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf440c3bd0 0x7fcf300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf49cce640 1 -- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf30003f30 msgr2=0x7fcf30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf49cce640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf30003f30 0x7fcf30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.739+0000 7fcf49cce640 1 -- 172.21.15.123:0/2224896177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf30003520 con 0x7fcf30004d40 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf49cce640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf30004d40 0x7fcf300051c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00a850 tx=0x7fcf30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d8475abf0896b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00a4a0 con 0x7fcf30004d40 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c02f070 con 0x7fcf30004d40 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf37fff640 1 -- 172.21.15.123:0/2224896177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c02bcb0 con 0x7fcf30004d40 2024-09-19T09:45:01.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf4b731640 1 -- 172.21.15.123:0/2224896177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf30004d40 msgr2=0x7fcf300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf4b731640 1 --2- 172.21.15.123:0/2224896177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf30004d40 0x7fcf300051c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00a850 tx=0x7fcf30005830 comp rx=0 tx=0).stop 2024-09-19T09:45:01.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf49cce640 1 -- 172.21.15.123:0/2224896177 reap_dead start 2024-09-19T09:45:01.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf4b731640 1 -- 172.21.15.123:0/2224896177 shutdown_connections 2024-09-19T09:45:01.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.740+0000 7fcf4b731640 1 -- 172.21.15.123:0/2224896177 >> 172.21.15.123:0/2224896177 conn(0x7fcf440713d0 msgr2=0x7fcf440cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.741+0000 7fcf4b731640 1 -- 172.21.15.123:0/2224896177 shutdown_connections 2024-09-19T09:45:01.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.741+0000 7fcf4b731640 1 -- 172.21.15.123:0/2224896177 wait complete. 2024-09-19T09:45:01.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.742+0000 7fcf4b731640 1 Processor -- start 2024-09-19T09:45:01.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.742+0000 7fcf4b731640 1 -- start start 2024-09-19T09:45:01.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf30004d40 0x7fcf440c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf441f1a10 0x7fcf440cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 0x7fcf441f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4406e580 con 0x7fcf4406c890 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4406e2a0 con 0x7fcf441f1a10 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcf440caad0 con 0x7fcf30004d40 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 0x7fcf441f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 0x7fcf441f4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42206/0 (socket says 172.21.15.123:42206) 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 -- 172.21.15.123:0/3774585015 learned_addr learned my addr 172.21.15.123:0/3774585015 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf494cd640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf30004d40 0x7fcf440c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf48ccc640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf441f1a10 0x7fcf440cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf30004d40 msgr2=0x7fcf440c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf30004d40 0x7fcf440c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf441f1a10 msgr2=0x7fcf440cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf441f1a10 0x7fcf440cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4406d340 con 0x7fcf4406c890 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf49cce640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 0x7fcf441f4530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00a970 tx=0x7fcf44158e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00a4a0 con 0x7fcf4406c890 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c004b60 con 0x7fcf4406c890 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf44150070 con 0x7fcf4406c890 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c001ff0 con 0x7fcf4406c890 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.743+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4406bdb0 con 0x7fcf4406c890 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.744+0000 7fcf4b731640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 0x7fcf441f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.744+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4406bc10 con 0x7fcf4406cd10 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.744+0000 7fcf494cd640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 0x7fcf441f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.745+0000 7fcf494cd640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf44069150 con 0x7fcf4406cd10 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.745+0000 7fcf494cd640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 0x7fcf441f4a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf40014ae0 tx=0x7fcf40012330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.745+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40022070 con 0x7fcf4406cd10 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.745+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf3c034470 con 0x7fcf4406c890 2024-09-19T09:45:01.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.745+0000 7fcf35ffb640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcf2806c1b0 0x7fcf2806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.745+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fcf3c0ab6f0 con 0x7fcf4406c890 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf48ccc640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcf2806c1b0 0x7fcf2806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcf40012e40 con 0x7fcf4406cd10 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 msgr2=0x7fcf441f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf35ffb640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 0x7fcf441f4a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf40014ae0 tx=0x7fcf40012330 comp rx=0 tx=0).stop 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 msgr2=0x7fcf441f4a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf35ffb640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406cd10 0x7fcf441f4a70 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf40014ae0 tx=0x7fcf40012330 comp rx=0 tx=0).stop 2024-09-19T09:45:01.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.746+0000 7fcf48ccc640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcf2806c1b0 0x7fcf2806e670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf44150550 tx=0x7fcf38009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf4b731640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 0x7fcf4414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf441f53c0 con 0x7fcf441f4fb0 2024-09-19T09:45:01.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf494cd640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 0x7fcf4414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf494cd640 1 -- 172.21.15.123:0/3774585015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcf440c9f90 con 0x7fcf441f4fb0 2024-09-19T09:45:01.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf494cd640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 0x7fcf4414bb50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf40014ae0 tx=0x7fcf40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40006040 con 0x7fcf441f4fb0 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fcf40006000 con 0x7fcf441f4fb0 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 msgr2=0x7fcf4414bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf35ffb640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 0x7fcf4414bb50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf40014ae0 tx=0x7fcf40004730 comp rx=0 tx=0).stop 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf35ffb640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 msgr2=0x7fcf4414bb50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.752+0000 7fcf35ffb640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf441f4fb0 0x7fcf4414bb50 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf40014ae0 tx=0x7fcf40004730 comp rx=0 tx=0).stop 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:01.755 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 4, 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 167322, 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 167, 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:01.756 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:01.757 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:01.758 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:01.759 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:01.760 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.761 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.762 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.763 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:01.764 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.766 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.767 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:01.768 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.769 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.770 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:01.770 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcf2806c1b0 msgr2=0x7fcf2806e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcf2806c1b0 0x7fcf2806e670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf44150550 tx=0x7fcf38009190 comp rx=0 tx=0).stop 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 msgr2=0x7fcf441f4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 0x7fcf441f4530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00a970 tx=0x7fcf44158e70 comp rx=0 tx=0).stop 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf49cce640 1 -- 172.21.15.123:0/3774585015 reap_dead start 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 shutdown_connections 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 --2- 172.21.15.123:0/3774585015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4406c890 0x7fcf441f4530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 >> 172.21.15.123:0/3774585015 conn(0x7fcf440713d0 msgr2=0x7fcf4415c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 shutdown_connections 2024-09-19T09:45:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.753+0000 7fcf4b731640 1 -- 172.21.15.123:0/3774585015 wait complete. 2024-09-19T09:45:01.773 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:01.773 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:45:01.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:45:01.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 Processor -- start 2024-09-19T09:45:01.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 -- start start 2024-09-19T09:45:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0db81551d0 0x7f0db815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81555b0 0x7f0db80ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db815e620 con 0x7f0db815f300 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0db80c5c50 con 0x7f0db81551d0 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.911+0000 7f0dbd24c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0db815b5f0 con 0x7f0db81555b0 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0db81551d0 0x7f0db815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0db81551d0 0x7f0db815edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42232/0 (socket says 172.21.15.123:42232) 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 -- 172.21.15.123:0/430105221 learned_addr learned my addr 172.21.15.123:0/430105221 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 -- 172.21.15.123:0/430105221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81555b0 msgr2=0x7f0db80ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/430105221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81555b0 0x7f0db80ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 -- 172.21.15.123:0/430105221 >> v1:172.21.15.194:6789/0 conn(0x7f0db815f300 legacy=0x7f0db806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.912+0000 7f0db6d9d640 1 -- 172.21.15.123:0/430105221 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db815b8d0 con 0x7f0db81551d0 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/430105221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81551d0 0x7f0db815edc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009870 tx=0x7f0da802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee5beb49f023e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0db659c640 1 -- 172.21.15.123:0/430105221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8037070 con 0x7f0db81551d0 2024-09-19T09:45:01.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0db659c640 1 -- 172.21.15.123:0/430105221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da8032440 con 0x7f0db81551d0 2024-09-19T09:45:01.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0db659c640 1 -- 172.21.15.123:0/430105221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8032810 con 0x7f0db81551d0 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 -- 172.21.15.123:0/430105221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81551d0 msgr2=0x7f0db815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/430105221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81551d0 0x7f0db815edc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009870 tx=0x7f0da802a2a0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 -- 172.21.15.123:0/430105221 shutdown_connections 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/430105221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81555b0 0x7f0db80ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/430105221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81551d0 0x7f0db815edc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 -- 172.21.15.123:0/430105221 >> 172.21.15.123:0/430105221 conn(0x7f0db80d0e10 msgr2=0x7f0db80d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 -- 172.21.15.123:0/430105221 shutdown_connections 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.913+0000 7f0dbd24c640 1 -- 172.21.15.123:0/430105221 wait complete. 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 Processor -- start 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 -- start start 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81551d0 0x7f0db81f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81555b0 0x7f0db80c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db815f300 0x7f0db814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0db815e8a0 con 0x7f0db81555b0 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0db815be90 con 0x7f0db815f300 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0dbd24c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0db806cde0 con 0x7f0db81551d0 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0daffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81555b0 0x7f0db80c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0daffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81555b0 0x7f0db80c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42234/0 (socket says 172.21.15.123:42234) 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0daffff640 1 -- 172.21.15.123:0/576817939 learned_addr learned my addr 172.21.15.123:0/576817939 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0db759e640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db815f300 0x7f0db814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.915+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81551d0 0x7f0db81f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daffff640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81551d0 msgr2=0x7f0db81f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daffff640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db81551d0 0x7f0db81f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daffff640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db815f300 msgr2=0x7f0db814d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daffff640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db815f300 0x7f0db814d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daffff640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db81f13f0 con 0x7f0db81555b0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daffff640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81555b0 0x7f0db80c76e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0da000b4d0 tx=0x7f0da000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0014070 con 0x7f0db81555b0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da0010610 con 0x7f0db81555b0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db81e4a80 con 0x7f0db81555b0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0010a00 con 0x7f0db81555b0 2024-09-19T09:45:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.916+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db81f1670 con 0x7f0db81555b0 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.917+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 0x7f0db814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.917+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0db815a440 con 0x7f0db81e5b00 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.917+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 0x7f0db814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.917+0000 7f0db6d9d640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0db815b080 con 0x7f0db81e5b00 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0da0017070 con 0x7f0db81555b0 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 0x7f0db814da90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0db808e7c0 tx=0x7f0da80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0d9806c2b0 0x7f0d9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f0da008ae00 con 0x7f0db81555b0 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0db759e640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0d9806c2b0 0x7f0d9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8037040 con 0x7f0db81e5b00 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0da803c820 con 0x7f0db81e5b00 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 msgr2=0x7f0db814da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 0x7f0db814da90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0db808e7c0 tx=0x7f0da80046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 msgr2=0x7f0db814da90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0daf7fe640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e5b00 0x7f0db814da90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.918+0000 7f0db759e640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0d9806c2b0 0x7f0d9806e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0db815f790 tx=0x7f0db000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.924+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 0x7f0db81f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.924+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8154710 con 0x7f0db81e7250 2024-09-19T09:45:01.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.925+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 0x7f0db81f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.925+0000 7f0db6d9d640 1 -- 172.21.15.123:0/576817939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0db80d14d0 con 0x7f0db81e7250 2024-09-19T09:45:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.925+0000 7f0db6d9d640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 0x7f0db81f1840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0db81e6180 tx=0x7f0da8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.925+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8037040 con 0x7f0db81e7250 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4864 (secure 0 0 0) 0x7f0da8009490 con 0x7f0db81e7250 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 msgr2=0x7f0db81f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0daf7fe640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 0x7f0db81f1840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0db81e6180 tx=0x7f0da8008030 comp rx=0 tx=0).stop 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0daf7fe640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 msgr2=0x7f0db81f1840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0daf7fe640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db81e7250 0x7f0db81f1840 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0db81e6180 tx=0x7f0da8008030 comp rx=0 tx=0).stop 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:01.928 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 4, 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 167455, 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 167, 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:01.929 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:01.930 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:01.931 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:01.932 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:01.933 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.935 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:01.936 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:01.937 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.938 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.939 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.940 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:01.941 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0d9806c2b0 msgr2=0x7f0d9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0d9806c2b0 0x7f0d9806e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0db815f790 tx=0x7f0db000d040 comp rx=0 tx=0).stop 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81555b0 msgr2=0x7f0db80c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 --2- 172.21.15.123:0/576817939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0db81555b0 0x7f0db80c76e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0da000b4d0 tx=0x7f0da000b990 comp rx=0 tx=0).stop 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0db759e640 1 -- 172.21.15.123:0/576817939 reap_dead start 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0db759e640 1 -- 172.21.15.123:0/576817939 reap_dead start 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 shutdown_connections 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 >> 172.21.15.123:0/576817939 conn(0x7f0db80d0e10 msgr2=0x7f0db8158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 shutdown_connections 2024-09-19T09:45:01.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:01.926+0000 7f0dbd24c640 1 -- 172.21.15.123:0/576817939 wait complete. 2024-09-19T09:45:01.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:01.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:45:01.944 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.041+0000 7f19fd48d640 1 Processor -- start 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.041+0000 7f19fd48d640 1 -- start start 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19fd48d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19f815b080 0x7f19f806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19fd48d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f815e620 con 0x7f19f81551d0 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19fd48d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f815b5f0 con 0x7f19f81555b0 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19fd48d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f19f80c5c50 con 0x7f19f815b080 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19f815b080 0x7f19f806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f6ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f19f81551d0 0x7f19f815edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40256/0 (socket says 172.21.15.123:40256) 2024-09-19T09:45:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f6ffd640 1 -- 172.21.15.123:0/1435555597 learned_addr learned my addr 172.21.15.123:0/1435555597 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f77fe640 1 -- 172.21.15.123:0/1435555597 >> v1:172.21.15.194:6789/0 conn(0x7f19f81555b0 legacy=0x7f19f80ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f5ffb640 1 -- 172.21.15.123:0/1435555597 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651538250 0 0) 0x7f19e8001490 con 0x7f19f81551d0 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f77fe640 1 -- 172.21.15.123:0/1435555597 >> v1:172.21.15.123:6789/0 conn(0x7f19f81551d0 legacy=0x7f19f815edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.042+0000 7f19f77fe640 1 -- 172.21.15.123:0/1435555597 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f815b8d0 con 0x7f19f815b080 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.043+0000 7f19f77fe640 1 --2- 172.21.15.123:0/1435555597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f815b080 0x7f19f806c6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097a0 tx=0x7f19f002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566eefb1c0babeb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.043+0000 7f19f5ffb640 1 -- 172.21.15.123:0/1435555597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0037070 con 0x7f19f815b080 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.043+0000 7f19f5ffb640 1 -- 172.21.15.123:0/1435555597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f0032440 con 0x7f19f815b080 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.043+0000 7f19f5ffb640 1 -- 172.21.15.123:0/1435555597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0032810 con 0x7f19f815b080 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 -- 172.21.15.123:0/1435555597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f815b080 msgr2=0x7f19f806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 --2- 172.21.15.123:0/1435555597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f815b080 0x7f19f806c6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097a0 tx=0x7f19f002a230 comp rx=0 tx=0).stop 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 -- 172.21.15.123:0/1435555597 shutdown_connections 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 --2- 172.21.15.123:0/1435555597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f815b080 0x7f19f806c6d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 -- 172.21.15.123:0/1435555597 >> 172.21.15.123:0/1435555597 conn(0x7f19f80d0e10 msgr2=0x7f19f80d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 -- 172.21.15.123:0/1435555597 shutdown_connections 2024-09-19T09:45:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.044+0000 7f19fd48d640 1 -- 172.21.15.123:0/1435555597 wait complete. 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.045+0000 7f19fd48d640 1 Processor -- start 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.045+0000 7f19fd48d640 1 -- start start 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f81551d0 0x7f19f81f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f81555b0 0x7f19f806c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f815b080 0x7f19f81454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19f815e8a0 con 0x7f19f81555b0 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19f815be90 con 0x7f19f81551d0 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f19f815f4d0 con 0x7f19f815b080 2024-09-19T09:45:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f81555b0 0x7f19f806c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f81555b0 0x7f19f806c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42248/0 (socket says 172.21.15.123:42248) 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 -- 172.21.15.123:0/141709113 learned_addr learned my addr 172.21.15.123:0/141709113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f6ffd640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f81551d0 0x7f19f81f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f77fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f815b080 0x7f19f81454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f815b080 msgr2=0x7f19f81454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f815b080 0x7f19f81454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f81551d0 msgr2=0x7f19f81f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f81551d0 0x7f19f81f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f81f4870 con 0x7f19f81555b0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19f67fc640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f81555b0 0x7f19f806c8d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c480 tx=0x7f19ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec0052d0 con 0x7f19f81555b0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ec005470 con 0x7f19f81555b0 2024-09-19T09:45:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.046+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f815e3c0 con 0x7f19f81555b0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.047+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec012870 con 0x7f19f81555b0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.047+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f80c6180 con 0x7f19f81555b0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.047+0000 7f19fd48d640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 0x7f19f8145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.047+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f19f80c7720 con 0x7f19f80c6350 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.047+0000 7f19f6ffd640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 0x7f19f8145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.048+0000 7f19f6ffd640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19f80c71e0 con 0x7f19f80c6350 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.048+0000 7f19f6ffd640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 0x7f19f8145a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000f80 tx=0x7f19e80079d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.048+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f19ec012a10 con 0x7f19f81555b0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.048+0000 7f19df7fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19e406c2e0 0x7f19e406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.048+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f19ec08af30 con 0x7f19f81555b0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19f77fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19e406c2e0 0x7f19e406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e800f950 con 0x7f19f80c6350 2024-09-19T09:45:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f19e8018070 con 0x7f19f80c6350 2024-09-19T09:45:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 msgr2=0x7f19f8145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19df7fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 0x7f19f8145a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000f80 tx=0x7f19e80079d0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 msgr2=0x7f19f8145a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19df7fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c6350 0x7f19f8145a10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.049+0000 7f19f77fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19e406c2e0 0x7f19e406e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f19f0034000 tx=0x7f19f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.055+0000 7f19fd48d640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 0x7f19f80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.055+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f19f815edc0 con 0x7f19f80c67d0 2024-09-19T09:45:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.055+0000 7f19f6ffd640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 0x7f19f80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.055+0000 7f19f6ffd640 1 -- 172.21.15.123:0/141709113 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19f8159e30 con 0x7f19f80c67d0 2024-09-19T09:45:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.055+0000 7f19f6ffd640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 0x7f19f80b5e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000f80 tx=0x7f19e80016f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8013600 con 0x7f19f80c67d0 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f19e8013600 con 0x7f19f80c67d0 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 msgr2=0x7f19f80b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19df7fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 0x7f19f80b5e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000f80 tx=0x7f19e80016f0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19df7fe640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 msgr2=0x7f19f80b5e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19df7fe640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f80c67d0 0x7f19f80b5e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:02.059 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 4, 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 167586, 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 167, 2024-09-19T09:45:02.060 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:02.061 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:02.062 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:02.063 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:02.064 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:02.065 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.066 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:02.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:02.068 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:02.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:02.070 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.071 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:02.072 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:02.073 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.074 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:02.075 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.076 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:02.077 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:02.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:02.079 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:02.079 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19e406c2e0 msgr2=0x7f19e406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19e406c2e0 0x7f19e406e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f19f0034000 tx=0x7f19f002e000 comp rx=0 tx=0).stop 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f81555b0 msgr2=0x7f19f806c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 --2- 172.21.15.123:0/141709113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f81555b0 0x7f19f806c8d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c480 tx=0x7f19ec00c940 comp rx=0 tx=0).stop 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19f77fe640 1 -- 172.21.15.123:0/141709113 reap_dead start 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19f77fe640 1 -- 172.21.15.123:0/141709113 reap_dead start 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 shutdown_connections 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 >> 172.21.15.123:0/141709113 conn(0x7f19f80d0e10 msgr2=0x7f19f80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 shutdown_connections 2024-09-19T09:45:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.056+0000 7f19fd48d640 1 -- 172.21.15.123:0/141709113 wait complete. 2024-09-19T09:45:02.082 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:02.082 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-19T09:45:02.082 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:45:02.082 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-19T09:45:02.082 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:45:02.083 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:45:02.083 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:45:02.097 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:45:02.097 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:45:02.097 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:02.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.192+0000 7f176b198640 1 Processor -- start 2024-09-19T09:45:02.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.192+0000 7f176b198640 1 -- start start 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f176b198640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 0x7f1764075c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f176b198640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176415b150 con 0x7f17640c82a0 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f176b198640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176415f040 con 0x7f1764155340 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f176b198640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f176415f5e0 con 0x7f176415bd40 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f17640c82a0 0x7f176415b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40272/0 (socket says 172.21.15.123:40272) 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175bfff640 1 -- 172.21.15.123:0/2327027767 learned_addr learned my addr 172.21.15.123:0/2327027767 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f1768f34640 1 -- 172.21.15.123:0/2327027767 >> v1:172.21.15.194:6789/0 conn(0x7f1764155340 legacy=0x7f176406d5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:02.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f1769735640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 0x7f1764075c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279715405 0 0) 0x7f176415b150 con 0x7f17640c82a0 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f174c003520 con 0x7f17640c82a0 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2732844097 0 0) 0x7f174c003520 con 0x7f17640c82a0 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 msgr2=0x7f1764075c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 0x7f1764075c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 >> v1:172.21.15.194:6789/0 conn(0x7f1764155340 legacy=0x7f176406d5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176415f300 con 0x7f17640c82a0 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f1754001670 con 0x7f17640c82a0 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 >> v1:172.21.15.123:6789/0 conn(0x7f17640c82a0 legacy=0x7f176415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0039e0 0x7f174c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f174c0043b0 0x7f174c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.193+0000 7f175b7fe640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 0x7f174c0050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f176415f5e0 con 0x7f174c0043b0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f174c00bab0 con 0x7f174c0039e0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f174c00bcb0 con 0x7f176415bd40 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f1768f34640 1 -- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0039e0 msgr2=0x7f174c003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f1768f34640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0039e0 0x7f174c003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175bfff640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f174c0043b0 0x7f174c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f1769735640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 0x7f174c0050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175bfff640 1 -- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 msgr2=0x7f174c0050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175bfff640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176415bd40 0x7f174c0050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175bfff640 1 -- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0039e0 msgr2=0x7f174c003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175bfff640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0039e0 0x7f174c003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.194+0000 7f175bfff640 1 -- 172.21.15.123:0/2327027767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c003520 con 0x7f174c0043b0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f175bfff640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f174c0043b0 0x7f174c004880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f175400c240 tx=0x7f174c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cfca16ee7b3a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754007d30 con 0x7f174c0043b0 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754005af0 con 0x7f174c0043b0 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f175b7fe640 1 -- 172.21.15.123:0/2327027767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754007070 con 0x7f174c0043b0 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f176b198640 1 -- 172.21.15.123:0/2327027767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f174c0043b0 msgr2=0x7f174c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f176b198640 1 --2- 172.21.15.123:0/2327027767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f174c0043b0 0x7f174c004880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f175400c240 tx=0x7f174c005830 comp rx=0 tx=0).stop 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f1769735640 1 -- 172.21.15.123:0/2327027767 reap_dead start 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f176b198640 1 -- 172.21.15.123:0/2327027767 shutdown_connections 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f176b198640 1 -- 172.21.15.123:0/2327027767 >> 172.21.15.123:0/2327027767 conn(0x7f176406c4c0 msgr2=0x7f17640cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f176b198640 1 -- 172.21.15.123:0/2327027767 shutdown_connections 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.195+0000 7f176b198640 1 -- 172.21.15.123:0/2327027767 wait complete. 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.196+0000 7f176b198640 1 Processor -- start 2024-09-19T09:45:02.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.196+0000 7f176b198640 1 -- start start 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f176b198640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0043b0 0x7f176415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f176b198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 0x7f1764156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f176b198640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17640ccdb0 0x7f17640cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f176b198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1764155720 con 0x7f1764157e50 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f176b198640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f17640c9770 con 0x7f174c0043b0 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f176b198640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f17640c9a50 con 0x7f17640ccdb0 2024-09-19T09:45:02.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f175bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 0x7f1764156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f175bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 0x7f1764156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42260/0 (socket says 172.21.15.123:42260) 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f175bfff640 1 -- 172.21.15.123:0/803175525 learned_addr learned my addr 172.21.15.123:0/803175525 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f1768f34640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0043b0 msgr2=0x7f176415a670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.197+0000 7f1768f34640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0043b0 0x7f176415a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f175bfff640 1 -- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17640ccdb0 msgr2=0x7f17640cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f175bfff640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17640ccdb0 0x7f17640cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f175bfff640 1 -- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0043b0 msgr2=0x7f176415a670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f175bfff640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0043b0 0x7f176415a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f175bfff640 1 -- 172.21.15.123:0/803175525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17641f4510 con 0x7f1764157e50 2024-09-19T09:45:02.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f175bfff640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 0x7f1764156580 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f175400c360 tx=0x7f17640c4810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754007d30 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754043070 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17641f4a90 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754004e10 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.198+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1764155aa0 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.199+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17640c78c0 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.200+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1754007070 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.200+0000 7f17597fa640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f175006c260 0x7f175006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.200+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f17540abba0 con 0x7f1764157e50 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.200+0000 7f1768f34640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f175006c260 0x7f175006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:02.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.201+0000 7f1768f34640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f175006c260 0x7f175006e720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1760006fd0 tx=0x7f1760006de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:02.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.204+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f175407a320 con 0x7f1764157e50 2024-09-19T09:45:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.434+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1764072110 con 0x7f1764157e50 2024-09-19T09:45:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.435+0000 7f17597fa640 1 -- 172.21.15.123:0/803175525 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f1754079c20 con 0x7f1764157e50 2024-09-19T09:45:02.437 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":167,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f175006c260 msgr2=0x7f175006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f175006c260 0x7f175006e720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1760006fd0 tx=0x7f1760006de0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 msgr2=0x7f1764156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 0x7f1764156580 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f175400c360 tx=0x7f17640c4810 comp rx=0 tx=0).stop 2024-09-19T09:45:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 shutdown_connections 2024-09-19T09:45:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f175006c260 0x7f175006e720 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17640ccdb0 0x7f17640cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1764157e50 0x7f1764156580 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 --2- 172.21.15.123:0/803175525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f174c0043b0 0x7f176415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 >> 172.21.15.123:0/803175525 conn(0x7f176406c4c0 msgr2=0x7f176406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 shutdown_connections 2024-09-19T09:45:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:02.437+0000 7f176b198640 1 -- 172.21.15.123:0/803175525 wait complete. 2024-09-19T09:45:05.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:05.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 Processor -- start 2024-09-19T09:45:05.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 -- start start 2024-09-19T09:45:05.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3ee81523a0 0x7f3ee80c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 0x7f3ee81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee8157e20 con 0x7f3ee8151fc0 2024-09-19T09:45:05.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee8158e20 con 0x7f3ee81523a0 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.559+0000 7f3eee6f8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee8072100 con 0x7f3ee8072770 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3ee8151fc0 0x7f3ee80710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47294/0 (socket says 172.21.15.123:47294) 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee77fe640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f3ee81523a0 msgr2=0x7f3ee80c88b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee7fff640 1 -- 172.21.15.123:0/2877419605 learned_addr learned my addr 172.21.15.123:0/2877419605 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee77fe640 1 --2- 172.21.15.123:0/2877419605 >> v2:172.21.15.194:3300/0 conn(0x7f3ee81523a0 0x7f3ee80c88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3eecc95640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 0x7f3ee81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779278691 0 0) 0x7f3ee8157e20 con 0x7f3ee8151fc0 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed0003520 con 0x7f3ee8151fc0 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 196234544 0 0) 0x7f3ed0003520 con 0x7f3ee8151fc0 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 msgr2=0x7f3ee81588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 0x7f3ee81588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 >> v2:172.21.15.194:3300/0 conn(0x7f3ee81523a0 msgr2=0x7f3ee80c88b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:05.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 --2- 172.21.15.123:0/2877419605 >> v2:172.21.15.194:3300/0 conn(0x7f3ee81523a0 0x7f3ee80c88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee80723e0 con 0x7f3ee8151fc0 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f3ed8001690 con 0x7f3ee8151fc0 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 >> v1:172.21.15.123:6789/0 conn(0x7f3ee8151fc0 legacy=0x7f3ee80710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ed0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 0x7f3ed0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0004d40 0x7f3ed00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8158e20 con 0x7f3ed00039b0 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8072100 con 0x7f3ed0004d40 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed000bb20 con 0x7f3ee8072770 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ed0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3eecc95640 1 -- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0004d40 msgr2=0x7f3ed00051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3eecc95640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0004d40 0x7f3ed00051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.560+0000 7f3ee77fe640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 0x7f3ed0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee7fff640 1 -- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 msgr2=0x7f3ed0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8072770 0x7f3ed0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee7fff640 1 -- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0004d40 msgr2=0x7f3ed00051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0004d40 0x7f3ed00051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee7fff640 1 -- 172.21.15.123:0/2877419605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed0003520 con 0x7f3ed00039b0 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ed0003dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c210 tx=0x7f3ed0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3536d886f2a865e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8007d60 con 0x7f3ed00039b0 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed80058d0 con 0x7f3ed00039b0 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.561+0000 7f3ee6ffd640 1 -- 172.21.15.123:0/2877419605 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8005cc0 con 0x7f3ed00039b0 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eee6f8640 1 -- 172.21.15.123:0/2877419605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 msgr2=0x7f3ed0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/2877419605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ed0003dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c210 tx=0x7f3ed0005830 comp rx=0 tx=0).stop 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eecc95640 1 -- 172.21.15.123:0/2877419605 reap_dead start 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eee6f8640 1 -- 172.21.15.123:0/2877419605 shutdown_connections 2024-09-19T09:45:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eee6f8640 1 -- 172.21.15.123:0/2877419605 >> 172.21.15.123:0/2877419605 conn(0x7f3ee806ec90 msgr2=0x7f3ee806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:05.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eee6f8640 1 -- 172.21.15.123:0/2877419605 shutdown_connections 2024-09-19T09:45:05.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.562+0000 7f3eee6f8640 1 -- 172.21.15.123:0/2877419605 wait complete. 2024-09-19T09:45:05.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.563+0000 7f3eee6f8640 1 Processor -- start 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.563+0000 7f3eee6f8640 1 -- start start 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3eee6f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ee8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3eee6f8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8154690 0x7f3ee814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3eee6f8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee81f2320 0x7f3ee81f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3eee6f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8071800 con 0x7f3ed00039b0 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3eee6f8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81583c0 con 0x7f3ee8154690 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3eee6f8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee8071980 con 0x7f3ee81f2320 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ee8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ee8156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55842/0 (socket says 172.21.15.123:55842) 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3ee7fff640 1 -- 172.21.15.123:0/365667124 learned_addr learned my addr 172.21.15.123:0/365667124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3ee77fe640 1 -- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8154690 msgr2=0x7f3ee814dd50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.564+0000 7f3ee77fe640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8154690 0x7f3ee814dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee7fff640 1 -- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee81f2320 msgr2=0x7f3ee81f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3eecc95640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee81f2320 0x7f3ee81f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee81f2320 0x7f3ee81f27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee7fff640 1 -- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8154690 msgr2=0x7f3ee814dd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8154690 0x7f3ee814dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee7fff640 1 -- 172.21.15.123:0/365667124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee8155050 con 0x7f3ed00039b0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee7fff640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ee8156160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c330 tx=0x7f3ed8001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8042020 con 0x7f3ed00039b0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed8007280 con 0x7f3ed00039b0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8007d60 con 0x7f3ed00039b0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee8073470 con 0x7f3ed00039b0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.565+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee81552c0 con 0x7f3ed00039b0 2024-09-19T09:45:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.566+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee815b3d0 con 0x7f3ed00039b0 2024-09-19T09:45:05.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.567+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ed8045020 con 0x7f3ed00039b0 2024-09-19T09:45:05.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.567+0000 7f3ee4ff9640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ed406c260 0x7f3ed406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:05.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.567+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f3ed80aba00 con 0x7f3ed00039b0 2024-09-19T09:45:05.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.567+0000 7f3ee77fe640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ed406c260 0x7f3ed406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:05.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.568+0000 7f3ee77fe640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ed406c260 0x7f3ed406e720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8156bb0 tx=0x7f3edc0090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:05.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.571+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3ed804c030 con 0x7f3ed00039b0 2024-09-19T09:45:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.802+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3ee806e460 con 0x7f3ed00039b0 2024-09-19T09:45:05.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.803+0000 7f3ee4ff9640 1 -- 172.21.15.123:0/365667124 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f3ed807a210 con 0x7f3ed00039b0 2024-09-19T09:45:05.805 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":171,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ed406c260 msgr2=0x7f3ed406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ed406c260 0x7f3ed406e720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8156bb0 tx=0x7f3edc0090e0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 msgr2=0x7f3ee8156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ee8156160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c330 tx=0x7f3ed8001a60 comp rx=0 tx=0).stop 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 shutdown_connections 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ed406c260 0x7f3ed406e720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee81f2320 0x7f3ee81f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8154690 0x7f3ee814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 --2- 172.21.15.123:0/365667124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ed00039b0 0x7f3ee8156160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 >> 172.21.15.123:0/365667124 conn(0x7f3ee806ec90 msgr2=0x7f3ee80c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 shutdown_connections 2024-09-19T09:45:05.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:05.805+0000 7f3eee6f8640 1 -- 172.21.15.123:0/365667124 wait complete. 2024-09-19T09:45:08.818 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:08.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.926+0000 7f1bcb43c640 1 Processor -- start 2024-09-19T09:45:08.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.926+0000 7f1bcb43c640 1 -- start start 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bcb43c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc41531e0 0x7f1bc4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bcb43c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bc406c680 0x7f1bc406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bcb43c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc40c6ce0 con 0x7f1bc40c4720 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bcb43c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc40c61f0 con 0x7f1bc406c680 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bcb43c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc40c4290 con 0x7f1bc41531e0 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc99d9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bc406c680 0x7f1bc406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc89d7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1bc40c4720 0x7f1bc4073300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47304/0 (socket says 172.21.15.123:47304) 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc89d7640 1 -- 172.21.15.123:0/541273114 learned_addr learned my addr 172.21.15.123:0/541273114 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc99d9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bc406c680 0x7f1bc406cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55854/0 (socket says 172.21.15.123:55854) 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc91d8640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc41531e0 0x7f1bc4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc99d9640 1 -- 172.21.15.123:0/541273114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc41531e0 msgr2=0x7f1bc4158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc99d9640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc41531e0 0x7f1bc4158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc99d9640 1 -- 172.21.15.123:0/541273114 >> v1:172.21.15.123:6789/0 conn(0x7f1bc40c4720 legacy=0x7f1bc4073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.927+0000 7f1bc99d9640 1 -- 172.21.15.123:0/541273114 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc40c4b20 con 0x7f1bc406c680 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.928+0000 7f1bc91d8640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc41531e0 0x7f1bc4158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.928+0000 7f1bc99d9640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc406cad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009d90 tx=0x7f1bbc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7293b04931e80ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.928+0000 7f1bbbfff640 1 -- 172.21.15.123:0/541273114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007740 con 0x7f1bc406c680 2024-09-19T09:45:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.928+0000 7f1bbbfff640 1 -- 172.21.15.123:0/541273114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0078e0 con 0x7f1bc406c680 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.928+0000 7f1bbbfff640 1 -- 172.21.15.123:0/541273114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007cb0 con 0x7f1bc406c680 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 -- 172.21.15.123:0/541273114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 msgr2=0x7f1bc406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc406cad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009d90 tx=0x7f1bbc02a6f0 comp rx=0 tx=0).stop 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 -- 172.21.15.123:0/541273114 shutdown_connections 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc406cad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/541273114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc41531e0 0x7f1bc4158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 -- 172.21.15.123:0/541273114 >> 172.21.15.123:0/541273114 conn(0x7f1bc406ec90 msgr2=0x7f1bc406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 -- 172.21.15.123:0/541273114 shutdown_connections 2024-09-19T09:45:08.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.929+0000 7f1bcb43c640 1 -- 172.21.15.123:0/541273114 wait complete. 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.930+0000 7f1bcb43c640 1 Processor -- start 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.930+0000 7f1bcb43c640 1 -- start start 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bcb43c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bcb43c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc40c4720 0x7f1bc40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bcb43c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc41531e0 0x7f1bc4149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bcb43c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40c6720 con 0x7f1bc406c680 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bcb43c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40c6440 con 0x7f1bc41531e0 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bcb43c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc40c6a00 con 0x7f1bc40c4720 2024-09-19T09:45:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc414b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55860/0 (socket says 172.21.15.123:55860) 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc99d9640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc41531e0 msgr2=0x7f1bc4149290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 -- 172.21.15.123:0/259855061 learned_addr learned my addr 172.21.15.123:0/259855061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc99d9640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc41531e0 0x7f1bc4149290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc89d7640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc40c4720 0x7f1bc40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 -- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc40c4720 msgr2=0x7f1bc40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc40c4720 0x7f1bc40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 -- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc41531e0 msgr2=0x7f1bc4149290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc41531e0 0x7f1bc4149290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.931+0000 7f1bc91d8640 1 -- 172.21.15.123:0/259855061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc41f2570 con 0x7f1bc406c680 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.932+0000 7f1bc91d8640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc414b7b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000c7f0 tx=0x7f1bc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.932+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0015070 con 0x7f1bc406c680 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.932+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc0007a30 con 0x7f1bc406c680 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.932+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc41f2850 con 0x7f1bc406c680 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.932+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0007e00 con 0x7f1bc406c680 2024-09-19T09:45:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.932+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc41f2e10 con 0x7f1bc406c680 2024-09-19T09:45:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.933+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc40c3f20 con 0x7f1bc406c680 2024-09-19T09:45:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.933+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1bc0018070 con 0x7f1bc406c680 2024-09-19T09:45:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.934+0000 7f1bb9ffb640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c260 0x7f1ba806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.934+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1bc008b3e0 con 0x7f1bc406c680 2024-09-19T09:45:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.934+0000 7f1bc89d7640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c260 0x7f1ba806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.934+0000 7f1bc89d7640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c260 0x7f1ba806e720 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c7c00 tx=0x7f1bb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:08.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:08.938+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1bc0059b60 con 0x7f1bc406c680 2024-09-19T09:45:09.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.166+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1bc414bcf0 con 0x7f1bc406c680 2024-09-19T09:45:09.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.167+0000 7f1bb9ffb640 1 -- 172.21.15.123:0/259855061 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f1bc0059460 con 0x7f1bc406c680 2024-09-19T09:45:09.169 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":174,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c260 msgr2=0x7f1ba806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c260 0x7f1ba806e720 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c7c00 tx=0x7f1bb4009040 comp rx=0 tx=0).stop 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 msgr2=0x7f1bc414b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc414b7b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000c7f0 tx=0x7f1bc000cbf0 comp rx=0 tx=0).stop 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 shutdown_connections 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc41531e0 0x7f1bc4149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c260 0x7f1ba806e720 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc40c4720 0x7f1bc40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:09.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 --2- 172.21.15.123:0/259855061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bc406c680 0x7f1bc414b7b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:09.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 >> 172.21.15.123:0/259855061 conn(0x7f1bc406ec90 msgr2=0x7f1bc414edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:09.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 shutdown_connections 2024-09-19T09:45:09.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:09.169+0000 7f1bcb43c640 1 -- 172.21.15.123:0/259855061 wait complete. 2024-09-19T09:45:12.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.290+0000 7f72d45bd640 1 Processor -- start 2024-09-19T09:45:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.290+0000 7f72d45bd640 1 -- start start 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d45bd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d45bd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d45bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72cc0c7dd0 con 0x7f72cc067e90 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d45bd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc072310 con 0x7f72cc153240 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d45bd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0c8090 con 0x7f72cc068490 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d2359640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d2b5a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72cc067e90 0x7f72cc06be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47310/0 (socket says 172.21.15.123:47310) 2024-09-19T09:45:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.291+0000 7f72d2b5a640 1 -- 172.21.15.123:0/1275557646 learned_addr learned my addr 172.21.15.123:0/1275557646 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:45:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:45:12.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:12.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:45:12.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:12.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:12.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.493+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:45:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:45:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:45:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:45:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:12.894+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:45:13.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.695+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:13.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.695+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.695+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.695+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.695+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.695+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.696+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.696+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.696+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:13.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:13.696+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72cc067950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72cc067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 msgr2=0x7f72cc073ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.123:3300/0 conn(0x7f72cc153240 0x7f72cc073ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.123:6789/0 conn(0x7f72cc067e90 legacy=0x7f72cc06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 0x7f72b8009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72cc15d010 con 0x7f72b80036c0 2024-09-19T09:45:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc072310 con 0x7f72b8007370 2024-09-19T09:45:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.292+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.292+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 msgr2=0x7f72b8009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 0x7f72b8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:15.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.493+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 msgr2=0x7f72b8009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:15.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.493+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:15.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.493+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 0x7f72b8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:45:15.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.894+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 msgr2=0x7f72b8009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:15.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.894+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:15.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:15.894+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 0x7f72b8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:45:16.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:16.695+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 msgr2=0x7f72b8009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:16.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:16.695+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:16.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:16.695+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 0x7f72b8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:45:18.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 msgr2=0x7f72b8009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 --2- 172.21.15.123:0/1275557646 >> v2:172.21.15.194:3300/0 conn(0x7f72b8007370 0x7f72b8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d2b5a640 1 -- 172.21.15.123:0/1275557646 reap_dead start 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b800a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b800afa0 con 0x7f72cc067e90 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72cc15d010 con 0x7f72b80036c0 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72cbfff640 1 -- 172.21.15.123:0/1275557646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc072310 con 0x7f72cc068490 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d2b5a640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b800a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738405869 0 0) 0x7f72b800afa0 con 0x7f72cc067e90 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72b4003520 con 0x7f72cc067e90 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4092628984 0 0) 0x7f72b4003520 con 0x7f72cc067e90 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72b800a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b800a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.194:6789/0 conn(0x7f72b80036c0 legacy=0x7f72b8005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b800ac60 con 0x7f72cc067e90 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f72c400f590 con 0x7f72cc067e90 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.291+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b800a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 >> v1:172.21.15.123:6789/0 conn(0x7f72cc067e90 legacy=0x7f72b8009ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72b40039e0 0x7f72b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc072310 con 0x7f72b4004800 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72b400baa0 con 0x7f72b40039e0 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f72b400bca0 con 0x7f72cc068490 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d2359640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72b40039e0 msgr2=0x7f72b4003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d2359640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72b40039e0 0x7f72b4003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d2b5a640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 msgr2=0x7f72b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc068490 0x7f72b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72b40039e0 msgr2=0x7f72b4003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72b40039e0 0x7f72b4003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.292+0000 7f72d1b58640 1 -- 172.21.15.123:0/1275557646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b4003520 con 0x7f72b4004800 2024-09-19T09:45:18.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.293+0000 7f72d1b58640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72b4004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0c77d0 tx=0x7f72b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a339832a9cc15e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.293+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0032070 con 0x7f72b4004800 2024-09-19T09:45:18.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.293+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c002c890 con 0x7f72b4004800 2024-09-19T09:45:18.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.293+0000 7f72d1357640 1 -- 172.21.15.123:0/1275557646 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0009aa0 con 0x7f72b4004800 2024-09-19T09:45:18.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d45bd640 1 -- 172.21.15.123:0/1275557646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 msgr2=0x7f72b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d45bd640 1 --2- 172.21.15.123:0/1275557646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72b4004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0c77d0 tx=0x7f72b4005830 comp rx=0 tx=0).stop 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d2b5a640 1 -- 172.21.15.123:0/1275557646 reap_dead start 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d45bd640 1 -- 172.21.15.123:0/1275557646 shutdown_connections 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d45bd640 1 -- 172.21.15.123:0/1275557646 >> 172.21.15.123:0/1275557646 conn(0x7f72cc0cdbd0 msgr2=0x7f72cc0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d45bd640 1 -- 172.21.15.123:0/1275557646 shutdown_connections 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.294+0000 7f72d45bd640 1 -- 172.21.15.123:0/1275557646 wait complete. 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.296+0000 7f72d45bd640 1 Processor -- start 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.296+0000 7f72d45bd640 1 -- start start 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.296+0000 7f72d45bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72cc0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.296+0000 7f72d45bd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc0c6b80 0x7f72cc1f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d45bd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc1f2d20 0x7f72cc149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d45bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc072840 con 0x7f72b4004800 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d45bd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc072560 con 0x7f72cc0c6b80 2024-09-19T09:45:18.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d45bd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc153620 con 0x7f72cc1f2d20 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72cc0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d1b58640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc0c6b80 msgr2=0x7f72cc1f27e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72cc0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46842/0 (socket says 172.21.15.123:46842) 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d1b58640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc0c6b80 0x7f72cc1f27e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 -- 172.21.15.123:0/4062432043 learned_addr learned my addr 172.21.15.123:0/4062432043 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2b5a640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc1f2d20 0x7f72cc149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 -- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc1f2d20 msgr2=0x7f72cc149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc1f2d20 0x7f72cc149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 -- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc0c6b80 msgr2=0x7f72cc1f27e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc0c6b80 0x7f72cc1f27e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 -- 172.21.15.123:0/4062432043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc14a6f0 con 0x7f72b4004800 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d2359640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72cc0c6300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72c400fec0 tx=0x7f72c40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c401a030 con 0x7f72b4004800 2024-09-19T09:45:18.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4015690 con 0x7f72b4004800 2024-09-19T09:45:18.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4015a80 con 0x7f72b4004800 2024-09-19T09:45:18.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.297+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc14a990 con 0x7f72b4004800 2024-09-19T09:45:18.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.298+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc14af50 con 0x7f72b4004800 2024-09-19T09:45:18.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.299+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72cc0c4d40 con 0x7f72b4004800 2024-09-19T09:45:18.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.299+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72c401d030 con 0x7f72b4004800 2024-09-19T09:45:18.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.300+0000 7f72caffd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f72b806ce90 0x7f72b806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.300+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f72c408b830 con 0x7f72b4004800 2024-09-19T09:45:18.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.300+0000 7f72d1b58640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f72b806ce90 0x7f72b806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.300+0000 7f72d1b58640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f72b806ce90 0x7f72b806f350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72c0037000 tx=0x7f72c0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.304+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f72cc0c4d40 con 0x7f72b4004800 2024-09-19T09:45:18.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.538+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f72cc06d4d0 con 0x7f72b4004800 2024-09-19T09:45:18.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.538+0000 7f72caffd640 1 -- 172.21.15.123:0/4062432043 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1561 (secure 0 0 0) 0x7f72c4059ff0 con 0x7f72b4004800 2024-09-19T09:45:18.541 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f72b806ce90 msgr2=0x7f72b806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f72b806ce90 0x7f72b806f350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72c0037000 tx=0x7f72c0032000 comp rx=0 tx=0).stop 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 msgr2=0x7f72cc0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72cc0c6300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72c400fec0 tx=0x7f72c40039e0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 shutdown_connections 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f72b806ce90 0x7f72b806f350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72cc1f2d20 0x7f72cc149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc0c6b80 0x7f72cc1f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 --2- 172.21.15.123:0/4062432043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72b4004800 0x7f72cc0c6300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 >> 172.21.15.123:0/4062432043 conn(0x7f72cc0cdbd0 msgr2=0x7f72cc0c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 shutdown_connections 2024-09-19T09:45:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.541+0000 7f72d45bd640 1 -- 172.21.15.123:0/4062432043 wait complete. 2024-09-19T09:45:18.555 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:45:18.555 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:45:18.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:45:18.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.652+0000 7f3e8d2ba640 1 Processor -- start 2024-09-19T09:45:18.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.652+0000 7f3e8d2ba640 1 -- start start 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e8d2ba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e880c4f60 0x7f3e8806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e8d2ba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e880c9670 0x7f3e8806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e8d2ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e880c3c70 con 0x7f3e8814f9c0 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e8d2ba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3e881592e0 con 0x7f3e880c4f60 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e8d2ba640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8806dec0 con 0x7f3e880c9670 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e86ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3e8814f9c0 0x7f3e88159770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50526/0 (socket says 172.21.15.123:50526) 2024-09-19T09:45:18.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e86ffd640 1 -- 172.21.15.123:0/3202482091 learned_addr learned my addr 172.21.15.123:0/3202482091 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e867fc640 1 --2- 172.21.15.123:0/3202482091 >> v2:172.21.15.123:3300/0 conn(0x7f3e880c4f60 0x7f3e8806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e877fe640 1 --2- 172.21.15.123:0/3202482091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e880c9670 0x7f3e8806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e85ffb640 1 -- 172.21.15.123:0/3202482091 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473827743 0 0) 0x7f3e880c3c70 con 0x7f3e8814f9c0 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.653+0000 7f3e85ffb640 1 -- 172.21.15.123:0/3202482091 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e70003520 con 0x7f3e8814f9c0 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e867fc640 1 -- 172.21.15.123:0/3202482091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e880c9670 msgr2=0x7f3e8806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e867fc640 1 --2- 172.21.15.123:0/3202482091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e880c9670 0x7f3e8806f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e867fc640 1 -- 172.21.15.123:0/3202482091 >> v1:172.21.15.123:6789/0 conn(0x7f3e8814f9c0 legacy=0x7f3e88159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e867fc640 1 -- 172.21.15.123:0/3202482091 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8806e1a0 con 0x7f3e880c4f60 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e867fc640 1 --2- 172.21.15.123:0/3202482091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c4f60 0x7f3e8806f1e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0097a0 tx=0x7f3e7c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec7a263add09bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e85ffb640 1 -- 172.21.15.123:0/3202482091 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c037070 con 0x7f3e880c4f60 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e85ffb640 1 -- 172.21.15.123:0/3202482091 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7c02ae50 con 0x7f3e880c4f60 2024-09-19T09:45:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.654+0000 7f3e85ffb640 1 -- 172.21.15.123:0/3202482091 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c032640 con 0x7f3e880c4f60 2024-09-19T09:45:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/3202482091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c4f60 msgr2=0x7f3e8806f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/3202482091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c4f60 0x7f3e8806f1e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0097a0 tx=0x7f3e7c02a100 comp rx=0 tx=0).stop 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/3202482091 shutdown_connections 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/3202482091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e880c9670 0x7f3e8806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/3202482091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c4f60 0x7f3e8806f1e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/3202482091 >> 172.21.15.123:0/3202482091 conn(0x7f3e880713d0 msgr2=0x7f3e880cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/3202482091 shutdown_connections 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.655+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/3202482091 wait complete. 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.656+0000 7f3e8d2ba640 1 Processor -- start 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.656+0000 7f3e8d2ba640 1 -- start start 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e8d2ba640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e880c4f60 0x7f3e8814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e8d2ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c9670 0x7f3e8815ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e8d2ba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e8814f9c0 0x7f3e8815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e8d2ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8815c4f0 con 0x7f3e880c9670 2024-09-19T09:45:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e8d2ba640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88158f00 con 0x7f3e880c4f60 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e8d2ba640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8815c670 con 0x7f3e8814f9c0 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e86ffd640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e880c4f60 msgr2=0x7f3e8814def0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e86ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e880c4f60 0x7f3e8814def0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c9670 0x7f3e8815ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c9670 0x7f3e8815ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46860/0 (socket says 172.21.15.123:46860) 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 -- 172.21.15.123:0/223753985 learned_addr learned my addr 172.21.15.123:0/223753985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e877fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e8814f9c0 0x7f3e8815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e8814f9c0 msgr2=0x7f3e8815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e8814f9c0 0x7f3e8815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e880c4f60 msgr2=0x7f3e8814def0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e880c4f60 0x7f3e8814def0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e867fc640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8815c1d0 con 0x7f3e880c9670 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.657+0000 7f3e877fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e8814f9c0 0x7f3e8815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.658+0000 7f3e867fc640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c9670 0x7f3e8815ad00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c035040 tx=0x7f3e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.658+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c041020 con 0x7f3e880c9670 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.658+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7c03c670 con 0x7f3e880c9670 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.658+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c037040 con 0x7f3e880c9670 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.658+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8806d4d0 con 0x7f3e880c9670 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.658+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8806c7b0 con 0x7f3e880c9670 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 0x7f3e880ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88069af0 con 0x7f3e8815a430 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e86ffd640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 0x7f3e880ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e86ffd640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e880c3f50 con 0x7f3e8815a430 2024-09-19T09:45:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e86ffd640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 0x7f3e880ca220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e78004b90 tx=0x7f3e7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78017070 con 0x7f3e8815a430 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.659+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3e7c044020 con 0x7f3e880c9670 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3e7406c1b0 0x7f3e7406e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f3e7c0abc20 con 0x7f3e880c9670 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e877fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3e7406c1b0 0x7f3e7406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3e7800ace0 con 0x7f3e8815a430 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 msgr2=0x7f3e880ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 0x7f3e880ca220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e78004b90 tx=0x7f3e7800a060 comp rx=0 tx=0).stop 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 msgr2=0x7f3e880ca220 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e6f7fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e8815a430 0x7f3e880ca220 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e78004b90 tx=0x7f3e7800a060 comp rx=0 tx=0).stop 2024-09-19T09:45:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.660+0000 7f3e877fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3e7406c1b0 0x7f3e7406e670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e880b3c40 tx=0x7f3e80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.666+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 0x7f3e880cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.666+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3e880cb080 con 0x7f3e880ca760 2024-09-19T09:45:18.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.666+0000 7f3e86ffd640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 0x7f3e880cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.666+0000 7f3e86ffd640 1 -- 172.21.15.123:0/223753985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e880c4290 con 0x7f3e880ca760 2024-09-19T09:45:18.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e86ffd640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 0x7f3e880cab40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e8806e640 tx=0x7f3e78001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78012620 con 0x7f3e880ca760 2024-09-19T09:45:18.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5187 (secure 0 0 0) 0x7f3e78025420 con 0x7f3e880ca760 2024-09-19T09:45:18.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 msgr2=0x7f3e880cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e6f7fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 0x7f3e880cab40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e8806e640 tx=0x7f3e78001250 comp rx=0 tx=0).stop 2024-09-19T09:45:18.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e6f7fe640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 msgr2=0x7f3e880cab40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e6f7fe640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880ca760 0x7f3e880cab40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 8, 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 184238, 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:18.671 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:18.672 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:18.673 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:18.674 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:18.675 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.676 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:18.677 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:18.678 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.679 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:18.681 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.682 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.683 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.684 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:18.685 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:18.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3e7406c1b0 msgr2=0x7f3e7406e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3e7406c1b0 0x7f3e7406e670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e880b3c40 tx=0x7f3e80008040 comp rx=0 tx=0).stop 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c9670 msgr2=0x7f3e8815ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 --2- 172.21.15.123:0/223753985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e880c9670 0x7f3e8815ad00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c035040 tx=0x7f3e7c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e877fe640 1 -- 172.21.15.123:0/223753985 reap_dead start 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e877fe640 1 -- 172.21.15.123:0/223753985 reap_dead start 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 shutdown_connections 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 >> 172.21.15.123:0/223753985 conn(0x7f3e880713d0 msgr2=0x7f3e88156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 shutdown_connections 2024-09-19T09:45:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.667+0000 7f3e8d2ba640 1 -- 172.21.15.123:0/223753985 wait complete. 2024-09-19T09:45:18.687 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:45:18.688 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:45:18.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:45:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.787+0000 7f16920d0640 1 Processor -- start 2024-09-19T09:45:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.787+0000 7f16920d0640 1 -- start start 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f16920d0640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f168c0cd040 0x7f168c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f16920d0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168c15b580 con 0x7f168c0cdbb0 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f16920d0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168c15b860 con 0x7f168c155360 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f16920d0640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f168c15c100 con 0x7f168c0cd040 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f168b7fe640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7f168c155360 legacy=0x7f168c0cb900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f168affd640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f168c0cd040 msgr2=0x7f168c0cd670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f168bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f168c0cdbb0 0x7f168c15eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50532/0 (socket says 172.21.15.123:50532) 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f168bfff640 1 -- 172.21.15.123:0/2287052896 learned_addr learned my addr 172.21.15.123:0/2287052896 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.788+0000 7f168affd640 1 --2- 172.21.15.123:0/2287052896 >> v2:172.21.15.194:3300/0 conn(0x7f168c0cd040 0x7f168c0cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029500172 0 0) 0x7f168c15b580 con 0x7f168c0cdbb0 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1674003520 con 0x7f168c0cdbb0 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1261594211 0 0) 0x7f1674003520 con 0x7f168c0cdbb0 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 >> v2:172.21.15.194:3300/0 conn(0x7f168c0cd040 msgr2=0x7f168c0cd670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 --2- 172.21.15.123:0/2287052896 >> v2:172.21.15.194:3300/0 conn(0x7f168c0cd040 0x7f168c0cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 >> v1:172.21.15.194:6789/0 conn(0x7f168c155360 legacy=0x7f168c0cb900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c15bb40 con 0x7f168c0cdbb0 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f16840019f0 con 0x7f168c0cdbb0 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 >> v1:172.21.15.123:6789/0 conn(0x7f168c0cdbb0 legacy=0x7f168c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16740039b0 0x7f1674003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1674004800 0x7f1674004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1674005230 0x7f167400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f168c15c100 con 0x7f16740039b0 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f167400c190 con 0x7f1674004800 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f167400c390 con 0x7f1674005230 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16740039b0 0x7f1674003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168affd640 1 -- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1674004800 msgr2=0x7f1674004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168affd640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1674004800 0x7f1674004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168b7fe640 1 -- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1674005230 msgr2=0x7f167400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1674005230 0x7f167400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168b7fe640 1 -- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1674004800 msgr2=0x7f1674004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1674004800 0x7f1674004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168b7fe640 1 -- 172.21.15.123:0/2287052896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1674003520 con 0x7f16740039b0 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.789+0000 7f168bfff640 1 -- 172.21.15.123:0/2287052896 reap_dead start 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.790+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16740039b0 0x7f1674003db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f1674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c279e19095b2ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.790+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c009500 con 0x7f16740039b0 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.790+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167c02e070 con 0x7f16740039b0 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.790+0000 7f168a7fc640 1 -- 172.21.15.123:0/2287052896 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c003df0 con 0x7f16740039b0 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 -- 172.21.15.123:0/2287052896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16740039b0 msgr2=0x7f1674003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16740039b0 0x7f1674003db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f1674005830 comp rx=0 tx=0).stop 2024-09-19T09:45:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 -- 172.21.15.123:0/2287052896 shutdown_connections 2024-09-19T09:45:18.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 --2- 172.21.15.123:0/2287052896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16740039b0 0x7f1674003db0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 -- 172.21.15.123:0/2287052896 >> 172.21.15.123:0/2287052896 conn(0x7f168c06cb60 msgr2=0x7f168c06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 -- 172.21.15.123:0/2287052896 shutdown_connections 2024-09-19T09:45:18.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.791+0000 7f16920d0640 1 -- 172.21.15.123:0/2287052896 wait complete. 2024-09-19T09:45:18.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.792+0000 7f16920d0640 1 Processor -- start 2024-09-19T09:45:18.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.792+0000 7f16920d0640 1 -- start start 2024-09-19T09:45:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16740039b0 0x7f168c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f168c0d0740 0x7f168c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 0x7f168c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f168c155740 con 0x7f168c1576d0 2024-09-19T09:45:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f168c15e910 con 0x7f168c0d0740 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f168c1558c0 con 0x7f16740039b0 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 0x7f168c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168affd640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f168c0d0740 msgr2=0x7f168c155d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168affd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f168c0d0740 0x7f168c155d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 0x7f168c157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46892/0 (socket says 172.21.15.123:46892) 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 -- 172.21.15.123:0/2632627268 learned_addr learned my addr 172.21.15.123:0/2632627268 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16740039b0 0x7f168c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16740039b0 msgr2=0x7f168c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16740039b0 0x7f168c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f168c0d0740 msgr2=0x7f168c155d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f168c0d0740 0x7f168c155d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c158070 con 0x7f168c1576d0 2024-09-19T09:45:18.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f168bfff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 0x7f168c157b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f168c08e580 tx=0x7f168400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400cea0 con 0x7f168c1576d0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168400a610 con 0x7f168c1576d0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400aa00 con 0x7f168c1576d0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c1f1c50 con 0x7f168c1576d0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.793+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c1568a0 con 0x7f168c1576d0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.794+0000 7f16920d0640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 0x7f168c14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.794+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f168c069af0 con 0x7f168c156aa0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 0x7f168c14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f168b7fe640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f168c15b160 con 0x7f168c156aa0 2024-09-19T09:45:18.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f168400aba0 con 0x7f168c1576d0 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 0x7f168c14f8a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f167c003930 tx=0x7f167c005a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f1673fff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f167806c260 0x7f167806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f168affd640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f167806c260 0x7f167806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.795+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f168408b050 con 0x7f168c1576d0 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c044070 con 0x7f168c156aa0 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f167c02e050 con 0x7f168c156aa0 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 msgr2=0x7f168c14f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f1673fff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 0x7f168c14f8a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f167c003930 tx=0x7f167c005a10 comp rx=0 tx=0).stop 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 msgr2=0x7f168c14f8a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f1673fff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c156aa0 0x7f168c14f8a0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f167c003930 tx=0x7f167c005a10 comp rx=0 tx=0).stop 2024-09-19T09:45:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.796+0000 7f168affd640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f167806c260 0x7f167806e720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f168c0b3ab0 tx=0x7f1680006d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.802+0000 7f16920d0640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 0x7f168c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.802+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f168c156e80 con 0x7f168c14fde0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.802+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 0x7f168c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.802+0000 7f168b7fe640 1 -- 172.21.15.123:0/2632627268 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f168c0b6e30 con 0x7f168c14fde0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.802+0000 7f168b7fe640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 0x7f168c1f45c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f168c0d0b70 tx=0x7f167c0090e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c04b070 con 0x7f168c14fde0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f167c005820 con 0x7f168c14fde0 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 msgr2=0x7f168c1f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f1673fff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 0x7f168c1f45c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f168c0d0b70 tx=0x7f167c0090e0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f1673fff640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 msgr2=0x7f168c1f45c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:18.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f1673fff640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f168c14fde0 0x7f168c1f45c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.808 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:18.808 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:18.808 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 8, 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 184335, 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:18.809 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:18.810 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:18.811 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:18.812 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:18.813 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:18.814 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:18.815 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:18.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:18.817 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.818 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.819 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:18.820 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.821 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:18.822 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f167806c260 msgr2=0x7f167806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f167806c260 0x7f167806e720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f168c0b3ab0 tx=0x7f1680006d30 comp rx=0 tx=0).stop 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 msgr2=0x7f168c157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 0x7f168c157b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f168c08e580 tx=0x7f168400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f168bfff640 1 -- 172.21.15.123:0/2632627268 reap_dead start 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 shutdown_connections 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 --2- 172.21.15.123:0/2632627268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f168c1576d0 0x7f168c157b30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 >> 172.21.15.123:0/2632627268 conn(0x7f168c06cb60 msgr2=0x7f168c15a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 shutdown_connections 2024-09-19T09:45:18.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:18.803+0000 7f16920d0640 1 -- 172.21.15.123:0/2632627268 wait complete. 2024-09-19T09:45:18.825 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:45:18.825 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:45:31.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:45:31.777 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:45:38.826 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:45:38.826 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-19T09:45:38.827 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:45:38.827 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:45:38.830 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:45:38.830 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:45:38.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.930+0000 7ffade6e4640 1 Processor -- start 2024-09-19T09:45:38.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.930+0000 7ffade6e4640 1 -- start start 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffade6e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffade6e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad80c8700 con 0x7ffad8073260 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffade6e4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad80c89e0 con 0x7ffad806de20 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffade6e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ffad815c440 con 0x7ffad8152e00 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffadcc81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffad8073260 0x7ffad81637d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55438/0 (socket says 172.21.15.123:55438) 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffadcc81640 1 -- 172.21.15.123:0/1774433842 learned_addr learned my addr 172.21.15.123:0/1774433842 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:38.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffad7fff640 1 --2- 172.21.15.123:0/1774433842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffad77fe640 1 -- 172.21.15.123:0/1774433842 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509774575 0 0) 0x7ffad80c8700 con 0x7ffad8073260 2024-09-19T09:45:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffad7fff640 1 -- 172.21.15.123:0/1774433842 >> v1:172.21.15.194:6789/0 conn(0x7ffad806de20 legacy=0x7ffad81598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.931+0000 7ffad7fff640 1 -- 172.21.15.123:0/1774433842 >> v1:172.21.15.123:6789/0 conn(0x7ffad8073260 legacy=0x7ffad81637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.932+0000 7ffad7fff640 1 -- 172.21.15.123:0/1774433842 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad80c8cc0 con 0x7ffad8152e00 2024-09-19T09:45:38.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.932+0000 7ffad7fff640 1 --2- 172.21.15.123:0/1774433842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815ce90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffac80097d0 tx=0x7ffac802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc5f418c3216a687 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.932+0000 7ffad77fe640 1 -- 172.21.15.123:0/1774433842 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8037070 con 0x7ffad8152e00 2024-09-19T09:45:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffad77fe640 1 -- 172.21.15.123:0/1774433842 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac8032440 con 0x7ffad8152e00 2024-09-19T09:45:38.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffad77fe640 1 -- 172.21.15.123:0/1774433842 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8032810 con 0x7ffad8152e00 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffade6e4640 1 -- 172.21.15.123:0/1774433842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 msgr2=0x7ffad815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffade6e4640 1 --2- 172.21.15.123:0/1774433842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815ce90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffac80097d0 tx=0x7ffac802a250 comp rx=0 tx=0).stop 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffade6e4640 1 -- 172.21.15.123:0/1774433842 shutdown_connections 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffade6e4640 1 --2- 172.21.15.123:0/1774433842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815ce90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.933+0000 7ffade6e4640 1 -- 172.21.15.123:0/1774433842 >> 172.21.15.123:0/1774433842 conn(0x7ffad80ce9b0 msgr2=0x7ffad80ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.934+0000 7ffade6e4640 1 -- 172.21.15.123:0/1774433842 shutdown_connections 2024-09-19T09:45:38.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.934+0000 7ffade6e4640 1 -- 172.21.15.123:0/1774433842 wait complete. 2024-09-19T09:45:38.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.935+0000 7ffade6e4640 1 Processor -- start 2024-09-19T09:45:38.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.935+0000 7ffade6e4640 1 -- start start 2024-09-19T09:45:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffade6e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 0x7ffad8158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffade6e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 0x7ffad815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffade6e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffacffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 0x7ffad815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffacffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 0x7ffad815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49602/0 (socket says 172.21.15.123:49602) 2024-09-19T09:45:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffacffff640 1 -- 172.21.15.123:0/831011831 learned_addr learned my addr 172.21.15.123:0/831011831 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffad7fff640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 0x7ffad8158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffad815d3d0 con 0x7ffad8073260 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffad815ca00 con 0x7ffad806de20 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ffad81531e0 con 0x7ffad8152e00 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffadcc81640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffad7fff640 1 -- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 msgr2=0x7ffad8158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffad7fff640 1 -- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 msgr2=0x7ffad8158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffad7fff640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 0x7ffad8158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffad7fff640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 0x7ffad8158c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffadcc81640 1 -- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 msgr2=0x7ffad8158c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffadcc81640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 0x7ffad8158c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffadcc81640 1 -- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 msgr2=0x7ffad815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:38.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffadcc81640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 0x7ffad815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffadcc81640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad81f3140 con 0x7ffad8152e00 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.937+0000 7ffacffff640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 0x7ffad815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.938+0000 7ffadcc81640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815a460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c410 tx=0x7ffad000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.938+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad00074e0 con 0x7ffad8152e00 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.938+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffad00047e0 con 0x7ffad8152e00 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.938+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0004bd0 con 0x7ffad8152e00 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.938+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad81eee90 con 0x7ffad8152e00 2024-09-19T09:45:38.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.938+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad81ef450 con 0x7ffad8152e00 2024-09-19T09:45:38.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.939+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad80c5990 con 0x7ffad8152e00 2024-09-19T09:45:38.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.940+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffad0011070 con 0x7ffad8152e00 2024-09-19T09:45:38.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.941+0000 7ffad57fa640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffab806c2b0 0x7ffab806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:38.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.941+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7ffad008afe0 con 0x7ffad8152e00 2024-09-19T09:45:38.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.941+0000 7ffad7fff640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffab806c2b0 0x7ffab806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:38.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.941+0000 7ffad7fff640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffab806c2b0 0x7ffab806e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffac8034000 tx=0x7ffac802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:38.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:38.945+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ffad00595f0 con 0x7ffad8152e00 2024-09-19T09:45:39.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.192+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ffad80c9470 con 0x7ffad8152e00 2024-09-19T09:45:39.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.193+0000 7ffad57fa640 1 -- 172.21.15.123:0/831011831 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7ffad0058ef0 con 0x7ffad8152e00 2024-09-19T09:45:39.195 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:39.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffab806c2b0 msgr2=0x7ffab806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffab806c2b0 0x7ffab806e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffac8034000 tx=0x7ffac802e000 comp rx=0 tx=0).stop 2024-09-19T09:45:39.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 msgr2=0x7ffad815a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815a460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c410 tx=0x7ffad000c8d0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 shutdown_connections 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ffab806c2b0 0x7ffab806e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad8152e00 0x7ffad815a460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffad8073260 0x7ffad815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 --2- 172.21.15.123:0/831011831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad806de20 0x7ffad8158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 >> 172.21.15.123:0/831011831 conn(0x7ffad80ce9b0 msgr2=0x7ffad814f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 shutdown_connections 2024-09-19T09:45:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.195+0000 7ffade6e4640 1 -- 172.21.15.123:0/831011831 wait complete. 2024-09-19T09:45:39.211 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:45:39.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:45:39.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.325+0000 7f5c96ee4640 1 Processor -- start 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.325+0000 7f5c96ee4640 1 -- start start 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c96ee4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 0x7f5c900ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c96ee4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c9015b080 0x7f5c900cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c96ee4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9015e620 con 0x7f5c901551d0 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c96ee4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5c900c5c50 con 0x7f5c9015b080 2024-09-19T09:45:39.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c96ee4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f5c9015b5f0 con 0x7f5c901555b0 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c95481640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c9015b080 0x7f5c900cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c95481640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c9015b080 0x7f5c900cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49614/0 (socket says 172.21.15.123:49614) 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c95481640 1 -- 172.21.15.123:0/1216056363 learned_addr learned my addr 172.21.15.123:0/1216056363 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.326+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 0x7f5c900ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c8ffff640 1 -- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 msgr2=0x7f5c900ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c8ffff640 1 -- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 msgr2=0x7f5c900ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 0x7f5c900ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 0x7f5c900ccb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c95481640 1 -- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 msgr2=0x7f5c900ccb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:39.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c95481640 1 --2- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 0x7f5c900ccb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c95481640 1 -- 172.21.15.123:0/1216056363 >> v1:172.21.15.123:6789/0 conn(0x7f5c901551d0 legacy=0x7f5c9015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.327+0000 7f5c95481640 1 -- 172.21.15.123:0/1216056363 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9015b8d0 con 0x7f5c9015b080 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.328+0000 7f5c95481640 1 --2- 172.21.15.123:0/1216056363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c9015b080 0x7f5c900cd070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5c90076320 tx=0x7f5c8802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af748d815c62f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.328+0000 7f5c8f7fe640 1 -- 172.21.15.123:0/1216056363 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88036070 con 0x7f5c9015b080 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.328+0000 7f5c8f7fe640 1 -- 172.21.15.123:0/1216056363 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c88031600 con 0x7f5c9015b080 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.328+0000 7f5c8f7fe640 1 -- 172.21.15.123:0/1216056363 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88031a10 con 0x7f5c9015b080 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1216056363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c9015b080 msgr2=0x7f5c900cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1216056363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c9015b080 0x7f5c900cd070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5c90076320 tx=0x7f5c8802a750 comp rx=0 tx=0).stop 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1216056363 shutdown_connections 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1216056363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c9015b080 0x7f5c900cd070 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1216056363 >> v2:172.21.15.194:3300/0 conn(0x7f5c901555b0 0x7f5c900ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1216056363 >> 172.21.15.123:0/1216056363 conn(0x7f5c900d0e10 msgr2=0x7f5c900d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1216056363 shutdown_connections 2024-09-19T09:45:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.329+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1216056363 wait complete. 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.330+0000 7f5c96ee4640 1 Processor -- start 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.331+0000 7f5c96ee4640 1 -- start start 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c96ee4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901551d0 0x7f5c900b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c96ee4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c901555b0 0x7f5c900c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c96ee4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c9015b080 0x7f5c9014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c96ee4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9015e8a0 con 0x7f5c901551d0 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c96ee4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9015be90 con 0x7f5c901555b0 2024-09-19T09:45:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c96ee4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9015f4d0 con 0x7f5c9015b080 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901551d0 0x7f5c900b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901551d0 0x7f5c900b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49618/0 (socket says 172.21.15.123:49618) 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 -- 172.21.15.123:0/1369784157 learned_addr learned my addr 172.21.15.123:0/1369784157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c901555b0 0x7f5c900c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c95481640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c9015b080 0x7f5c9014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c9015b080 msgr2=0x7f5c9014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c9015b080 0x7f5c9014e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c901555b0 msgr2=0x7f5c900c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c901555b0 0x7f5c900c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.332+0000 7f5c94c80640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9015c7c0 con 0x7f5c901551d0 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.333+0000 7f5c94c80640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901551d0 0x7f5c900b6a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c430 tx=0x7f5c8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.333+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c840052d0 con 0x7f5c901551d0 2024-09-19T09:45:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.333+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c84005490 con 0x7f5c901551d0 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.333+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84007260 con 0x7f5c901551d0 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.333+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c900b62d0 con 0x7f5c901551d0 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.333+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c901f45d0 con 0x7f5c901551d0 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.334+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 0x7f5c901f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.334+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c900b60a0 con 0x7f5c900b50d0 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.334+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 0x7f5c901f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.334+0000 7f5c8ffff640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c9015edc0 con 0x7f5c900b50d0 2024-09-19T09:45:39.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.335+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 0x7f5c901f47d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c00f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.335+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c019020 con 0x7f5c900b50d0 2024-09-19T09:45:39.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.335+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5c84007400 con 0x7f5c901551d0 2024-09-19T09:45:39.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.335+0000 7f5c8d7fa640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5c7406c1b0 0x7f5c7406e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c95481640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5c7406c1b0 0x7f5c7406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f5c8408aa70 con 0x7f5c901551d0 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5c7c014870 con 0x7f5c900b50d0 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 msgr2=0x7f5c901f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c8d7fa640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 0x7f5c901f47d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c00f930 comp rx=0 tx=0).stop 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 msgr2=0x7f5c901f47d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c8d7fa640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c900b50d0 0x7f5c901f47d0 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c00f930 comp rx=0 tx=0).stop 2024-09-19T09:45:39.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.336+0000 7f5c95481640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5c7406c1b0 0x7f5c7406e670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c88033000 tx=0x7f5c88009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.342+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 0x7f5c901454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.342+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c90152480 con 0x7f5c901f4dd0 2024-09-19T09:45:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.342+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 0x7f5c901454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.342+0000 7f5c8ffff640 1 -- 172.21.15.123:0/1369784157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5c900c6530 con 0x7f5c901f4dd0 2024-09-19T09:45:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8ffff640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 0x7f5c901454d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c02a620 con 0x7f5c901f4dd0 2024-09-19T09:45:39.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5199 (secure 0 0 0) 0x7f5c7c02a620 con 0x7f5c901f4dd0 2024-09-19T09:45:39.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 msgr2=0x7f5c901454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.345 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 14, 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 204914, 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:39.346 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:39.347 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:39.348 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:39.349 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:39.350 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:39.351 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.352 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:39.353 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.354 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.355 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:39.356 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:39.357 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.358 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:39.359 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:39.360 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:39.361 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:39.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8d7fa640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 0x7f5c901454d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8d7fa640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 msgr2=0x7f5c901454d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:39.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c8d7fa640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901f4dd0 0x7f5c901454d0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5c7406c1b0 msgr2=0x7f5c7406e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5c7406c1b0 0x7f5c7406e670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c88033000 tx=0x7f5c88009000 comp rx=0 tx=0).stop 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901551d0 msgr2=0x7f5c900b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c96ee4640 1 --2- 172.21.15.123:0/1369784157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c901551d0 0x7f5c900b6a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c430 tx=0x7f5c8400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c95481640 1 -- 172.21.15.123:0/1369784157 reap_dead start 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.343+0000 7f5c95481640 1 -- 172.21.15.123:0/1369784157 reap_dead start 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.344+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 shutdown_connections 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.344+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 >> 172.21.15.123:0/1369784157 conn(0x7f5c900d0e10 msgr2=0x7f5c9015a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.344+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 shutdown_connections 2024-09-19T09:45:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.344+0000 7f5c96ee4640 1 -- 172.21.15.123:0/1369784157 wait complete. 2024-09-19T09:45:39.364 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:39.365 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:45:39.365 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:45:39.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.463+0000 7f5d6730a640 1 Processor -- start 2024-09-19T09:45:39.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.463+0000 7f5d6730a640 1 -- start start 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d6730a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d600c7640 0x7f5d6015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d6730a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 0x7f5d6006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d6730a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d60067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d6730a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6015e830 con 0x7f5d600c7640 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d6730a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6015ea60 con 0x7f5d600c7a20 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d6730a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6015ed40 con 0x7f5d6006d2f0 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d600c7640 0x7f5d6015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d600c7640 0x7f5d6015bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49652/0 (socket says 172.21.15.123:49652) 2024-09-19T09:45:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 -- 172.21.15.123:0/1357002239 learned_addr learned my addr 172.21.15.123:0/1357002239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:39.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d658a7640 1 --2- 172.21.15.123:0/1357002239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d60067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d648a5640 1 --2- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 0x7f5d6006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d648a5640 1 -- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 msgr2=0x7f5d6006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d648a5640 1 -- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 msgr2=0x7f5d6006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d648a5640 1 --2- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 0x7f5d6006cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d648a5640 1 --2- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 0x7f5d6006cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 -- 172.21.15.123:0/1357002239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 msgr2=0x7f5d60067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 --2- 172.21.15.123:0/1357002239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d60067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 -- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 msgr2=0x7f5d6006cdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 --2- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 0x7f5d6006cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.464+0000 7f5d650a6640 1 -- 172.21.15.123:0/1357002239 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6015f020 con 0x7f5d600c7640 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.465+0000 7f5d650a6640 1 --2- 172.21.15.123:0/1357002239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d6015bcd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c4df0 tx=0x7f5d5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa9af601bcb85f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.466+0000 7f5d57fff640 1 -- 172.21.15.123:0/1357002239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c037070 con 0x7f5d600c7640 2024-09-19T09:45:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.466+0000 7f5d57fff640 1 -- 172.21.15.123:0/1357002239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c032440 con 0x7f5d600c7640 2024-09-19T09:45:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.466+0000 7f5d57fff640 1 -- 172.21.15.123:0/1357002239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c037070 con 0x7f5d600c7640 2024-09-19T09:45:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.466+0000 7f5d6730a640 1 -- 172.21.15.123:0/1357002239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 msgr2=0x7f5d6015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.466+0000 7f5d6730a640 1 --2- 172.21.15.123:0/1357002239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d6015bcd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c4df0 tx=0x7f5d5c02a270 comp rx=0 tx=0).stop 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 -- 172.21.15.123:0/1357002239 shutdown_connections 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 --2- 172.21.15.123:0/1357002239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d60067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 --2- 172.21.15.123:0/1357002239 >> v2:172.21.15.194:3300/0 conn(0x7f5d600c7a20 0x7f5d6006cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 --2- 172.21.15.123:0/1357002239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d6015bcd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 -- 172.21.15.123:0/1357002239 >> 172.21.15.123:0/1357002239 conn(0x7f5d600703e0 msgr2=0x7f5d600cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 -- 172.21.15.123:0/1357002239 shutdown_connections 2024-09-19T09:45:39.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.467+0000 7f5d6730a640 1 -- 172.21.15.123:0/1357002239 wait complete. 2024-09-19T09:45:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.468+0000 7f5d6730a640 1 Processor -- start 2024-09-19T09:45:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.469+0000 7f5d6730a640 1 -- start start 2024-09-19T09:45:39.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d6730a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d601f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d6730a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d600c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d6730a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 0x7f5d600c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d6730a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60067e90 con 0x7f5d600c7640 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d600c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d600c10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49658/0 (socket says 172.21.15.123:49658) 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 -- 172.21.15.123:0/421137211 learned_addr learned my addr 172.21.15.123:0/421137211 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6015f5e0 con 0x7f5d600c7a20 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5d60068010 con 0x7f5d6006d2f0 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d601f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d658a7640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 0x7f5d600c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d658a7640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 msgr2=0x7f5d600c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d658a7640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 msgr2=0x7f5d600c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d658a7640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 0x7f5d600c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d658a7640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 0x7f5d600c54c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 msgr2=0x7f5d601f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d601f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 msgr2=0x7f5d600c54c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600c7a20 0x7f5d600c54c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d648a5640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d600c15e0 con 0x7f5d600c7640 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.470+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d6006d2f0 0x7f5d601f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.471+0000 7f5d648a5640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d600c10a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000d7d0 tx=0x7f5d5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.471+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000b6c0 con 0x7f5d600c7640 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.471+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d50019070 con 0x7f5d600c7640 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.471+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000bac0 con 0x7f5d600c7640 2024-09-19T09:45:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.471+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6015b830 con 0x7f5d600c7640 2024-09-19T09:45:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.471+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6015bdf0 con 0x7f5d600c7640 2024-09-19T09:45:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d6730a640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5d600ca5f0 con 0x7f5d600cd260 2024-09-19T09:45:39.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:45:39.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:39.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:39.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.472+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:39.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.474+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d5000bc60 con 0x7f5d600c7640 2024-09-19T09:45:39.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.474+0000 7f5d55ffb640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5d4406c2e0 0x7f5d4406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:39.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.474+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f5d5008b8a0 con 0x7f5d600c7640 2024-09-19T09:45:39.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.474+0000 7f5d658a7640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5d4406c2e0 0x7f5d4406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.475+0000 7f5d658a7640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5d4406c2e0 0x7f5d4406e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c1970 tx=0x7f5d5800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:39.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.673+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:39.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.673+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:45:39.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.673+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:39.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.673+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:39.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:39.673+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:45:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.074+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.074+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:45:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.074+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:40.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.074+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:40.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.074+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:45:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.875+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.875+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:45:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.875+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:40.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.875+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:40.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:40.875+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:45:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:42.477+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:42.477+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:45:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:42.477+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:42.477+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:42.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:42.477+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-19T09:45:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d54ff9640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d54ff9640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d54ff9640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d54ff9640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 msgr2=0x7f5d6015a4b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d54ff9640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d600cd260 0x7f5d6015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d54ff9640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5d600ca5f0 con 0x7f5d3c003590 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.470+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.471+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 msgr2=0x7f5d3c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.471+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 msgr2=0x7f5d3c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.471+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:43.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.471+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.672+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.672+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 msgr2=0x7f5d3c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:45:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.672+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 msgr2=0x7f5d3c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:45:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.672+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:45:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:43.672+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:45:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.073+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.073+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d3c006100 con 0x7f5d3c003590 2024-09-19T09:45:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d60068470 tx=0x7f5d5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c037040 con 0x7f5d3c003590 2024-09-19T09:45:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5d5c009490 con 0x7f5d3c003590 2024-09-19T09:45:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 msgr2=0x7f5d3c005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d55ffb640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d60068470 tx=0x7f5d5c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 msgr2=0x7f5d3c005a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.074+0000 7f5d55ffb640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d3c003590 0x7f5d3c005a20 secure :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d60068470 tx=0x7f5d5c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.086+0000 7f5d6730a640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 0x7f5d6015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.086+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5d600c82c0 con 0x7f5d60159ef0 2024-09-19T09:45:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.086+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 0x7f5d6015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.087+0000 7f5d650a6640 1 -- 172.21.15.123:0/421137211 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d600c69e0 con 0x7f5d60159ef0 2024-09-19T09:45:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.087+0000 7f5d650a6640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 0x7f5d6015a9f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c02a2b0 tx=0x7f5d5c03e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.087+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c056070 con 0x7f5d60159ef0 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.087+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f5d5c054070 con 0x7f5d60159ef0 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 msgr2=0x7f5d6015a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d55ffb640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 0x7f5d6015a9f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c02a2b0 tx=0x7f5d5c03e040 comp rx=0 tx=0).stop 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d55ffb640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 msgr2=0x7f5d6015a9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d55ffb640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d60159ef0 0x7f5d6015a9f0 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c02a2b0 tx=0x7f5d5c03e040 comp rx=0 tx=0).stop 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d658a7640 1 -- 172.21.15.123:0/421137211 reap_dead start 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:44.090 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 14, 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 5161, 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 4, 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:44.091 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:44.092 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.093 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:44.096 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:44.096 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:44.097 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.098 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.100 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.101 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.102 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:44.103 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.104 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:44.105 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:44.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5d4406c2e0 msgr2=0x7f5d4406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5d4406c2e0 0x7f5d4406e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c1970 tx=0x7f5d5800d040 comp rx=0 tx=0).stop 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 msgr2=0x7f5d600c10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d600c10a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000d7d0 tx=0x7f5d5000dc90 comp rx=0 tx=0).stop 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 shutdown_connections 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d600c7640 0x7f5d600c10a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 --2- 172.21.15.123:0/421137211 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5d4406c2e0 0x7f5d4406e7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 >> 172.21.15.123:0/421137211 conn(0x7f5d600703e0 msgr2=0x7f5d600c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 shutdown_connections 2024-09-19T09:45:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.088+0000 7f5d6730a640 1 -- 172.21.15.123:0/421137211 wait complete. 2024-09-19T09:45:44.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:44.108 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:45:44.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:45:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.208+0000 7f6030253640 1 Processor -- start 2024-09-19T09:45:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.208+0000 7f6030253640 1 -- start start 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f6030253640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60281555b0 0x7f60280ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f6030253640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815b080 0x7f60280cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f6030253640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602815e620 con 0x7f60281551d0 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f6030253640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f60280c5c50 con 0x7f60281555b0 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f6030253640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f602815b5f0 con 0x7f602815b080 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60281555b0 0x7f60280ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60281555b0 0x7f60280ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48954/0 (socket says 172.21.15.123:48954) 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 -- 172.21.15.123:0/766066312 learned_addr learned my addr 172.21.15.123:0/766066312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602e7f0640 1 --2- 172.21.15.123:0/766066312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815b080 0x7f60280cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 -- 172.21.15.123:0/766066312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815b080 msgr2=0x7f60280cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 --2- 172.21.15.123:0/766066312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815b080 0x7f60280cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 -- 172.21.15.123:0/766066312 >> v1:172.21.15.194:6789/0 conn(0x7f60281551d0 legacy=0x7f602815edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.209+0000 7f602d7ee640 1 -- 172.21.15.123:0/766066312 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602815b8d0 con 0x7f60281555b0 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.210+0000 7f602d7ee640 1 --2- 172.21.15.123:0/766066312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281555b0 0x7f60280ccb30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2045d0d28e0ab8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.210+0000 7f602cfed640 1 -- 172.21.15.123:0/766066312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018037070 con 0x7f60281555b0 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.210+0000 7f602cfed640 1 -- 172.21.15.123:0/766066312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601802ae50 con 0x7f60281555b0 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.210+0000 7f602cfed640 1 -- 172.21.15.123:0/766066312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018032860 con 0x7f60281555b0 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 -- 172.21.15.123:0/766066312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281555b0 msgr2=0x7f60280ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 --2- 172.21.15.123:0/766066312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281555b0 0x7f60280ccb30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601802a300 comp rx=0 tx=0).stop 2024-09-19T09:45:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 -- 172.21.15.123:0/766066312 shutdown_connections 2024-09-19T09:45:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 --2- 172.21.15.123:0/766066312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815b080 0x7f60280cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 --2- 172.21.15.123:0/766066312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281555b0 0x7f60280ccb30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 -- 172.21.15.123:0/766066312 >> 172.21.15.123:0/766066312 conn(0x7f60280d0e10 msgr2=0x7f60280d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 -- 172.21.15.123:0/766066312 shutdown_connections 2024-09-19T09:45:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.211+0000 7f6030253640 1 -- 172.21.15.123:0/766066312 wait complete. 2024-09-19T09:45:44.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.213+0000 7f6030253640 1 Processor -- start 2024-09-19T09:45:44.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.213+0000 7f6030253640 1 -- start start 2024-09-19T09:45:44.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f6030253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281551d0 0x7f602815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f6030253640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281555b0 0x7f602814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f6030253640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f602815b080 0x7f602815d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f6030253640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f602815e8a0 con 0x7f60281551d0 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f6030253640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f602815be90 con 0x7f602815b080 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f6030253640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f602815f4d0 con 0x7f60281555b0 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281551d0 0x7f602815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281551d0 0x7f602815c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48956/0 (socket says 172.21.15.123:48956) 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 -- 172.21.15.123:0/4226009282 learned_addr learned my addr 172.21.15.123:0/4226009282 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602d7ee640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281555b0 0x7f602814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602e7f0640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f602815b080 0x7f602815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281555b0 msgr2=0x7f602814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281555b0 0x7f602814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f602815b080 msgr2=0x7f602815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f602815b080 0x7f602815d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.214+0000 7f602dfef640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60280b6c40 con 0x7f60281551d0 2024-09-19T09:45:44.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.215+0000 7f602dfef640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281551d0 0x7f602815c3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f602400c400 tx=0x7f602400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.215+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60240052d0 con 0x7f60281551d0 2024-09-19T09:45:44.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.215+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6024005490 con 0x7f60281551d0 2024-09-19T09:45:44.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.215+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024007260 con 0x7f60281551d0 2024-09-19T09:45:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.215+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60281f1150 con 0x7f60281551d0 2024-09-19T09:45:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.215+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60281f1710 con 0x7f60281551d0 2024-09-19T09:45:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f6030253640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 0x7f60281f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f602815edc0 con 0x7f602815ce30 2024-09-19T09:45:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f602d7ee640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 0x7f60281f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6024007400 con 0x7f60281551d0 2024-09-19T09:45:44.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f602d7ee640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f602814eee0 con 0x7f602815ce30 2024-09-19T09:45:44.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f602d7ee640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 0x7f60281f1950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f602806d4c0 tx=0x7f60180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.217+0000 7f601e7fc640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f600c06c2b0 0x7f600c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f602408a900 con 0x7f60281551d0 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f602e7f0640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f600c06c2b0 0x7f600c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018043070 con 0x7f602815ce30 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f601802ae50 con 0x7f602815ce30 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 msgr2=0x7f60281f1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 0x7f60281f1950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f602806d4c0 tx=0x7f60180046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 msgr2=0x7f60281f1950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f601e7fc640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f602815ce30 0x7f60281f1950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.218+0000 7f602e7f0640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f600c06c2b0 0x7f600c06e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f602815df10 tx=0x7f602000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.229+0000 7f6030253640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 0x7f602815d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.229+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f60280ce2a0 con 0x7f60281f43b0 2024-09-19T09:45:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.230+0000 7f602d7ee640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 0x7f602815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.230+0000 7f602d7ee640 1 -- 172.21.15.123:0/4226009282 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f60280cdfc0 con 0x7f60281f43b0 2024-09-19T09:45:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.230+0000 7f602d7ee640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 0x7f602815d790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60180090b0 tx=0x7f6018008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018037040 con 0x7f60281f43b0 2024-09-19T09:45:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f601803cd20 con 0x7f60281f43b0 2024-09-19T09:45:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 msgr2=0x7f602815d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f601e7fc640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 0x7f602815d790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60180090b0 tx=0x7f6018008030 comp rx=0 tx=0).stop 2024-09-19T09:45:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f601e7fc640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 msgr2=0x7f602815d790 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f601e7fc640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60281f43b0 0x7f602815d790 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60180090b0 tx=0x7f6018008030 comp rx=0 tx=0).stop 2024-09-19T09:45:44.233 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 14, 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 209762, 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 5, 2024-09-19T09:45:44.234 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:44.237 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:44.238 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:44.239 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:44.240 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:44.241 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:44.242 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:44.243 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.244 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.245 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:44.246 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:44.247 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:44.247 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f600c06c2b0 msgr2=0x7f600c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f6030253640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f600c06c2b0 0x7f600c06e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f602815df10 tx=0x7f602000b040 comp rx=0 tx=0).stop 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281551d0 msgr2=0x7f602815c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f6030253640 1 --2- 172.21.15.123:0/4226009282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60281551d0 0x7f602815c3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f602400c400 tx=0x7f602400c8c0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f602e7f0640 1 -- 172.21.15.123:0/4226009282 reap_dead start 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f602e7f0640 1 -- 172.21.15.123:0/4226009282 reap_dead start 2024-09-19T09:45:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 shutdown_connections 2024-09-19T09:45:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.231+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 >> 172.21.15.123:0/4226009282 conn(0x7f60280d0e10 msgr2=0x7f60280cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.232+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 shutdown_connections 2024-09-19T09:45:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.232+0000 7f6030253640 1 -- 172.21.15.123:0/4226009282 wait complete. 2024-09-19T09:45:44.249 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:44.249 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:45:44.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:45:44.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.349+0000 7fb378ffd640 1 Processor -- start 2024-09-19T09:45:44.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.349+0000 7fb378ffd640 1 -- start start 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb378ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb374155650 0x7fb3740cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb378ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3740c7f40 0x7fb3740ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb378ffd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37415c240 con 0x7fb3740c8400 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb378ffd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb374155a30 con 0x7fb374155650 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb378ffd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb37415b3e0 con 0x7fb3740c7f40 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb37259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb374155650 0x7fb3740cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb37259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb374155650 0x7fb3740cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48970/0 (socket says 172.21.15.123:48970) 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb37259c640 1 -- 172.21.15.123:0/1155377784 learned_addr learned my addr 172.21.15.123:0/1155377784 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.350+0000 7fb371d9b640 1 --2- 172.21.15.123:0/1155377784 >> v2:172.21.15.194:3300/0 conn(0x7fb3740c7f40 0x7fb3740ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.351+0000 7fb37159a640 1 -- 172.21.15.123:0/1155377784 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886276167 0 0) 0x7fb37415c240 con 0x7fb3740c8400 2024-09-19T09:45:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.351+0000 7fb37159a640 1 -- 172.21.15.123:0/1155377784 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb35c003520 con 0x7fb3740c8400 2024-09-19T09:45:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.351+0000 7fb37259c640 1 -- 172.21.15.123:0/1155377784 >> v2:172.21.15.194:3300/0 conn(0x7fb3740c7f40 msgr2=0x7fb3740ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.351+0000 7fb37259c640 1 --2- 172.21.15.123:0/1155377784 >> v2:172.21.15.194:3300/0 conn(0x7fb3740c7f40 0x7fb3740ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.351+0000 7fb37259c640 1 -- 172.21.15.123:0/1155377784 >> v1:172.21.15.123:6789/0 conn(0x7fb3740c8400 legacy=0x7fb3740cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.351+0000 7fb37259c640 1 -- 172.21.15.123:0/1155377784 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37415b6c0 con 0x7fb374155650 2024-09-19T09:45:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.352+0000 7fb37259c640 1 --2- 172.21.15.123:0/1155377784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb374155650 0x7fb3740cc850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb3740ca840 tx=0x7fb36402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cefe3813ec377ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.352+0000 7fb37159a640 1 -- 172.21.15.123:0/1155377784 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364037070 con 0x7fb374155650 2024-09-19T09:45:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.352+0000 7fb37159a640 1 -- 172.21.15.123:0/1155377784 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb364032440 con 0x7fb374155650 2024-09-19T09:45:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.352+0000 7fb37159a640 1 -- 172.21.15.123:0/1155377784 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364032810 con 0x7fb374155650 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.352+0000 7fb378ffd640 1 -- 172.21.15.123:0/1155377784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb374155650 msgr2=0x7fb3740cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.352+0000 7fb378ffd640 1 --2- 172.21.15.123:0/1155377784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb374155650 0x7fb3740cc850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb3740ca840 tx=0x7fb36402a280 comp rx=0 tx=0).stop 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.353+0000 7fb378ffd640 1 -- 172.21.15.123:0/1155377784 shutdown_connections 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.353+0000 7fb378ffd640 1 --2- 172.21.15.123:0/1155377784 >> v2:172.21.15.194:3300/0 conn(0x7fb3740c7f40 0x7fb3740ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.353+0000 7fb378ffd640 1 --2- 172.21.15.123:0/1155377784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb374155650 0x7fb3740cc850 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.353+0000 7fb378ffd640 1 -- 172.21.15.123:0/1155377784 >> 172.21.15.123:0/1155377784 conn(0x7fb3740cd5c0 msgr2=0x7fb3740cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.353+0000 7fb378ffd640 1 -- 172.21.15.123:0/1155377784 shutdown_connections 2024-09-19T09:45:44.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.353+0000 7fb378ffd640 1 -- 172.21.15.123:0/1155377784 wait complete. 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.355+0000 7fb378ffd640 1 Processor -- start 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.355+0000 7fb378ffd640 1 -- start start 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb378ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3740c7f40 0x7fb3740c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb378ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 0x7fb374150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb378ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3741f1f20 0x7fb374151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb371d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 0x7fb374150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb371d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 0x7fb374150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48978/0 (socket says 172.21.15.123:48978) 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb371d9b640 1 -- 172.21.15.123:0/483383245 learned_addr learned my addr 172.21.15.123:0/483383245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb37415bf60 con 0x7fb3740c8400 2024-09-19T09:45:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb37415bc80 con 0x7fb3741f1f20 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740ce430 con 0x7fb3740c7f40 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb37259c640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3740c7f40 0x7fb3740c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb372d9d640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3741f1f20 0x7fb374151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb371d9b640 1 -- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3740c7f40 msgr2=0x7fb3740c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.356+0000 7fb371d9b640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3740c7f40 0x7fb3740c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb371d9b640 1 -- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3741f1f20 msgr2=0x7fb374151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb371d9b640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3741f1f20 0x7fb374151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb371d9b640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740c4b10 con 0x7fb3740c8400 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb372d9d640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3741f1f20 0x7fb374151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb37259c640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3740c7f40 0x7fb3740c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb371d9b640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 0x7fb374150ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb36800e8d0 tx=0x7fb36800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368017070 con 0x7fb3740c8400 2024-09-19T09:45:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36800c8e0 con 0x7fb3740c8400 2024-09-19T09:45:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36800ccb0 con 0x7fb3740c8400 2024-09-19T09:45:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3740c4db0 con 0x7fb3740c8400 2024-09-19T09:45:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.357+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3741e74f0 con 0x7fb3740c8400 2024-09-19T09:45:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.358+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3740ca0f0 con 0x7fb3740c8400 2024-09-19T09:45:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.359+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb36801a070 con 0x7fb3740c8400 2024-09-19T09:45:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.360+0000 7fb362ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb35406c330 0x7fb35406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.360+0000 7fb37259c640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb35406c330 0x7fb35406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.360+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb36808b190 con 0x7fb3740c8400 2024-09-19T09:45:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.361+0000 7fb37259c640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb35406c330 0x7fb35406e7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb364034000 tx=0x7fb36402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:44.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.364+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb3740ca0f0 con 0x7fb3740c8400 2024-09-19T09:45:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.603+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb3740d0460 con 0x7fb3740c8400 2024-09-19T09:45:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.604+0000 7fb362ffd640 1 -- 172.21.15.123:0/483383245 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb368059280 con 0x7fb3740c8400 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.606+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb35406c330 msgr2=0x7fb35406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb35406c330 0x7fb35406e7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb364034000 tx=0x7fb36402e000 comp rx=0 tx=0).stop 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 msgr2=0x7fb374150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 0x7fb374150ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb36800e8d0 tx=0x7fb36800ed90 comp rx=0 tx=0).stop 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 shutdown_connections 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3741f1f20 0x7fb374151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3740c8400 0x7fb374150ff0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb35406c330 0x7fb35406e7f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 --2- 172.21.15.123:0/483383245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3740c7f40 0x7fb3740c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 >> 172.21.15.123:0/483383245 conn(0x7fb3740cd5c0 msgr2=0x7fb374072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:44.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 shutdown_connections 2024-09-19T09:45:44.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:44.607+0000 7fb378ffd640 1 -- 172.21.15.123:0/483383245 wait complete. 2024-09-19T09:45:44.620 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:45:54.622 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:45:54.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:54.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.767+0000 7fc57be96640 1 Processor -- start 2024-09-19T09:45:54.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.767+0000 7fc57be96640 1 -- start start 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57be96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574152e00 0x7fc57415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57be96640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc57406de20 0x7fc5741598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57be96640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc574159e10 con 0x7fc574073260 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57be96640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc57415c440 con 0x7fc57406de20 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57be96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc57415ca00 con 0x7fc574152e00 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57a433640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc574073260 0x7fc5740c5e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51808/0 (socket says 172.21.15.123:51808) 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc57a433640 1 -- 172.21.15.123:0/1159906311 learned_addr learned my addr 172.21.15.123:0/1159906311 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:54.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc579431640 1 --2- 172.21.15.123:0/1159906311 >> v2:172.21.15.194:3300/0 conn(0x7fc57406de20 0x7fc5741598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.768+0000 7fc579c32640 1 --2- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574152e00 0x7fc57415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.769+0000 7fc578c30640 1 -- 172.21.15.123:0/1159906311 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021126667 0 0) 0x7fc56c001490 con 0x7fc574073260 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.769+0000 7fc578c30640 1 -- 172.21.15.123:0/1159906311 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc560003520 con 0x7fc574073260 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.769+0000 7fc579431640 1 -- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574152e00 msgr2=0x7fc57415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.769+0000 7fc579431640 1 --2- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574152e00 0x7fc57415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.769+0000 7fc579431640 1 -- 172.21.15.123:0/1159906311 >> v1:172.21.15.123:6789/0 conn(0x7fc574073260 legacy=0x7fc5740c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:54.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.769+0000 7fc579431640 1 -- 172.21.15.123:0/1159906311 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5740c8700 con 0x7fc57406de20 2024-09-19T09:45:54.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.770+0000 7fc579431640 1 --2- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc5741598d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5640097a0 tx=0x7fc56402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1504c1cc028bc02e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:54.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.770+0000 7fc578c30640 1 -- 172.21.15.123:0/1159906311 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564037070 con 0x7fc57406de20 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.770+0000 7fc578c30640 1 -- 172.21.15.123:0/1159906311 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc564032440 con 0x7fc57406de20 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.770+0000 7fc578c30640 1 -- 172.21.15.123:0/1159906311 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564032810 con 0x7fc57406de20 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 -- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 msgr2=0x7fc5741598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 --2- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc5741598d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5640097a0 tx=0x7fc56402a210 comp rx=0 tx=0).stop 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 -- 172.21.15.123:0/1159906311 shutdown_connections 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 --2- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc5741598d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 --2- 172.21.15.123:0/1159906311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574152e00 0x7fc57415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 -- 172.21.15.123:0/1159906311 >> 172.21.15.123:0/1159906311 conn(0x7fc5740ce9b0 msgr2=0x7fc5740ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 -- 172.21.15.123:0/1159906311 shutdown_connections 2024-09-19T09:45:54.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.771+0000 7fc57be96640 1 -- 172.21.15.123:0/1159906311 wait complete. 2024-09-19T09:45:54.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.773+0000 7fc57be96640 1 Processor -- start 2024-09-19T09:45:54.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.773+0000 7fc57be96640 1 -- start start 2024-09-19T09:45:54.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.774+0000 7fc57be96640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc57415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:54.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.774+0000 7fc57be96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574073260 0x7fc574158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:54.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.774+0000 7fc57be96640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 0x7fc574158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57be96640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740c8cc0 con 0x7fc574152e00 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57be96640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc57415d3d0 con 0x7fc57406de20 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57be96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc57415c690 con 0x7fc574073260 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 0x7fc574158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc579431640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574073260 0x7fc574158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc579c32640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc57415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 0x7fc574158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57372/0 (socket says 172.21.15.123:57372) 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 -- 172.21.15.123:0/559919650 learned_addr learned my addr 172.21.15.123:0/559919650 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 -- 172.21.15.123:0/559919650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574073260 msgr2=0x7fc574158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574073260 0x7fc574158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 -- 172.21.15.123:0/559919650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 msgr2=0x7fc57415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:54.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc57415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 -- 172.21.15.123:0/559919650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5741531e0 con 0x7fc574152e00 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.775+0000 7fc57a433640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 0x7fc574158dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00cde0 tx=0x7fc56c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.776+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c017070 con 0x7fc574152e00 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.776+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5741eed10 con 0x7fc574152e00 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.776+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc574157db0 con 0x7fc574152e00 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.776+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c00ace0 con 0x7fc574152e00 2024-09-19T09:45:54.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.776+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c012600 con 0x7fc574152e00 2024-09-19T09:45:54.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.777+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c005290 con 0x7fc574152e00 2024-09-19T09:45:54.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.778+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc56c01a070 con 0x7fc574152e00 2024-09-19T09:45:54.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.779+0000 7fc56a7fc640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55806c2b0 0x7fc55806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:54.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.779+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc56c08b250 con 0x7fc574152e00 2024-09-19T09:45:54.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.779+0000 7fc579c32640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55806c2b0 0x7fc55806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:54.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.779+0000 7fc579c32640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55806c2b0 0x7fc55806e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc570009b40 tx=0x7fc570009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:54.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:54.787+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc574159e10 con 0x7fc574152e00 2024-09-19T09:45:55.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.189+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc55c005580 con 0x7fc574152e00 2024-09-19T09:45:55.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.189+0000 7fc56a7fc640 1 -- 172.21.15.123:0/559919650 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fc56c0592e0 con 0x7fc574152e00 2024-09-19T09:45:55.192 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55806c2b0 msgr2=0x7fc55806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55806c2b0 0x7fc55806e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc570009b40 tx=0x7fc570009190 comp rx=0 tx=0).stop 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 msgr2=0x7fc574158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 0x7fc574158dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00cde0 tx=0x7fc56c00a430 comp rx=0 tx=0).stop 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 shutdown_connections 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc574152e00 0x7fc574158dd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55806c2b0 0x7fc55806e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc574073260 0x7fc574158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 --2- 172.21.15.123:0/559919650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc57406de20 0x7fc57415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 >> 172.21.15.123:0/559919650 conn(0x7fc5740ce9b0 msgr2=0x7fc5740cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 shutdown_connections 2024-09-19T09:45:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.192+0000 7fc57be96640 1 -- 172.21.15.123:0/559919650 wait complete. 2024-09-19T09:45:55.208 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:45:55.208 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:45:55.209 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:45:55.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:45:55.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.309+0000 7f4d3f63c640 1 Processor -- start 2024-09-19T09:45:55.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.309+0000 7f4d3f63c640 1 -- start start 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3f63c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d38071910 0x7f4d3815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3f63c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d380c0760 0x7f4d3815f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3f63c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3815e790 con 0x7f4d381552b0 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3f63c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4d3815f6c0 con 0x7f4d38071910 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3f63c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4d380cdf00 con 0x7f4d380c0760 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3cbd7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d38071910 0x7f4d3815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3cbd7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d38071910 0x7f4d3815ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57380/0 (socket says 172.21.15.123:57380) 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.310+0000 7f4d3d3d8640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4d381552b0 0x7f4d3806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51820/0 (socket says 172.21.15.123:51820) 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/4218791303 learned_addr learned my addr 172.21.15.123:0/4218791303 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d3dbd9640 1 --2- 172.21.15.123:0/4218791303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d380c0760 0x7f4d3815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/4218791303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d380c0760 msgr2=0x7f4d3815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d3cbd7640 1 --2- 172.21.15.123:0/4218791303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d380c0760 0x7f4d3815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/4218791303 >> v1:172.21.15.123:6789/0 conn(0x7f4d381552b0 legacy=0x7f4d3806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d2ffff640 1 -- 172.21.15.123:0/4218791303 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562150582 0 0) 0x7f4d3815e790 con 0x7f4d381552b0 2024-09-19T09:45:55.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.311+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/4218791303 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d380cdc20 con 0x7f4d38071910 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.312+0000 7f4d3cbd7640 1 --2- 172.21.15.123:0/4218791303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38071910 0x7f4d3815ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009870 tx=0x7f4d2802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7f5c4bfd0f06af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.312+0000 7f4d2ffff640 1 -- 172.21.15.123:0/4218791303 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28037070 con 0x7f4d38071910 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.312+0000 7f4d2ffff640 1 -- 172.21.15.123:0/4218791303 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2802ae50 con 0x7f4d38071910 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.312+0000 7f4d2ffff640 1 -- 172.21.15.123:0/4218791303 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28032860 con 0x7f4d38071910 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 -- 172.21.15.123:0/4218791303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38071910 msgr2=0x7f4d3815ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/4218791303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38071910 0x7f4d3815ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009870 tx=0x7f4d2802a300 comp rx=0 tx=0).stop 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 -- 172.21.15.123:0/4218791303 shutdown_connections 2024-09-19T09:45:55.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/4218791303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d380c0760 0x7f4d3815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/4218791303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38071910 0x7f4d3815ec40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 -- 172.21.15.123:0/4218791303 >> 172.21.15.123:0/4218791303 conn(0x7f4d3806daa0 msgr2=0x7f4d3806de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 -- 172.21.15.123:0/4218791303 shutdown_connections 2024-09-19T09:45:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.313+0000 7f4d3f63c640 1 -- 172.21.15.123:0/4218791303 wait complete. 2024-09-19T09:45:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.315+0000 7f4d3f63c640 1 Processor -- start 2024-09-19T09:45:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.315+0000 7f4d3f63c640 1 -- start start 2024-09-19T09:45:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3f63c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d38071910 0x7f4d381f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3f63c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 0x7f4d381579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3f63c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d381552b0 0x7f4d38158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3f63c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380ca2e0 con 0x7f4d380c0760 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3f63c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380ca000 con 0x7f4d38071910 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3f63c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4d38155690 con 0x7f4d381552b0 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 0x7f4d381579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3d3d8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d38071910 0x7f4d381f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 0x7f4d381579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57392/0 (socket says 172.21.15.123:57392) 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/3671456561 learned_addr learned my addr 172.21.15.123:0/3671456561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3dbd9640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d381552b0 0x7f4d38158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d381552b0 msgr2=0x7f4d38158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d381552b0 0x7f4d38158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d38071910 msgr2=0x7f4d381f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d38071910 0x7f4d381f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3cbd7640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d381f1fb0 con 0x7f4d380c0760 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.316+0000 7f4d3d3d8640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d38071910 0x7f4d381f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.317+0000 7f4d3cbd7640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 0x7f4d381579d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4d28035040 tx=0x7f4d280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.317+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28037040 con 0x7f4d380c0760 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.317+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d28004230 con 0x7f4d380c0760 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.317+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28003610 con 0x7f4d380c0760 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.317+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3815b030 con 0x7f4d380c0760 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.317+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d380ccff0 con 0x7f4d380c0760 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.318+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 0x7f4d381f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.318+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38157390 con 0x7f4d38155eb0 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.318+0000 7f4d3d3d8640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 0x7f4d381f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.319+0000 7f4d3d3d8640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d3815b2f0 con 0x7f4d38155eb0 2024-09-19T09:45:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.319+0000 7f4d3d3d8640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 0x7f4d381f45e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.319+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400f9b0 con 0x7f4d38155eb0 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.319+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4d2803a070 con 0x7f4d380c0760 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.319+0000 7f4d2dffb640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d1c06c1e0 0x7f4d1c06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f4d280aba30 con 0x7f4d380c0760 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d3dbd9640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d1c06c1e0 0x7f4d1c06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4d34018070 con 0x7f4d38155eb0 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 msgr2=0x7f4d381f45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d2dffb640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 0x7f4d381f45e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34001c50 comp rx=0 tx=0).stop 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 msgr2=0x7f4d381f45e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d2dffb640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d38155eb0 0x7f4d381f45e0 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34001c50 comp rx=0 tx=0).stop 2024-09-19T09:45:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.320+0000 7f4d3dbd9640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d1c06c1e0 0x7f4d1c06e6a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d3815a9b0 tx=0x7f4d3000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.331+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 0x7f4d381f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.331+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381f5470 con 0x7f4d381f4b20 2024-09-19T09:45:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.331+0000 7f4d3d3d8640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 0x7f4d381f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d3d3d8640 1 -- 172.21.15.123:0/3671456561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4d3815b790 con 0x7f4d381f4b20 2024-09-19T09:45:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d3d3d8640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 0x7f4d381f4f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34013600 con 0x7f4d381f4b20 2024-09-19T09:45:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5200 (secure 0 0 0) 0x7f4d34013600 con 0x7f4d381f4b20 2024-09-19T09:45:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 msgr2=0x7f4d381f4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 14, 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 220902, 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:55.335 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.336 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:55.338 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.339 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.340 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.342 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:55.343 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.344 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.345 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.346 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:45:55.347 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.348 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:55.349 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d2dffb640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 0x7f4d381f4f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34007f90 comp rx=0 tx=0).stop 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d2dffb640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 msgr2=0x7f4d381f4f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.332+0000 7f4d2dffb640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d381f4b20 0x7f4d381f4f30 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34007f90 comp rx=0 tx=0).stop 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d1c06c1e0 msgr2=0x7f4d1c06e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4d1c06c1e0 0x7f4d1c06e6a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d3815a9b0 tx=0x7f4d3000b040 comp rx=0 tx=0).stop 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3dbd9640 1 -- 172.21.15.123:0/3671456561 reap_dead start 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 msgr2=0x7f4d381579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 0x7f4d381579d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4d28035040 tx=0x7f4d280046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 shutdown_connections 2024-09-19T09:45:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 --2- 172.21.15.123:0/3671456561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d380c0760 0x7f4d381579d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.333+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 >> 172.21.15.123:0/3671456561 conn(0x7f4d3806daa0 msgr2=0x7f4d381e4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.335+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 shutdown_connections 2024-09-19T09:45:55.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.335+0000 7f4d3f63c640 1 -- 172.21.15.123:0/3671456561 wait complete. 2024-09-19T09:45:55.352 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:55.352 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:45:55.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:45:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.452+0000 7f4af27a6640 1 Processor -- start 2024-09-19T09:45:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.452+0000 7f4af27a6640 1 -- start start 2024-09-19T09:45:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4af27a6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4af27a6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4aec0cafa0 0x7f4aec158640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4af27a6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec15b930 con 0x7f4aec06f830 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4af27a6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f4aec0c9d70 con 0x7f4aec0cafa0 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4af27a6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec0ca050 con 0x7f4aec06f450 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4aeb7fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4aec06f830 0x7f4aec15b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:53404/0 (socket says 172.21.15.123:53404) 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4aebfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4aeb7fe640 1 -- 172.21.15.123:0/1592781230 learned_addr learned my addr 172.21.15.123:0/1592781230 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.453+0000 7f4af0d43640 1 --2- 172.21.15.123:0/1592781230 >> v2:172.21.15.194:3300/0 conn(0x7f4aec0cafa0 0x7f4aec158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.454+0000 7f4af0d43640 1 -- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 msgr2=0x7f4aec0c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.454+0000 7f4af0d43640 1 --2- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec0c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.454+0000 7f4af0d43640 1 -- 172.21.15.123:0/1592781230 >> v1:172.21.15.194:6789/0 conn(0x7f4aec06f830 legacy=0x7f4aec15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.454+0000 7f4aeaffd640 1 -- 172.21.15.123:0/1592781230 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067960075 0 0) 0x7f4aec15b930 con 0x7f4aec06f830 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.454+0000 7f4af0d43640 1 -- 172.21.15.123:0/1592781230 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec15e790 con 0x7f4aec0cafa0 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.454+0000 7f4aebfff640 1 --2- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.455+0000 7f4af0d43640 1 --2- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0cafa0 0x7f4aec158640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009d90 tx=0x7f4ae402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47bdd431e075fafe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.455+0000 7f4aeaffd640 1 -- 172.21.15.123:0/1592781230 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4007740 con 0x7f4aec0cafa0 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.455+0000 7f4aeaffd640 1 -- 172.21.15.123:0/1592781230 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae40078e0 con 0x7f4aec0cafa0 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.455+0000 7f4aeaffd640 1 -- 172.21.15.123:0/1592781230 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4007cb0 con 0x7f4aec0cafa0 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 -- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0cafa0 msgr2=0x7f4aec158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 --2- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0cafa0 0x7f4aec158640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009d90 tx=0x7f4ae402a660 comp rx=0 tx=0).stop 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 -- 172.21.15.123:0/1592781230 shutdown_connections 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 --2- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec0cafa0 0x7f4aec158640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 --2- 172.21.15.123:0/1592781230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 -- 172.21.15.123:0/1592781230 >> 172.21.15.123:0/1592781230 conn(0x7f4aec0713d0 msgr2=0x7f4aec0cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 -- 172.21.15.123:0/1592781230 shutdown_connections 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.456+0000 7f4af27a6640 1 -- 172.21.15.123:0/1592781230 wait complete. 2024-09-19T09:45:55.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.458+0000 7f4af27a6640 1 Processor -- start 2024-09-19T09:45:55.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.458+0000 7f4af27a6640 1 -- start start 2024-09-19T09:45:55.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af27a6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec1f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af27a6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec06f830 0x7f4aec1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af27a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 0x7f4aec0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af27a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15f030 con 0x7f4aec0cafa0 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af27a6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15ed50 con 0x7f4aec06f830 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af27a6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec0cb410 con 0x7f4aec06f450 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af0d43640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 0x7f4aec0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af0d43640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 0x7f4aec0c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57434/0 (socket says 172.21.15.123:57434) 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4af0d43640 1 -- 172.21.15.123:0/2685032282 learned_addr learned my addr 172.21.15.123:0/2685032282 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4aebfff640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec1f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.459+0000 7f4aeb7fe640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec06f830 0x7f4aec1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af0d43640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 msgr2=0x7f4aec1f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af0d43640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aec06f450 0x7f4aec1f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af0d43640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec06f830 msgr2=0x7f4aec1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af0d43640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec06f830 0x7f4aec1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af0d43640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec1f0b30 con 0x7f4aec0cafa0 2024-09-19T09:45:55.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af0d43640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 0x7f4aec0c8350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009d90 tx=0x7f4ae4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae403f070 con 0x7f4aec0cafa0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4031c40 con 0x7f4aec0cafa0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4009450 con 0x7f4aec0cafa0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec1f1080 con 0x7f4aec0cafa0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.460+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1f0da0 con 0x7f4aec0cafa0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.461+0000 7f4af27a6640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 0x7f4aec0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.461+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15f550 con 0x7f4aec153c50 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.461+0000 7f4aebfff640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 0x7f4aec0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4aebfff640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4aec0ce0b0 con 0x7f4aec153c50 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4aebfff640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 0x7f4aec0c8890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0118e0 tx=0x7f4adc011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00fc20 con 0x7f4aec153c50 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4adc00fdc0 con 0x7f4aec153c50 2024-09-19T09:45:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 msgr2=0x7f4aec0c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 0x7f4aec0c8890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0118e0 tx=0x7f4adc011da0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 msgr2=0x7f4aec0c8890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec153c50 0x7f4aec0c8890 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0118e0 tx=0x7f4adc011da0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.462+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ae4003990 con 0x7f4aec0cafa0 2024-09-19T09:45:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.463+0000 7f4ae8ff9640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4ad806bd90 0x7f4ad806e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.463+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f4ae40ac200 con 0x7f4aec0cafa0 2024-09-19T09:45:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.463+0000 7f4aebfff640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4ad806bd90 0x7f4ad806e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.464+0000 7f4aebfff640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4ad806bd90 0x7f4ad806e250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4adc000c00 tx=0x7f4adc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.474+0000 7f4af27a6640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 0x7f4aec1f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.474+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1f3c40 con 0x7f4aec1505e0 2024-09-19T09:45:55.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.475+0000 7f4aeb7fe640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 0x7f4aec1f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.475+0000 7f4aeb7fe640 1 -- 172.21.15.123:0/2685032282 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4aec152fb0 con 0x7f4aec1505e0 2024-09-19T09:45:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.475+0000 7f4aeb7fe640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 0x7f4aec1f3700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0c8f20 tx=0x7f4ae0001990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.475+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000f5e0 con 0x7f4aec1505e0 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f4ae000f5e0 con 0x7f4aec1505e0 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 msgr2=0x7f4aec1f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4ae8ff9640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 0x7f4aec1f3700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0c8f20 tx=0x7f4ae0001990 comp rx=0 tx=0).stop 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4ae8ff9640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 msgr2=0x7f4aec1f3700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 14, 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 16549, 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:55.483 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:55.484 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.485 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.486 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:55.487 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.488 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.489 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:55.490 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.491 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:55.492 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4ae8ff9640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aec1505e0 0x7f4aec1f3700 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4ad806bd90 msgr2=0x7f4ad806e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4ad806bd90 0x7f4ad806e250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4adc000c00 tx=0x7f4adc008030 comp rx=0 tx=0).stop 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af0d43640 1 -- 172.21.15.123:0/2685032282 reap_dead start 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 msgr2=0x7f4aec0c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 0x7f4aec0c8350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009d90 tx=0x7f4ae4004a40 comp rx=0 tx=0).stop 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 shutdown_connections 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 --2- 172.21.15.123:0/2685032282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aec0cafa0 0x7f4aec0c8350 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 >> 172.21.15.123:0/2685032282 conn(0x7f4aec0713d0 msgr2=0x7f4aec0ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 shutdown_connections 2024-09-19T09:45:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.476+0000 7f4af27a6640 1 -- 172.21.15.123:0/2685032282 wait complete. 2024-09-19T09:45:55.495 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:55.495 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:45:55.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:45:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.594+0000 7f92c5d5b640 1 Processor -- start 2024-09-19T09:45:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.594+0000 7f92c5d5b640 1 -- start start 2024-09-19T09:45:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.594+0000 7f92c5d5b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92c00c3bd0 0x7f92c006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92c5d5b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92c015c460 0x7f92c006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92c5d5b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c0153540 con 0x7f92c0153160 2024-09-19T09:45:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92c5d5b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f92c00ca880 con 0x7f92c015c460 2024-09-19T09:45:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92c5d5b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f92c006ecd0 con 0x7f92c00c3bd0 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92c015c460 0x7f92c006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92c015c460 0x7f92c006f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57436/0 (socket says 172.21.15.123:57436) 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 -- 172.21.15.123:0/1005604049 learned_addr learned my addr 172.21.15.123:0/1005604049 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92beffd640 1 --2- 172.21.15.123:0/1005604049 >> v2:172.21.15.194:3300/0 conn(0x7f92c00c3bd0 0x7f92c006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 -- 172.21.15.123:0/1005604049 >> v2:172.21.15.194:3300/0 conn(0x7f92c00c3bd0 msgr2=0x7f92c006f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 --2- 172.21.15.123:0/1005604049 >> v2:172.21.15.194:3300/0 conn(0x7f92c00c3bd0 0x7f92c006f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 -- 172.21.15.123:0/1005604049 >> v1:172.21.15.194:6789/0 conn(0x7f92c0153160 legacy=0x7f92c00caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92bffff640 1 -- 172.21.15.123:0/1005604049 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c006dfc0 con 0x7f92c015c460 2024-09-19T09:45:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.595+0000 7f92beffd640 1 --2- 172.21.15.123:0/1005604049 >> v2:172.21.15.194:3300/0 conn(0x7f92c00c3bd0 0x7f92c006f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.596+0000 7f92bffff640 1 --2- 172.21.15.123:0/1005604049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c006f720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92c00c6040 tx=0x7f92b802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92409ba356540953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.596+0000 7f92be7fc640 1 -- 172.21.15.123:0/1005604049 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8036070 con 0x7f92c015c460 2024-09-19T09:45:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.596+0000 7f92be7fc640 1 -- 172.21.15.123:0/1005604049 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b8031600 con 0x7f92c015c460 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.596+0000 7f92be7fc640 1 -- 172.21.15.123:0/1005604049 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80319d0 con 0x7f92c015c460 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1005604049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 msgr2=0x7f92c006f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1005604049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c006f720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92c00c6040 tx=0x7f92b802a730 comp rx=0 tx=0).stop 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1005604049 shutdown_connections 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1005604049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c006f720 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1005604049 >> v2:172.21.15.194:3300/0 conn(0x7f92c00c3bd0 0x7f92c006f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1005604049 >> 172.21.15.123:0/1005604049 conn(0x7f92c00713d0 msgr2=0x7f92c00cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1005604049 shutdown_connections 2024-09-19T09:45:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.597+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1005604049 wait complete. 2024-09-19T09:45:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.598+0000 7f92c5d5b640 1 Processor -- start 2024-09-19T09:45:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.598+0000 7f92c5d5b640 1 -- start start 2024-09-19T09:45:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92c5d5b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00c3bd0 0x7f92c014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92c5d5b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c0153160 0x7f92c01f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92c5d5b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c00cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92c5d5b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f92c00caad0 con 0x7f92c015c460 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92c5d5b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f92c006e580 con 0x7f92c0153160 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92c5d5b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f92c00ca3c0 con 0x7f92c00c3bd0 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c00cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c00cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57438/0 (socket says 172.21.15.123:57438) 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 -- 172.21.15.123:0/1336606262 learned_addr learned my addr 172.21.15.123:0/1336606262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92beffd640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c0153160 0x7f92c01f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bf7fe640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00c3bd0 0x7f92c014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00c3bd0 msgr2=0x7f92c014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00c3bd0 0x7f92c014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c0153160 msgr2=0x7f92c01f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c0153160 0x7f92c01f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.599+0000 7f92bffff640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c00cc250 con 0x7f92c015c460 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.600+0000 7f92bffff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c00cdac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009f10 tx=0x7f92b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.600+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8036030 con 0x7f92c015c460 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.600+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b8040070 con 0x7f92c015c460 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.600+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c006bfe0 con 0x7f92c015c460 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.600+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c01f4b70 con 0x7f92c015c460 2024-09-19T09:45:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.600+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8009510 con 0x7f92c015c460 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.601+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 0x7f92c00ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.601+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f92c00c9670 con 0x7f92c00ce000 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.601+0000 7f92bf7fe640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 0x7f92c00ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.602+0000 7f92bf7fe640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92c01f4d40 con 0x7f92c00ce000 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.602+0000 7f92bf7fe640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 0x7f92c00ce3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e420 tx=0x7f92b000e8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.602+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b00052e0 con 0x7f92c00ce000 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.602+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f92b8007c00 con 0x7f92c015c460 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f92a006c1b0 0x7f92a006e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f92b80abbc0 con 0x7f92c015c460 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92beffd640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f92a006c1b0 0x7f92a006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f92b0018070 con 0x7f92c00ce000 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 msgr2=0x7f92c00ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 0x7f92c00ce3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e420 tx=0x7f92b000e8e0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 msgr2=0x7f92c00ce3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:55.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.603+0000 7f92b7fff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c00ce000 0x7f92c00ce3e0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e420 tx=0x7f92b000e8e0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.604+0000 7f92beffd640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f92a006c1b0 0x7f92a006e670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f92c006be10 tx=0x7f92a8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.614+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 0x7f92c014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.614+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f92c00c9f90 con 0x7f92c014d400 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.615+0000 7f92bf7fe640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 0x7f92c014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.615+0000 7f92bf7fe640 1 -- 172.21.15.123:0/1336606262 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92c0156890 con 0x7f92c014d400 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.615+0000 7f92bf7fe640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 0x7f92c014d810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92b000ee30 tx=0x7f92b0000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.615+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003a00 con 0x7f92c014d400 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f92b0003a00 con 0x7f92c014d400 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 msgr2=0x7f92c014d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92b7fff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 0x7f92c014d810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92b000ee30 tx=0x7f92b0000ed0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92b7fff640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 msgr2=0x7f92c014d810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:45:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92b7fff640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c014d400 0x7f92c014d810 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92b000ee30 tx=0x7f92b0000ed0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.619 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:45:55.619 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:55.619 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:55.619 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:45:55.619 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 14, 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 221146, 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:45:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:45:55.623 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:45:55.624 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.625 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:45:55.626 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.627 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.628 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.629 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.630 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.631 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:45:55.632 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:45:55.633 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:45:55.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f92a006c1b0 msgr2=0x7f92a006e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f92a006c1b0 0x7f92a006e670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f92c006be10 tx=0x7f92a8009190 comp rx=0 tx=0).stop 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 msgr2=0x7f92c00cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 --2- 172.21.15.123:0/1336606262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92c015c460 0x7f92c00cdac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009f10 tx=0x7f92b8004a40 comp rx=0 tx=0).stop 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92bffff640 1 -- 172.21.15.123:0/1336606262 reap_dead start 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92bffff640 1 -- 172.21.15.123:0/1336606262 reap_dead start 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 shutdown_connections 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 >> 172.21.15.123:0/1336606262 conn(0x7f92c00713d0 msgr2=0x7f92c006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 shutdown_connections 2024-09-19T09:45:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.616+0000 7f92c5d5b640 1 -- 172.21.15.123:0/1336606262 wait complete. 2024-09-19T09:45:55.635 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:45:55.636 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-19T09:45:55.636 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:45:55.636 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-19T09:45:55.636 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-19T09:45:55.636 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T09:45:55.636 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:45:55.653 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T09:45:55.653 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:45:55.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.773+0000 7f6404596640 1 Processor -- start 2024-09-19T09:45:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.773+0000 7f6404596640 1 -- start start 2024-09-19T09:45:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6404596640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f63fc0c7f40 0x7f63fc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6404596640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc15c240 con 0x7f63fc155650 2024-09-19T09:45:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6404596640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc155a30 con 0x7f63fc0c8400 2024-09-19T09:45:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6404596640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc15b3e0 con 0x7f63fc0c7f40 2024-09-19T09:45:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6402332640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f63fc155650 0x7f63fc0cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51828/0 (socket says 172.21.15.123:51828) 2024-09-19T09:45:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6402332640 1 -- 172.21.15.123:0/3213427449 learned_addr learned my addr 172.21.15.123:0/3213427449 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401b31640 1 --2- 172.21.15.123:0/3213427449 >> v2:172.21.15.194:3300/0 conn(0x7f63fc0c7f40 0x7f63fc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401330640 1 -- 172.21.15.123:0/3213427449 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898354682 0 0) 0x7f63fc15c240 con 0x7f63fc155650 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401330640 1 -- 172.21.15.123:0/3213427449 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e8003520 con 0x7f63fc155650 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401b31640 1 -- 172.21.15.123:0/3213427449 >> v1:172.21.15.194:6789/0 conn(0x7f63fc0c8400 legacy=0x7f63fc165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401330640 1 -- 172.21.15.123:0/3213427449 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944523430 0 0) 0x7f63fc155a30 con 0x7f63fc0c8400 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401b31640 1 -- 172.21.15.123:0/3213427449 >> v1:172.21.15.123:6789/0 conn(0x7f63fc155650 legacy=0x7f63fc0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.774+0000 7f6401b31640 1 -- 172.21.15.123:0/3213427449 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc15b6c0 con 0x7f63fc0c7f40 2024-09-19T09:45:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.775+0000 7f6401b31640 1 --2- 172.21.15.123:0/3213427449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c7f40 0x7f63fc0cb7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097a0 tx=0x7f63ec02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3284795a64651ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.775+0000 7f6401330640 1 -- 172.21.15.123:0/3213427449 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec037070 con 0x7f63fc0c7f40 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.775+0000 7f6401330640 1 -- 172.21.15.123:0/3213427449 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec02ac30 con 0x7f63fc0c7f40 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.775+0000 7f6401330640 1 -- 172.21.15.123:0/3213427449 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8001670 con 0x7f63fc0c7f40 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 -- 172.21.15.123:0/3213427449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c7f40 msgr2=0x7f63fc0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 --2- 172.21.15.123:0/3213427449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c7f40 0x7f63fc0cb7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097a0 tx=0x7f63ec02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 -- 172.21.15.123:0/3213427449 shutdown_connections 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 --2- 172.21.15.123:0/3213427449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c7f40 0x7f63fc0cb7f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 -- 172.21.15.123:0/3213427449 >> 172.21.15.123:0/3213427449 conn(0x7f63fc0cd5c0 msgr2=0x7f63fc0cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 -- 172.21.15.123:0/3213427449 shutdown_connections 2024-09-19T09:45:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.776+0000 7f6404596640 1 -- 172.21.15.123:0/3213427449 wait complete. 2024-09-19T09:45:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.777+0000 7f6404596640 1 Processor -- start 2024-09-19T09:45:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.777+0000 7f6404596640 1 -- start start 2024-09-19T09:45:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6404596640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63fc0c7f40 0x7f63fc151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6404596640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c8400 0x7f63fc0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6404596640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 0x7f63fc1e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6404596640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc15bf60 con 0x7f63fc155650 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6404596640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc15bc80 con 0x7f63fc0c8400 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6404596640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc0ce430 con 0x7f63fc0c7f40 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6402332640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63fc0c7f40 msgr2=0x7f63fc151380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6402332640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63fc0c7f40 0x7f63fc151380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6402b33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 0x7f63fc1e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6402b33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 0x7f63fc1e3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57442/0 (socket says 172.21.15.123:57442) 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6401b31640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c8400 0x7f63fc0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.778+0000 7f6402b33640 1 -- 172.21.15.123:0/1423290856 learned_addr learned my addr 172.21.15.123:0/1423290856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6402b33640 1 -- 172.21.15.123:0/1423290856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63fc0c7f40 msgr2=0x7f63fc151380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6402b33640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63fc0c7f40 0x7f63fc151380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6402b33640 1 -- 172.21.15.123:0/1423290856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c8400 msgr2=0x7f63fc0c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6402b33640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c8400 0x7f63fc0c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6402b33640 1 -- 172.21.15.123:0/1423290856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc0c7600 con 0x7f63fc155650 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6402b33640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 0x7f63fc1e3d70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c7e0 tx=0x7f63f400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4017070 con 0x7f63fc155650 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc0c6550 con 0x7f63fc155650 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f4003dc0 con 0x7f63fc155650 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40052b0 con 0x7f63fc155650 2024-09-19T09:45:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.779+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc0c6b10 con 0x7f63fc155650 2024-09-19T09:45:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.780+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc073060 con 0x7f63fc155650 2024-09-19T09:45:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.781+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f63f401a070 con 0x7f63fc155650 2024-09-19T09:45:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.781+0000 7f63f2ffd640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f63e006c260 0x7f63e006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.781+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f63f408ab40 con 0x7f63fc155650 2024-09-19T09:45:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.781+0000 7f6402332640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f63e006c260 0x7f63e006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.782+0000 7f6402332640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f63e006c260 0x7f63e006e720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f63f80010e0 tx=0x7f63f8001600 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:55.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:55.786+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f63fc073060 con 0x7f63fc155650 2024-09-19T09:45:56.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.026+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f63fc0d0460 con 0x7f63fc155650 2024-09-19T09:45:56.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.026+0000 7f63f2ffd640 1 -- 172.21.15.123:0/1423290856 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f63f4058b60 con 0x7f63fc155650 2024-09-19T09:45:56.028 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:56.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f63e006c260 msgr2=0x7f63e006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:56.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f63e006c260 0x7f63e006e720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f63f80010e0 tx=0x7f63f8001600 comp rx=0 tx=0).stop 2024-09-19T09:45:56.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 msgr2=0x7f63fc1e3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 0x7f63fc1e3d70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c7e0 tx=0x7f63f400cca0 comp rx=0 tx=0).stop 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 shutdown_connections 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc155650 0x7f63fc1e3d70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63fc0c8400 0x7f63fc0c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f63e006c260 0x7f63e006e720 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.028+0000 7f6404596640 1 --2- 172.21.15.123:0/1423290856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63fc0c7f40 0x7f63fc151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.029+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 >> 172.21.15.123:0/1423290856 conn(0x7f63fc0cd5c0 msgr2=0x7f63fc152410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.029+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 shutdown_connections 2024-09-19T09:45:56.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:56.029+0000 7f6404596640 1 -- 172.21.15.123:0/1423290856 wait complete. 2024-09-19T09:45:59.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:45:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.141+0000 7f7f0a2a5640 1 Processor -- start 2024-09-19T09:45:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.141+0000 7f7f0a2a5640 1 -- start start 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f0a2a5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7f040c57a0 0x7f7f0415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f0a2a5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f040c6470 0x7f7f040cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f0a2a5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0415eb10 con 0x7f7f040cbb10 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f0a2a5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0415c1e0 con 0x7f7f040c6470 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f0a2a5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7f040c9d50 con 0x7f7f040c57a0 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f040c6470 0x7f7f040cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f040c6470 0x7f7f040cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57444/0 (socket says 172.21.15.123:57444) 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 -- 172.21.15.123:0/360902479 learned_addr learned my addr 172.21.15.123:0/360902479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f03fff640 1 --2- 172.21.15.123:0/360902479 >> v2:172.21.15.194:3300/0 conn(0x7f7f040c57a0 0x7f7f0415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 -- 172.21.15.123:0/360902479 >> v2:172.21.15.194:3300/0 conn(0x7f7f040c57a0 msgr2=0x7f7f0415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 --2- 172.21.15.123:0/360902479 >> v2:172.21.15.194:3300/0 conn(0x7f7f040c57a0 0x7f7f0415bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 -- 172.21.15.123:0/360902479 >> v1:172.21.15.194:6789/0 conn(0x7f7f040cbb10 legacy=0x7f7f040ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.142+0000 7f7f037fe640 1 -- 172.21.15.123:0/360902479 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0415edf0 con 0x7f7f040c6470 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.143+0000 7f7f037fe640 1 --2- 172.21.15.123:0/360902479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040c6470 0x7f7f040cb5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7f04074270 tx=0x7f7eec02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07e57a64b629dec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.143+0000 7f7f02ffd640 1 -- 172.21.15.123:0/360902479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec037070 con 0x7f7f040c6470 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.143+0000 7f7f02ffd640 1 -- 172.21.15.123:0/360902479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec02ae50 con 0x7f7f040c6470 2024-09-19T09:45:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.143+0000 7f7f02ffd640 1 -- 172.21.15.123:0/360902479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec032860 con 0x7f7f040c6470 2024-09-19T09:45:59.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/360902479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040c6470 msgr2=0x7f7f040cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/360902479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040c6470 0x7f7f040cb5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7f04074270 tx=0x7f7eec02a300 comp rx=0 tx=0).stop 2024-09-19T09:45:59.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/360902479 shutdown_connections 2024-09-19T09:45:59.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/360902479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040c6470 0x7f7f040cb5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/360902479 >> v2:172.21.15.194:3300/0 conn(0x7f7f040c57a0 0x7f7f0415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/360902479 >> 172.21.15.123:0/360902479 conn(0x7f7f04070df0 msgr2=0x7f7f040711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:59.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/360902479 shutdown_connections 2024-09-19T09:45:59.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.144+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/360902479 wait complete. 2024-09-19T09:45:59.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.145+0000 7f7f0a2a5640 1 Processor -- start 2024-09-19T09:45:59.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.145+0000 7f7f0a2a5640 1 -- start start 2024-09-19T09:45:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f0a2a5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f040c57a0 0x7f7f041f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f0a2a5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f040c6470 0x7f7f041f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f0a2a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 0x7f7f041f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f0a2a5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0415f690 con 0x7f7f040cbb10 2024-09-19T09:45:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f0a2a5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0415f3b0 con 0x7f7f040c57a0 2024-09-19T09:45:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f0a2a5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0415e7b0 con 0x7f7f040c6470 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f037fe640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f040c6470 msgr2=0x7f7f041f27b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 0x7f7f041f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f040c6470 0x7f7f041f27b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 0x7f7f041f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57452/0 (socket says 172.21.15.123:57452) 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 -- 172.21.15.123:0/3037767179 learned_addr learned my addr 172.21.15.123:0/3037767179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f03fff640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f040c57a0 0x7f7f041f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 -- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f040c6470 msgr2=0x7f7f041f27b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f040c6470 0x7f7f041f27b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 -- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f040c57a0 msgr2=0x7f7f041f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f040c57a0 0x7f7f041f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 -- 172.21.15.123:0/3037767179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f041f57c0 con 0x7f7f040cbb10 2024-09-19T09:45:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.146+0000 7f7f08842640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 0x7f7f041f5280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c6e0 tx=0x7f7efc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.147+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc003b70 con 0x7f7f040cbb10 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.147+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc003d30 con 0x7f7f040cbb10 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.147+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc005310 con 0x7f7f040cbb10 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.147+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0406e490 con 0x7f7f040cbb10 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.147+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f041f1450 con 0x7f7f040cbb10 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.148+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f040c8ad0 con 0x7f7f040cbb10 2024-09-19T09:45:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.148+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7efc0054b0 con 0x7f7f040cbb10 2024-09-19T09:45:59.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.149+0000 7f7f00ff9640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ee406c260 0x7f7ee406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:59.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.149+0000 7f7f03fff640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ee406c260 0x7f7ee406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:59.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.149+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7efc08b380 con 0x7f7f040cbb10 2024-09-19T09:45:59.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.149+0000 7f7f03fff640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ee406c260 0x7f7ee406e720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009ad0 tx=0x7f7ef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:59.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.153+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7f040c8ad0 con 0x7f7f040cbb10 2024-09-19T09:45:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.393+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f040c5b80 con 0x7f7f040cbb10 2024-09-19T09:45:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.394+0000 7f7f00ff9640 1 -- 172.21.15.123:0/3037767179 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f7f041f57c0 con 0x7f7f040cbb10 2024-09-19T09:45:59.396 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ee406c260 msgr2=0x7f7ee406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ee406c260 0x7f7ee406e720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009ad0 tx=0x7f7ef4008040 comp rx=0 tx=0).stop 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 msgr2=0x7f7f041f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 0x7f7f041f5280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c6e0 tx=0x7f7efc00cba0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 shutdown_connections 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f040cbb10 0x7f7f041f5280 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ee406c260 0x7f7ee406e720 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f040c6470 0x7f7f041f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 --2- 172.21.15.123:0/3037767179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f040c57a0 0x7f7f041f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 >> 172.21.15.123:0/3037767179 conn(0x7f7f04070df0 msgr2=0x7f7f040c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 shutdown_connections 2024-09-19T09:45:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:45:59.396+0000 7f7f0a2a5640 1 -- 172.21.15.123:0/3037767179 wait complete. 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:45:59.661 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-09-19T09:45:59.662 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:45:59.665 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:45:59.689 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:45:59.691 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:45:59.691 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:46:00.333 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:46:00.411 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:46:00.452 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:46:00.470 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:46:00.471 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:46:00.499 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:46:00.500 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:46:00.500 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:46:00.576 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-19T09:46:00.577 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-19T09:46:00.578 DEBUG:teuthology.orchestra.run.smithi123:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T09:46:00.639 INFO:tasks.workunit.client.0.smithi123.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T09:46:00.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-19T09:46:00.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ trap -- retry EXIT 2024-09-19T09:46:00.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -rf ffsb 2024-09-19T09:46:00.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-19T09:46:00.643 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into 'ffsb'... 2024-09-19T09:46:01.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:46:01.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:46:02.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:02.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.506+0000 7fb30c5e8640 1 Processor -- start 2024-09-19T09:46:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.506+0000 7fb30c5e8640 1 -- start start 2024-09-19T09:46:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.506+0000 7fb30c5e8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb304153240 0x7fb304073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30c5e8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304068490 0x7fb304067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30c5e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb304067e90 0x7fb30406be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30c5e8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb304072310 con 0x7fb304067e90 2024-09-19T09:46:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30c5e8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb3040c7dd0 con 0x7fb304153240 2024-09-19T09:46:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30c5e8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb3040c8090 con 0x7fb304068490 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb304067e90 0x7fb30406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb309b83640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304068490 msgr2=0x7fb304067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb309b83640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304068490 0x7fb304067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb304067e90 0x7fb30406be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57464/0 (socket says 172.21.15.123:57464) 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 -- 172.21.15.123:0/2142365401 learned_addr learned my addr 172.21.15.123:0/2142365401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30a384640 1 --2- 172.21.15.123:0/2142365401 >> v2:172.21.15.194:3300/0 conn(0x7fb304153240 0x7fb304073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 -- 172.21.15.123:0/2142365401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304068490 msgr2=0x7fb304067950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 --2- 172.21.15.123:0/2142365401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304068490 0x7fb304067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 -- 172.21.15.123:0/2142365401 >> v2:172.21.15.194:3300/0 conn(0x7fb304153240 msgr2=0x7fb304073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 --2- 172.21.15.123:0/2142365401 >> v2:172.21.15.194:3300/0 conn(0x7fb304153240 0x7fb304073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.507+0000 7fb30ab85640 1 -- 172.21.15.123:0/2142365401 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30415d010 con 0x7fb304067e90 2024-09-19T09:46:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb30ab85640 1 --2- 172.21.15.123:0/2142365401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304067e90 0x7fb30406be50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb304075a00 tx=0x7fb2f402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba64eba485c4176f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb309382640 1 -- 172.21.15.123:0/2142365401 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4037070 con 0x7fb304067e90 2024-09-19T09:46:02.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb309382640 1 -- 172.21.15.123:0/2142365401 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4032440 con 0x7fb304067e90 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb309382640 1 -- 172.21.15.123:0/2142365401 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4032810 con 0x7fb304067e90 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb30c5e8640 1 -- 172.21.15.123:0/2142365401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304067e90 msgr2=0x7fb30406be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/2142365401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304067e90 0x7fb30406be50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb304075a00 tx=0x7fb2f402a160 comp rx=0 tx=0).stop 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb30c5e8640 1 -- 172.21.15.123:0/2142365401 shutdown_connections 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/2142365401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304067e90 0x7fb30406be50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.508+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/2142365401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304068490 0x7fb304067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.509+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/2142365401 >> v2:172.21.15.194:3300/0 conn(0x7fb304153240 0x7fb304073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.509+0000 7fb30c5e8640 1 -- 172.21.15.123:0/2142365401 >> 172.21.15.123:0/2142365401 conn(0x7fb3040cdbd0 msgr2=0x7fb3040cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.509+0000 7fb30c5e8640 1 -- 172.21.15.123:0/2142365401 shutdown_connections 2024-09-19T09:46:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.509+0000 7fb30c5e8640 1 -- 172.21.15.123:0/2142365401 wait complete. 2024-09-19T09:46:02.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.510+0000 7fb30c5e8640 1 Processor -- start 2024-09-19T09:46:02.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.510+0000 7fb30c5e8640 1 -- start start 2024-09-19T09:46:02.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.511+0000 7fb30c5e8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304067e90 0x7fb30415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.511+0000 7fb30c5e8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb304068490 0x7fb304158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.511+0000 7fb30c5e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 0x7fb304158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.511+0000 7fb30c5e8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb304072840 con 0x7fb304153240 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.511+0000 7fb30c5e8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb304072560 con 0x7fb304068490 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.511+0000 7fb30c5e8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb304153620 con 0x7fb304067e90 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30a384640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304067e90 msgr2=0x7fb30415a060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30a384640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304067e90 0x7fb30415a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 0x7fb304158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 0x7fb304158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57466/0 (socket says 172.21.15.123:57466) 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 -- 172.21.15.123:0/1081520125 learned_addr learned my addr 172.21.15.123:0/1081520125 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb309b83640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb304068490 0x7fb304158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 -- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304067e90 msgr2=0x7fb30415a060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304067e90 0x7fb30415a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 -- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb304068490 msgr2=0x7fb304158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb304068490 0x7fb304158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 -- 172.21.15.123:0/1081520125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb304156d10 con 0x7fb304153240 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30ab85640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 0x7fb304158fc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40090b0 tx=0x7fb2f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4041020 con 0x7fb304153240 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f403d620 con 0x7fb304153240 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4037040 con 0x7fb304153240 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041f2e20 con 0x7fb304153240 2024-09-19T09:46:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.512+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041562d0 con 0x7fb304153240 2024-09-19T09:46:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.514+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30406d200 con 0x7fb304153240 2024-09-19T09:46:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.514+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb2f4044020 con 0x7fb304153240 2024-09-19T09:46:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.514+0000 7fb302ffd640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb2f006c260 0x7fb2f006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.514+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb2f40abb60 con 0x7fb304153240 2024-09-19T09:46:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.514+0000 7fb30a384640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb2f006c260 0x7fb2f006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.515+0000 7fb30a384640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb2f006c260 0x7fb2f006e720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009b10 tx=0x7fb2fc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.519+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb2f404b030 con 0x7fb304153240 2024-09-19T09:46:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.860+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb3040cc450 con 0x7fb304153240 2024-09-19T09:46:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.860+0000 7fb302ffd640 1 -- 172.21.15.123:0/1081520125 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb2f407a260 con 0x7fb304153240 2024-09-19T09:46:02.863 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb2f006c260 msgr2=0x7fb2f006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb2f006c260 0x7fb2f006e720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009b10 tx=0x7fb2fc00b040 comp rx=0 tx=0).stop 2024-09-19T09:46:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 msgr2=0x7fb304158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 0x7fb304158fc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40090b0 tx=0x7fb2f40046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 shutdown_connections 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb304153240 0x7fb304158fc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb304068490 0x7fb304158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb2f006c260 0x7fb2f006e720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 --2- 172.21.15.123:0/1081520125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb304067e90 0x7fb30415a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 >> 172.21.15.123:0/1081520125 conn(0x7fb3040cdbd0 msgr2=0x7fb30406bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 shutdown_connections 2024-09-19T09:46:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:02.862+0000 7fb30c5e8640 1 -- 172.21.15.123:0/1081520125 wait complete. 2024-09-19T09:46:03.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ trap - EXIT 2024-09-19T09:46:03.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd ffsb 2024-09-19T09:46:03.043 INFO:tasks.workunit.client.0.smithi123.stderr:+ ./configure 2024-09-19T09:46:04.191 INFO:tasks.workunit.client.0.smithi123.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T09:46:05.198 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether build environment is sane... yes 2024-09-19T09:46:05.208 INFO:tasks.workunit.client.0.smithi123.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T09:46:05.208 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gawk... gawk 2024-09-19T09:46:05.224 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T09:46:05.258 INFO:tasks.workunit.client.0.smithi123.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T09:46:05.258 INFO:tasks.workunit.client.0.smithi123.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T09:46:05.269 INFO:tasks.workunit.client.0.smithi123.stdout:checking for style of include used by make... GNU 2024-09-19T09:46:05.273 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc... gcc 2024-09-19T09:46:05.325 INFO:tasks.workunit.client.0.smithi123.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:46:05.329 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether the C compiler works... yes 2024-09-19T09:46:05.329 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether we are cross compiling... no 2024-09-19T09:46:05.365 INFO:tasks.workunit.client.0.smithi123.stdout:checking for suffix of executables... 2024-09-19T09:46:05.394 INFO:tasks.workunit.client.0.smithi123.stdout:checking for suffix of object files... o 2024-09-19T09:46:05.421 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:46:05.449 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:46:05.517 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:46:05.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.972+0000 7fd5f7b8d640 1 Processor -- start 2024-09-19T09:46:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.972+0000 7fd5f7b8d640 1 -- start start 2024-09-19T09:46:05.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f7b8d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 0x7fd5f0158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f7b8d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f7b8d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f00c6ce0 con 0x7fd5f0073840 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f7b8d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f00c61f0 con 0x7fd5f00c4720 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f7b8d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f00c4290 con 0x7fd5f01531e0 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f5929640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 msgr2=0x7fd5f0158e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f5929640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 0x7fd5f0158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f5128640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f612a640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd5f0073840 0x7fd5f006c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:51234/0 (socket says 172.21.15.123:51234) 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f5128640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:37400/0 (socket says 172.21.15.123:37400) 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.973+0000 7fd5f612a640 1 -- 172.21.15.123:0/2447619535 learned_addr learned my addr 172.21.15.123:0/2447619535 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.974+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.974+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.974+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:05.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:05.974+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.174+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 msgr2=0x7fd5f0158e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.174+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 0x7fd5f0158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:46:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.175+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.175+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.175+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.175+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.175+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:46:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.575+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 msgr2=0x7fd5f0158e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.575+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 0x7fd5f0158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:46:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.576+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.576+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.576+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.576+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:06.576+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:46:07.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.376+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 msgr2=0x7fd5f0158e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:07.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.376+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 0x7fd5f0158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:46:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.377+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.378+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.378+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.378+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:07.378+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 msgr2=0x7fd5f0158e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f01531e0 0x7fd5f0158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 msgr2=0x7fd5f0073300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.194:3300/0 conn(0x7fd5f00c4720 0x7fd5f0073300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 -- 172.21.15.123:0/2447619535 >> v1:172.21.15.194:6789/0 conn(0x7fd5f0073840 legacy=0x7fd5f006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 -- 172.21.15.123:0/2447619535 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f00c4b20 con 0x7fd5dc006240 2024-09-19T09:46:08.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5ef7fe640 1 -- 172.21.15.123:0/2447619535 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f00c61f0 con 0x7fd5dc0036e0 2024-09-19T09:46:08.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.973+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:08.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.974+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:08.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.974+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:08.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.974+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:08.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:08.974+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.175+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.175+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.175+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.175+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.175+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:46:09.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.576+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.576+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:09.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.576+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:09.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.576+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:09.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.576+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:46:09.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.974+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051086154 0 0) 0x7fd5f00c4b20 con 0x7fd5dc006240 2024-09-19T09:46:09.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.974+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d8003520 con 0x7fd5dc006240 2024-09-19T09:46:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3018689129 0 0) 0x7fd5d8003520 con 0x7fd5dc006240 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 msgr2=0x7fd5dc005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 --2- 172.21.15.123:0/2447619535 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc0036e0 0x7fd5dc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc00afe0 con 0x7fd5dc006240 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fd5e400d580 con 0x7fd5dc006240 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 >> v1:172.21.15.123:6789/0 conn(0x7fd5dc006240 legacy=0x7fd5dc008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f612a640 1 -- 172.21.15.123:0/2447619535 reap_dead start 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80039b0 0x7fd5d8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8004800 0x7fd5d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d8005210 0x7fd5d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f00c61f0 con 0x7fd5d8004800 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d800c140 con 0x7fd5d8005210 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d8010750 con 0x7fd5d80039b0 2024-09-19T09:46:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f5929640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80039b0 msgr2=0x7fd5d8003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f5929640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80039b0 0x7fd5d8003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8004800 0x7fd5d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.976+0000 7fd5f612a640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d8005210 0x7fd5d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.977+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80039b0 msgr2=0x7fd5d8003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.977+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80039b0 0x7fd5d8003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.977+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d8005210 msgr2=0x7fd5d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.977+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d8005210 0x7fd5d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.977+0000 7fd5f5128640 1 -- 172.21.15.123:0/2447619535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d8003520 con 0x7fd5d8004800 2024-09-19T09:46:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.978+0000 7fd5f5128640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8004800 0x7fd5d8004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4006fd0 tx=0x7fd5d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba708c177c3b51b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:09.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.979+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4039070 con 0x7fd5d8004800 2024-09-19T09:46:09.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.979+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e4034410 con 0x7fd5d8004800 2024-09-19T09:46:09.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.979+0000 7fd5f4927640 1 -- 172.21.15.123:0/2447619535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400dd30 con 0x7fd5d8004800 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/2447619535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8004800 msgr2=0x7fd5d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8004800 0x7fd5d8004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4006fd0 tx=0x7fd5d8005830 comp rx=0 tx=0).stop 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/2447619535 shutdown_connections 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d8005210 0x7fd5d800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8004800 0x7fd5d8004c80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/2447619535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80039b0 0x7fd5d8003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/2447619535 >> 172.21.15.123:0/2447619535 conn(0x7fd5f006ec90 msgr2=0x7fd5f006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/2447619535 shutdown_connections 2024-09-19T09:46:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.980+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/2447619535 wait complete. 2024-09-19T09:46:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 Processor -- start 2024-09-19T09:46:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 -- start start 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80039b0 0x7fd5f0157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d8004800 0x7fd5f0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 0x7fd5f0071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f00c6a00 con 0x7fd5d8005210 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f00c6720 con 0x7fd5d80039b0 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.982+0000 7fd5f7b8d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f00c3f20 con 0x7fd5d8004800 2024-09-19T09:46:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f5128640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d8004800 msgr2=0x7fd5f0071990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 0x7fd5f0071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f5128640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d8004800 0x7fd5f0071990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 0x7fd5f0071ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38758/0 (socket says 172.21.15.123:38758) 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 -- 172.21.15.123:0/1714721002 learned_addr learned my addr 172.21.15.123:0/1714721002 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f5929640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80039b0 0x7fd5f0157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 -- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d8004800 msgr2=0x7fd5f0071990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d8004800 0x7fd5f0071990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 -- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80039b0 msgr2=0x7fd5f0157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80039b0 0x7fd5f0157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 -- 172.21.15.123:0/1714721002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f0072610 con 0x7fd5d8005210 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f612a640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 0x7fd5f0071ed0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc006120 tx=0x7fd5e80015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80049f0 con 0x7fd5d8005210 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8004b90 con 0x7fd5d8005210 2024-09-19T09:46:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f01ed630 con 0x7fd5d8005210 2024-09-19T09:46:09.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.983+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8005030 con 0x7fd5d8005210 2024-09-19T09:46:09.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.984+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f0071470 con 0x7fd5d8005210 2024-09-19T09:46:09.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.985+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f01529a0 con 0x7fd5d8005210 2024-09-19T09:46:09.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.986+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5e80051d0 con 0x7fd5d8005210 2024-09-19T09:46:09.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.986+0000 7fd5ee7fc640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd5dc06cb60 0x7fd5dc06f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:09.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.986+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fd5e808ad00 con 0x7fd5d8005210 2024-09-19T09:46:09.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.986+0000 7fd5f5929640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd5dc06cb60 0x7fd5dc06f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:09.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.987+0000 7fd5f5929640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd5dc06cb60 0x7fd5dc06f020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0003cb0 tx=0x7fd5e0007760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:09.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:09.993+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd5f01529a0 con 0x7fd5d8005210 2024-09-19T09:46:10.007 INFO:tasks.workunit.client.0.smithi123.stdout:checking dependency style of gcc... gcc3 2024-09-19T09:46:10.216 INFO:tasks.workunit.client.0.smithi123.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:46:10.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.232+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd5f00c3a00 con 0x7fd5d8005210 2024-09-19T09:46:10.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.232+0000 7fd5ee7fc640 1 -- 172.21.15.123:0/1714721002 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fd5e801b060 con 0x7fd5d8005210 2024-09-19T09:46:10.234 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd5dc06cb60 msgr2=0x7fd5dc06f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd5dc06cb60 0x7fd5dc06f020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0003cb0 tx=0x7fd5e0007760 comp rx=0 tx=0).stop 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 msgr2=0x7fd5f0071ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 0x7fd5f0071ed0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc006120 tx=0x7fd5e80015d0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 shutdown_connections 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5d8005210 0x7fd5f0071ed0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd5dc06cb60 0x7fd5dc06f020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d8004800 0x7fd5f0071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 --2- 172.21.15.123:0/1714721002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80039b0 0x7fd5f0157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 >> 172.21.15.123:0/1714721002 conn(0x7fd5f006ec90 msgr2=0x7fd5f014d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:10.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 shutdown_connections 2024-09-19T09:46:10.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.235+0000 7fd5f7b8d640 1 -- 172.21.15.123:0/1714721002 wait complete. 2024-09-19T09:46:10.249 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:46:10.249 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:46:10.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:46:10.254 INFO:tasks.workunit.client.0.smithi123.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:46:10.256 INFO:tasks.workunit.client.0.smithi123.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:46:10.264 INFO:tasks.workunit.client.0.smithi123.stdout:checking for AIX... no 2024-09-19T09:46:10.282 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc... (cached) gcc 2024-09-19T09:46:10.290 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:46:10.291 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:46:10.291 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:46:10.291 INFO:tasks.workunit.client.0.smithi123.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T09:46:10.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.350+0000 7f8da0eaf640 1 Processor -- start 2024-09-19T09:46:10.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.351+0000 7f8da0eaf640 1 -- start start 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8da0eaf640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8d9c155540 0x7f8d9c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8da0eaf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d9c0c6ab0 0x7f8d9c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8da0eaf640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c073170 0x7f8d9c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8da0eaf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8d9c070f20 con 0x7f8d9c0c6ab0 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8da0eaf640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f8d9c0caed0 con 0x7f8d9c155540 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8da0eaf640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c0ca910 con 0x7f8d9c073170 2024-09-19T09:46:10.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d9ad9d640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c073170 msgr2=0x7f8d9c0735c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:10.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d9ad9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c073170 0x7f8d9c0735c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:10.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d9c0c6ab0 0x7f8d9c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d9c0c6ab0 0x7f8d9c0709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38772/0 (socket says 172.21.15.123:38772) 2024-09-19T09:46:10.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 -- 172.21.15.123:0/547821472 learned_addr learned my addr 172.21.15.123:0/547821472 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:10.355 INFO:tasks.workunit.client.0.smithi123.stdout:checking for main in -lm... yes 2024-09-19T09:46:10.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d9a59c640 1 --2- 172.21.15.123:0/547821472 >> v2:172.21.15.194:3300/0 conn(0x7f8d9c155540 0x7f8d9c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 -- 172.21.15.123:0/547821472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c073170 msgr2=0x7f8d9c0735c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:10.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 --2- 172.21.15.123:0/547821472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c073170 0x7f8d9c0735c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 -- 172.21.15.123:0/547821472 >> v2:172.21.15.194:3300/0 conn(0x7f8d9c155540 msgr2=0x7f8d9c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:10.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 --2- 172.21.15.123:0/547821472 >> v2:172.21.15.194:3300/0 conn(0x7f8d9c155540 0x7f8d9c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.352+0000 7f8d93fff640 1 -- 172.21.15.123:0/547821472 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c0cabf0 con 0x7f8d9c0c6ab0 2024-09-19T09:46:10.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.353+0000 7f8d93fff640 1 --2- 172.21.15.123:0/547821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c0709e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c071c60 tx=0x7f8d8402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f698718f4a536e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.353+0000 7f8d99d9b640 1 -- 172.21.15.123:0/547821472 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84037070 con 0x7f8d9c0c6ab0 2024-09-19T09:46:10.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.353+0000 7f8d99d9b640 1 -- 172.21.15.123:0/547821472 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d84032440 con 0x7f8d9c0c6ab0 2024-09-19T09:46:10.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.353+0000 7f8d99d9b640 1 -- 172.21.15.123:0/547821472 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84032810 con 0x7f8d9c0c6ab0 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 -- 172.21.15.123:0/547821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0c6ab0 msgr2=0x7f8d9c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/547821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c0709e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c071c60 tx=0x7f8d8402a200 comp rx=0 tx=0).stop 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 -- 172.21.15.123:0/547821472 shutdown_connections 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/547821472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c073170 0x7f8d9c0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/547821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c0709e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/547821472 >> v2:172.21.15.194:3300/0 conn(0x7f8d9c155540 0x7f8d9c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 -- 172.21.15.123:0/547821472 >> 172.21.15.123:0/547821472 conn(0x7f8d9c0ce9a0 msgr2=0x7f8d9c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 -- 172.21.15.123:0/547821472 shutdown_connections 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.354+0000 7f8da0eaf640 1 -- 172.21.15.123:0/547821472 wait complete. 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.355+0000 7f8da0eaf640 1 Processor -- start 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.355+0000 7f8da0eaf640 1 -- start start 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8da0eaf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c073170 0x7f8d9c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8da0eaf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c1f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8da0eaf640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c155540 0x7f8d9c1f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8da0eaf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c0c6590 con 0x7f8d9c073170 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8da0eaf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c0c62b0 con 0x7f8d9c0c6ab0 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8da0eaf640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c0c5ad0 con 0x7f8d9c155540 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c073170 0x7f8d9c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c073170 0x7f8d9c14b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38782/0 (socket says 172.21.15.123:38782) 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 -- 172.21.15.123:0/740252079 learned_addr learned my addr 172.21.15.123:0/740252079 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9ad9d640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c155540 msgr2=0x7f8d9c1f16e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9ad9d640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c155540 0x7f8d9c1f16e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d93fff640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c1f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c155540 msgr2=0x7f8d9c1f16e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d9c155540 0x7f8d9c1f16e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d9c0c6ab0 msgr2=0x7f8d9c1f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c1f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c158a30 con 0x7f8d9c073170 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d93fff640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d9c0c6ab0 0x7f8d9c1f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.356+0000 7f8d9a59c640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c073170 0x7f8d9c14b350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00e9e0 tx=0x7f8d8c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.357+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c017070 con 0x7f8d9c073170 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.357+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8c00c9d0 con 0x7f8d9c073170 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.357+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c158100 con 0x7f8d9c073170 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.357+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00cdc0 con 0x7f8d9c073170 2024-09-19T09:46:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.357+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c1f4f00 con 0x7f8d9c073170 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.358+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 0x7f8d9c1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.358+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c1f0e50 con 0x7f8d9c0ca340 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.358+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d8c01a070 con 0x7f8d9c073170 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.358+0000 7f8d93fff640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 0x7f8d9c1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d93fff640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d9c1f5270 con 0x7f8d9c0ca340 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d7c06c290 0x7f8d7c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f8d8c08b520 con 0x7f8d9c073170 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d9ad9d640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d7c06c290 0x7f8d7c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d93fff640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 0x7f8d9c1491a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c158c10 tx=0x7f8d840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84041070 con 0x7f8d9c0ca340 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d9ad9d640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d7c06c290 0x7f8d7c06e750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d94003cb0 tx=0x7f8d94009270 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8d8403c660 con 0x7f8d9c0ca340 2024-09-19T09:46:10.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 msgr2=0x7f8d9c1491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 0x7f8d9c1491a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c158c10 tx=0x7f8d840046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 msgr2=0x7f8d9c1491a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:10.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.359+0000 7f8d92ffd640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c0ca340 0x7f8d9c1491a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.366+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 0x7f8d9c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.366+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c0c9cf0 con 0x7f8d9c1e4ed0 2024-09-19T09:46:10.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.366+0000 7f8d93fff640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 0x7f8d9c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.366+0000 7f8d93fff640 1 -- 172.21.15.123:0/740252079 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8d9c1528c0 con 0x7f8d9c1e4ed0 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.366+0000 7f8d93fff640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 0x7f8d9c1496e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d84000c00 tx=0x7f8d84008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.366+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84037040 con 0x7f8d9c1e4ed0 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5188 (secure 0 0 0) 0x7f8d8404b070 con 0x7f8d9c1e4ed0 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 msgr2=0x7f8d9c1496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d92ffd640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 0x7f8d9c1496e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d84000c00 tx=0x7f8d84008030 comp rx=0 tx=0).stop 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d92ffd640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 msgr2=0x7f8d9c1496e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d92ffd640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c1e4ed0 0x7f8d9c1496e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:10.369 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 18, 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 235937, 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: 1 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:10.370 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:10.371 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.372 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:10.374 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:10.376 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:10.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:10.380 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.381 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 8 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.382 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.383 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:10.384 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:10.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d7c06c290 msgr2=0x7f8d7c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d7c06c290 0x7f8d7c06e750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d94003cb0 tx=0x7f8d94009270 comp rx=0 tx=0).stop 2024-09-19T09:46:10.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c073170 msgr2=0x7f8d9c14b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 --2- 172.21.15.123:0/740252079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c073170 0x7f8d9c14b350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00e9e0 tx=0x7f8d8c00eea0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d9ad9d640 1 -- 172.21.15.123:0/740252079 reap_dead start 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8d9ad9d640 1 -- 172.21.15.123:0/740252079 reap_dead start 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 shutdown_connections 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 >> 172.21.15.123:0/740252079 conn(0x7f8d9c0ce9a0 msgr2=0x7f8d9c0c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 shutdown_connections 2024-09-19T09:46:10.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.367+0000 7f8da0eaf640 1 -- 172.21.15.123:0/740252079 wait complete. 2024-09-19T09:46:10.386 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:46:10.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-19T09:46:10.387 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:46:10.401 INFO:tasks.workunit.client.0.smithi123.stdout:checking for main in -lpthread... yes 2024-09-19T09:46:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.510+0000 7f62912f1640 1 Processor -- start 2024-09-19T09:46:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.510+0000 7f62912f1640 1 -- start start 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f62912f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 0x7f628c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f62912f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c0c8830 con 0x7f628c06d270 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f62912f1640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c0c8ad0 con 0x7f628c06ce90 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f62912f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f628c0cbc50 con 0x7f628c06ee60 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f628a7fc640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 msgr2=0x7f628c154ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f628b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f628c06d270 0x7f628c0c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34848/0 (socket says 172.21.15.123:34848) 2024-09-19T09:46:10.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f628b7fe640 1 -- 172.21.15.123:0/908739939 learned_addr learned my addr 172.21.15.123:0/908739939 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.511+0000 7f628a7fc640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 0x7f628c154ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723214692 0 0) 0x7f628c0c8830 con 0x7f628c06d270 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6278003520 con 0x7f628c06d270 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768384368 0 0) 0x7f628c0c8ad0 con 0x7f628c06ce90 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f628c0c8830 con 0x7f628c06ce90 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1379411047 0 0) 0x7f6278003520 con 0x7f628c06d270 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 msgr2=0x7f628c154ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 0x7f628c154ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 >> v1:172.21.15.194:6789/0 conn(0x7f628c06ce90 legacy=0x7f628c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c0c8db0 con 0x7f628c06d270 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f627c001690 con 0x7f628c06d270 2024-09-19T09:46:10.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 >> v1:172.21.15.123:6789/0 conn(0x7f628c06d270 legacy=0x7f628c0c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278003b70 0x7f6278003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 0x7f6278004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278004d90 0x7f62780051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f628c0cbc50 con 0x7f6278004d90 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f627800bc00 con 0x7f6278003b70 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f627800be00 con 0x7f628c06ee60 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628a7fc640 1 -- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 msgr2=0x7f6278004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628a7fc640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 0x7f6278004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628b7fe640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278004d90 0x7f62780051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628affd640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278003b70 0x7f6278003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628b7fe640 1 -- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 msgr2=0x7f6278004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628b7fe640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c06ee60 0x7f6278004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628b7fe640 1 -- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278003b70 msgr2=0x7f6278003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628b7fe640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278003b70 0x7f6278003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.512+0000 7f628b7fe640 1 -- 172.21.15.123:0/908739939 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6278003520 con 0x7f6278004d90 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.513+0000 7f628b7fe640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278004d90 0x7f62780051f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f628c06d680 tx=0x7f6278005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2caaf10e6301918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.513+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c007cc0 con 0x7f6278004d90 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.513+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c005af0 con 0x7f6278004d90 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.513+0000 7f6289ffb640 1 -- 172.21.15.123:0/908739939 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c007070 con 0x7f6278004d90 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f62912f1640 1 -- 172.21.15.123:0/908739939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278004d90 msgr2=0x7f62780051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f62912f1640 1 --2- 172.21.15.123:0/908739939 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278004d90 0x7f62780051f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f628c06d680 tx=0x7f6278005830 comp rx=0 tx=0).stop 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f628b7fe640 1 -- 172.21.15.123:0/908739939 reap_dead start 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f62912f1640 1 -- 172.21.15.123:0/908739939 shutdown_connections 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f62912f1640 1 -- 172.21.15.123:0/908739939 >> 172.21.15.123:0/908739939 conn(0x7f628c06fb20 msgr2=0x7f628c06ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f62912f1640 1 -- 172.21.15.123:0/908739939 shutdown_connections 2024-09-19T09:46:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.514+0000 7f62912f1640 1 -- 172.21.15.123:0/908739939 wait complete. 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.515+0000 7f62912f1640 1 Processor -- start 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.515+0000 7f62912f1640 1 -- start start 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f62912f1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278004d90 0x7f628c1e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f62912f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c1f47d0 0x7f628c1e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f62912f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 0x7f628c142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f62912f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f628c0c9090 con 0x7f628c1e7690 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f62912f1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f628c15ebe0 con 0x7f6278004d90 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f62912f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f628c15b200 con 0x7f628c1f47d0 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 0x7f628c142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 0x7f628c142700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38822/0 (socket says 172.21.15.123:38822) 2024-09-19T09:46:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 -- 172.21.15.123:0/3482280523 learned_addr learned my addr 172.21.15.123:0/3482280523 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628affd640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278004d90 0x7f628c1e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628a7fc640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c1f47d0 msgr2=0x7f628c1e7150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c1f47d0 msgr2=0x7f628c1e7150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628a7fc640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c1f47d0 0x7f628c1e7150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f628c1f47d0 0x7f628c1e7150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278004d90 msgr2=0x7f628c1e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6278004d90 0x7f628c1e6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c158a40 con 0x7f628c1e7690 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.516+0000 7f628b7fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 0x7f628c142700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f627c00c160 tx=0x7f628c0c8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.517+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c037040 con 0x7f628c1e7690 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.517+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c041070 con 0x7f628c1e7690 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.517+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c001c20 con 0x7f628c1e7690 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.517+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c157a90 con 0x7f628c1e7690 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.517+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c157d50 con 0x7f628c1e7690 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.518+0000 7f62912f1640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 0x7f628c1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.518+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f628c158780 con 0x7f628c1583a0 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.518+0000 7f628affd640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 0x7f628c1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.518+0000 7f628affd640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f628c0c8280 con 0x7f628c1583a0 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.518+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f627c007270 con 0x7f628c1e7690 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.518+0000 7f628affd640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 0x7f628c1f4bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6284012c00 tx=0x7f6284010610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f626c06c290 0x7f626c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f627c0ab1f0 con 0x7f628c1e7690 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f628a7fc640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f626c06c290 0x7f626c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284019020 con 0x7f628c1583a0 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6284012e70 con 0x7f628c1583a0 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 msgr2=0x7f628c1f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 0x7f628c1f4bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6284012c00 tx=0x7f6284010610 comp rx=0 tx=0).stop 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 msgr2=0x7f628c1f4bd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f62837fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c1583a0 0x7f628c1f4bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.519+0000 7f628a7fc640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f626c06c290 0x7f626c06e750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f628c144110 tx=0x7f6274006d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.525+0000 7f62912f1640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 0x7f628c155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.525+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f628c158c20 con 0x7f628c142c40 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.525+0000 7f628affd640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 0x7f628c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f628affd640 1 -- 172.21.15.123:0/3482280523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f628c0cb870 con 0x7f628c142c40 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f628affd640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 0x7f628c155830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f628401a000 tx=0x7f6284001630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284019030 con 0x7f628c142c40 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f62840055b0 con 0x7f628c142c40 2024-09-19T09:46:10.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 msgr2=0x7f628c155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f62837fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 0x7f628c155830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f628401a000 tx=0x7f6284001630 comp rx=0 tx=0).stop 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f62837fe640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 msgr2=0x7f628c155830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.526+0000 7f62837fe640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f628c142c40 0x7f628c155830 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:46:10.530 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 18, 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 31600, 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: 1 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:10.531 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.532 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:10.533 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:10.534 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:10.535 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:10.536 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:10.537 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.538 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:10.539 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:10.540 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:10.541 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.542 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:10.544 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:10.545 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:10.546 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:10.546 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:10.546 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:10.546 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:10.546 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:10.546 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:10.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f626c06c290 msgr2=0x7f626c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f626c06c290 0x7f626c06e750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f628c144110 tx=0x7f6274006d90 comp rx=0 tx=0).stop 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 msgr2=0x7f628c142700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 0x7f628c142700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f627c00c160 tx=0x7f628c0c8ca0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f628b7fe640 1 -- 172.21.15.123:0/3482280523 reap_dead start 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 shutdown_connections 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 --2- 172.21.15.123:0/3482280523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f628c1e7690 0x7f628c142700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 >> 172.21.15.123:0/3482280523 conn(0x7f628c06fb20 msgr2=0x7f628c0c57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 shutdown_connections 2024-09-19T09:46:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:10.527+0000 7f62912f1640 1 -- 172.21.15.123:0/3482280523 wait complete. 2024-09-19T09:46:10.549 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:46:10.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:46:10.568 INFO:tasks.workunit.client.0.smithi123.stdout:checking for ANSI C header files... yes 2024-09-19T09:46:10.623 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T09:46:10.665 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/types.h... yes 2024-09-19T09:46:11.057 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/stat.h... yes 2024-09-19T09:46:11.057 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stdlib.h... yes 2024-09-19T09:46:11.561 INFO:tasks.workunit.client.0.smithi123.stdout:checking for string.h... yes 2024-09-19T09:46:11.607 INFO:tasks.workunit.client.0.smithi123.stdout:checking for memory.h... yes 2024-09-19T09:46:11.652 INFO:tasks.workunit.client.0.smithi123.stdout:checking for strings.h... yes 2024-09-19T09:46:11.696 INFO:tasks.workunit.client.0.smithi123.stdout:checking for inttypes.h... yes 2024-09-19T09:46:11.741 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stdint.h... yes 2024-09-19T09:46:11.789 INFO:tasks.workunit.client.0.smithi123.stdout:checking for unistd.h... yes 2024-09-19T09:46:12.119 INFO:tasks.workunit.client.0.smithi123.stdout:checking pthread.h usability... yes 2024-09-19T09:46:12.139 INFO:tasks.workunit.client.0.smithi123.stdout:checking pthread.h presence... yes 2024-09-19T09:46:12.140 INFO:tasks.workunit.client.0.smithi123.stdout:checking for pthread.h... yes 2024-09-19T09:46:12.192 INFO:tasks.workunit.client.0.smithi123.stdout:checking fcntl.h usability... yes 2024-09-19T09:46:12.210 INFO:tasks.workunit.client.0.smithi123.stdout:checking fcntl.h presence... yes 2024-09-19T09:46:12.210 INFO:tasks.workunit.client.0.smithi123.stdout:checking for fcntl.h... yes 2024-09-19T09:46:12.518 INFO:tasks.workunit.client.0.smithi123.stdout:checking limits.h usability... yes 2024-09-19T09:46:12.539 INFO:tasks.workunit.client.0.smithi123.stdout:checking limits.h presence... yes 2024-09-19T09:46:12.539 INFO:tasks.workunit.client.0.smithi123.stdout:checking for limits.h... yes 2024-09-19T09:46:13.204 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stdint.h... (cached) yes 2024-09-19T09:46:13.244 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/time.h usability... yes 2024-09-19T09:46:13.262 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/time.h presence... yes 2024-09-19T09:46:13.263 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/time.h... yes 2024-09-19T09:46:13.276 INFO:tasks.workunit.client.0.smithi123.stdout:checking for unistd.h... (cached) yes 2024-09-19T09:46:13.331 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/vfs.h usability... yes 2024-09-19T09:46:13.348 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/vfs.h presence... yes 2024-09-19T09:46:13.349 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/vfs.h... yes 2024-09-19T09:46:13.392 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/limits.h usability... no 2024-09-19T09:46:13.410 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/limits.h presence... no 2024-09-19T09:46:13.410 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/limits.h... no 2024-09-19T09:46:13.441 INFO:tasks.workunit.client.0.smithi123.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T09:46:13.471 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T09:46:13.472 INFO:tasks.workunit.client.0.smithi123.stdout:checking for function prototypes... yes 2024-09-19T09:46:13.497 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether setvbuf arguments are reversed... no 2024-09-19T09:46:13.568 INFO:tasks.workunit.client.0.smithi123.stdout:checking for system... yes 2024-09-19T09:46:13.630 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gettimeofday... yes 2024-09-19T09:46:13.690 INFO:tasks.workunit.client.0.smithi123.stdout:checking for mkdir... yes 2024-09-19T09:46:14.003 INFO:tasks.workunit.client.0.smithi123.stdout:checking for strerror... yes 2024-09-19T09:46:14.061 INFO:tasks.workunit.client.0.smithi123.stdout:checking for open64... yes 2024-09-19T09:46:14.119 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stat64... yes 2024-09-19T09:46:14.178 INFO:tasks.workunit.client.0.smithi123.stdout:checking for fseeko64... yes 2024-09-19T09:46:14.235 INFO:tasks.workunit.client.0.smithi123.stdout:checking for lrand48_r... yes 2024-09-19T09:46:14.293 INFO:tasks.workunit.client.0.smithi123.stdout:checking for srand48_r... yes 2024-09-19T09:46:14.315 INFO:tasks.workunit.client.0.smithi123.stdout:configure: creating ./config.status 2024-09-19T09:46:14.404 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: creating Makefile 2024-09-19T09:46:14.417 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: creating config.h 2024-09-19T09:46:14.433 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: executing depfiles commands 2024-09-19T09:46:14.913 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: executing default commands 2024-09-19T09:46:14.960 INFO:tasks.workunit.client.0.smithi123.stderr:+ make 2024-09-19T09:46:14.966 INFO:tasks.workunit.client.0.smithi123.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-19T09:46:14.968 INFO:tasks.workunit.client.0.smithi123.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-19T09:46:14.969 INFO:tasks.workunit.client.0.smithi123.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-19T09:46:14.969 INFO:tasks.workunit.client.0.smithi123.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-19T09:46:14.969 INFO:tasks.workunit.client.0.smithi123.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-19T09:46:14.969 INFO:tasks.workunit.client.0.smithi123.stderr: any GNU archive site. 2024-09-19T09:46:14.971 INFO:tasks.workunit.client.0.smithi123.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-19T09:46:14.972 INFO:tasks.workunit.client.0.smithi123.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-19T09:46:14.973 INFO:tasks.workunit.client.0.smithi123.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-19T09:46:14.973 INFO:tasks.workunit.client.0.smithi123.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-19T09:46:14.973 INFO:tasks.workunit.client.0.smithi123.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-19T09:46:14.973 INFO:tasks.workunit.client.0.smithi123.stderr: Grab them from any GNU archive site. 2024-09-19T09:46:15.072 INFO:tasks.workunit.client.0.smithi123.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-19T09:46:15.403 INFO:tasks.workunit.client.0.smithi123.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-19T09:46:15.404 INFO:tasks.workunit.client.0.smithi123.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-19T09:46:15.404 INFO:tasks.workunit.client.0.smithi123.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-19T09:46:15.404 INFO:tasks.workunit.client.0.smithi123.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-19T09:46:16.244 INFO:tasks.workunit.client.0.smithi123.stdout:/bin/sh ./config.status --recheck 2024-09-19T09:46:16.303 INFO:tasks.workunit.client.0.smithi123.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-19T09:46:16.400 INFO:tasks.workunit.client.0.smithi123.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T09:46:17.406 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether build environment is sane... yes 2024-09-19T09:46:17.412 INFO:tasks.workunit.client.0.smithi123.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T09:46:17.412 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gawk... gawk 2024-09-19T09:46:17.429 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T09:46:17.463 INFO:tasks.workunit.client.0.smithi123.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T09:46:17.463 INFO:tasks.workunit.client.0.smithi123.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T09:46:17.478 INFO:tasks.workunit.client.0.smithi123.stdout:checking for style of include used by make... GNU 2024-09-19T09:46:17.482 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc... gcc 2024-09-19T09:46:17.571 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether the C compiler works... yes 2024-09-19T09:46:17.571 INFO:tasks.workunit.client.0.smithi123.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:46:17.748 INFO:tasks.workunit.client.0.smithi123.stdout:checking for suffix of executables... 2024-09-19T09:46:17.965 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether we are cross compiling... no 2024-09-19T09:46:18.092 INFO:tasks.workunit.client.0.smithi123.stdout:checking for suffix of object files... o 2024-09-19T09:46:18.159 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:46:18.298 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:46:18.338 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:46:18.441 INFO:tasks.workunit.client.0.smithi123.stdout:checking dependency style of gcc... gcc3 2024-09-19T09:46:18.486 INFO:tasks.workunit.client.0.smithi123.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:46:18.535 INFO:tasks.workunit.client.0.smithi123.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:46:18.536 INFO:tasks.workunit.client.0.smithi123.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:46:18.653 INFO:tasks.workunit.client.0.smithi123.stdout:checking for ANSI C header files... yes 2024-09-19T09:46:18.686 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/types.h... yes 2024-09-19T09:46:18.721 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/stat.h... yes 2024-09-19T09:46:18.757 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stdlib.h... yes 2024-09-19T09:46:18.794 INFO:tasks.workunit.client.0.smithi123.stdout:checking for string.h... yes 2024-09-19T09:46:18.830 INFO:tasks.workunit.client.0.smithi123.stdout:checking for memory.h... yes 2024-09-19T09:46:18.867 INFO:tasks.workunit.client.0.smithi123.stdout:checking for strings.h... yes 2024-09-19T09:46:18.903 INFO:tasks.workunit.client.0.smithi123.stdout:checking for inttypes.h... yes 2024-09-19T09:46:18.940 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stdint.h... yes 2024-09-19T09:46:18.979 INFO:tasks.workunit.client.0.smithi123.stdout:checking for unistd.h... yes 2024-09-19T09:46:19.020 INFO:tasks.workunit.client.0.smithi123.stdout:checking minix/config.h usability... no 2024-09-19T09:46:19.048 INFO:tasks.workunit.client.0.smithi123.stdout:checking minix/config.h presence... no 2024-09-19T09:46:19.048 INFO:tasks.workunit.client.0.smithi123.stdout:checking for minix/config.h... no 2024-09-19T09:46:19.335 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-19T09:46:19.335 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc... (cached) gcc 2024-09-19T09:46:19.369 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:46:19.369 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:46:19.369 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:46:19.369 INFO:tasks.workunit.client.0.smithi123.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T09:46:19.412 INFO:tasks.workunit.client.0.smithi123.stdout:checking for main in -lm... yes 2024-09-19T09:46:19.456 INFO:tasks.workunit.client.0.smithi123.stdout:checking for main in -lpthread... yes 2024-09-19T09:46:19.457 INFO:tasks.workunit.client.0.smithi123.stdout:checking for ANSI C header files... (cached) yes 2024-09-19T09:46:19.489 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T09:46:19.538 INFO:tasks.workunit.client.0.smithi123.stdout:checking pthread.h usability... yes 2024-09-19T09:46:19.766 INFO:tasks.workunit.client.0.smithi123.stdout:checking pthread.h presence... yes 2024-09-19T09:46:19.767 INFO:tasks.workunit.client.0.smithi123.stdout:checking for pthread.h... yes 2024-09-19T09:46:19.812 INFO:tasks.workunit.client.0.smithi123.stdout:checking fcntl.h usability... yes 2024-09-19T09:46:20.193 INFO:tasks.workunit.client.0.smithi123.stdout:checking fcntl.h presence... yes 2024-09-19T09:46:20.194 INFO:tasks.workunit.client.0.smithi123.stdout:checking for fcntl.h... yes 2024-09-19T09:46:21.201 INFO:tasks.workunit.client.0.smithi123.stdout:checking limits.h usability... yes 2024-09-19T09:46:21.297 INFO:tasks.workunit.client.0.smithi123.stdout:checking limits.h presence... yes 2024-09-19T09:46:21.297 INFO:tasks.workunit.client.0.smithi123.stdout:checking for limits.h... yes 2024-09-19T09:46:21.316 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stdint.h... (cached) yes 2024-09-19T09:46:21.352 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/time.h usability... yes 2024-09-19T09:46:22.162 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/time.h presence... yes 2024-09-19T09:46:22.163 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/time.h... yes 2024-09-19T09:46:22.187 INFO:tasks.workunit.client.0.smithi123.stdout:checking for unistd.h... (cached) yes 2024-09-19T09:46:22.225 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/vfs.h usability... yes 2024-09-19T09:46:22.244 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/vfs.h presence... yes 2024-09-19T09:46:22.245 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/vfs.h... yes 2024-09-19T09:46:22.293 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/limits.h usability... no 2024-09-19T09:46:22.322 INFO:tasks.workunit.client.0.smithi123.stdout:checking sys/limits.h presence... no 2024-09-19T09:46:22.322 INFO:tasks.workunit.client.0.smithi123.stdout:checking for sys/limits.h... no 2024-09-19T09:46:22.348 INFO:tasks.workunit.client.0.smithi123.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T09:46:22.375 INFO:tasks.workunit.client.0.smithi123.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T09:46:22.428 INFO:tasks.workunit.client.0.smithi123.stdout:checking for system... yes 2024-09-19T09:46:22.481 INFO:tasks.workunit.client.0.smithi123.stdout:checking for gettimeofday... yes 2024-09-19T09:46:22.535 INFO:tasks.workunit.client.0.smithi123.stdout:checking for mkdir... yes 2024-09-19T09:46:22.590 INFO:tasks.workunit.client.0.smithi123.stdout:checking for strerror... yes 2024-09-19T09:46:22.645 INFO:tasks.workunit.client.0.smithi123.stdout:checking for open64... yes 2024-09-19T09:46:22.700 INFO:tasks.workunit.client.0.smithi123.stdout:checking for stat64... yes 2024-09-19T09:46:22.755 INFO:tasks.workunit.client.0.smithi123.stdout:checking for fseeko64... yes 2024-09-19T09:46:22.809 INFO:tasks.workunit.client.0.smithi123.stdout:checking for lrand48_r... yes 2024-09-19T09:46:22.862 INFO:tasks.workunit.client.0.smithi123.stdout:checking for srand48_r... yes 2024-09-19T09:46:22.886 INFO:tasks.workunit.client.0.smithi123.stdout:configure: creating ./config.status 2024-09-19T09:46:22.942 INFO:tasks.workunit.client.0.smithi123.stdout: /bin/sh ./config.status 2024-09-19T09:46:22.986 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: creating Makefile 2024-09-19T09:46:22.998 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: creating config.h 2024-09-19T09:46:23.020 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: executing depfiles commands 2024-09-19T09:46:23.031 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: executing default commands 2024-09-19T09:46:23.052 INFO:tasks.workunit.client.0.smithi123.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-19T09:46:23.196 INFO:tasks.workunit.client.0.smithi123.stdout:rm -f stamp-h1 2024-09-19T09:46:23.198 INFO:tasks.workunit.client.0.smithi123.stdout:touch config.h.in 2024-09-19T09:46:23.199 INFO:tasks.workunit.client.0.smithi123.stdout:cd . && /bin/sh ./config.status config.h 2024-09-19T09:46:23.237 INFO:tasks.workunit.client.0.smithi123.stdout:config.status: creating config.h 2024-09-19T09:46:23.261 INFO:tasks.workunit.client.0.smithi123.stdout:make all-am 2024-09-19T09:46:23.266 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T09:46:23.266 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-19T09:46:23.426 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-19T09:46:23.428 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-19T09:46:23.516 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-19T09:46:23.516 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-19T09:46:23.596 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-19T09:46:23.598 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-19T09:46:23.684 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-19T09:46:23.687 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-19T09:46:23.805 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-19T09:46:23.807 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-19T09:46:23.853 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-19T09:46:23.855 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-19T09:46:23.895 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-19T09:46:23.897 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-19T09:46:23.942 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-19T09:46:23.944 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-19T09:46:24.142 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-19T09:46:24.144 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-19T09:46:24.263 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-19T09:46:24.265 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-19T09:46:24.406 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-19T09:46:24.409 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-19T09:46:24.473 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-19T09:46:24.476 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-19T09:46:24.546 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-19T09:46:24.550 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-19T09:46:24.648 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-19T09:46:24.650 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-19T09:46:24.677 INFO:tasks.workunit.client.0.smithi123.stderr:In file included from parser.h:22, 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: from parser.c:25: 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c: In function ‘init_filesys’: 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.678 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.679 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.680 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.681 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.681 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.681 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.681 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.682 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.682 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.682 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.683 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:46:24.684 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.685 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.686 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.687 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T09:46:24.688 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: | ^ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:46:24.689 INFO:tasks.workunit.client.0.smithi123.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T09:46:24.690 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c: In function ‘get_optstr’: 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:200:14: note: source object declared here 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr: 200 | char temp[BUFSIZE]; 2024-09-19T09:46:24.730 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~ 2024-09-19T09:46:24.737 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c: In function ‘size64_convert’: 2024-09-19T09:46:24.737 INFO:tasks.workunit.client.0.smithi123.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-19T09:46:24.738 INFO:tasks.workunit.client.0.smithi123.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-19T09:46:24.738 INFO:tasks.workunit.client.0.smithi123.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-19T09:46:25.021 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-19T09:46:25.023 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-19T09:46:25.076 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-19T09:46:25.079 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-19T09:46:25.166 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-19T09:46:25.168 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-19T09:46:25.196 INFO:tasks.workunit.client.0.smithi123.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-19T09:46:25.199 INFO:tasks.workunit.client.0.smithi123.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-19T09:46:25.231 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T09:46:25.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd .. 2024-09-19T09:46:25.231 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir tmp 2024-09-19T09:46:25.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd tmp 2024-09-19T09:46:25.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ for f in $mydir/*.ffsb 2024-09-19T09:46:25.233 INFO:tasks.workunit.client.0.smithi123.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-19T09:46:25.234 INFO:tasks.workunit.client.0.smithi123.stdout:FFSB version 6.0-RC2 started 2024-09-19T09:46:25.234 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.236 INFO:tasks.workunit.client.0.smithi123.stdout:benchmark time = 300 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout:ThreadGroup 0 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout:================ 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: num_threads = 32 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: read_random = off 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: read_size = 0 (0B) 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: read_blocksize = 0 (0B) 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: read_skip = off 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: read_skipsize = 0 (0B) 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.237 INFO:tasks.workunit.client.0.smithi123.stdout: write_random = on 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: write_size = 5242880 (5MB) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: fsync_file = 0 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: write_blocksize = 4096 (4KB) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: wait time = 0 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: op weights 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: read = 0 (0.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: readall = 0 (0.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: write = 1 (100.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: create = 0 (0.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: append = 0 (0.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: delete = 0 (0.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: metaop = 0 (0.00%) 2024-09-19T09:46:25.238 INFO:tasks.workunit.client.0.smithi123.stdout: createdir = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: stat = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: writeall = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: writeall_fsync = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: open_close = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: write_fsync = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: create_fsync = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: append_fsync = 0 (0.00%) 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout:FileSystem . 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout:========== 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: num_dirs = 0 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: starting files = 128 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.239 INFO:tasks.workunit.client.0.smithi123.stdout: min file size = 104857600 (100MB) 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: max file size = 104857600 (100MB) 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: directio = off 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: alignedio = on 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: bufferedio = off 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: aging is off 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: current utilization = 0.00% 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:25.240 INFO:tasks.workunit.client.0.smithi123.stdout:checking existing fs: . 2024-09-19T09:46:25.241 INFO:tasks.workunit.client.0.smithi123.stdout:recreating new fileset 2024-09-19T09:46:25.241 INFO:tasks.workunit.client.0.smithi123.stderr:opendir: No such file or directory 2024-09-19T09:46:30.550 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-19T09:46:30.550 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-19T09:46:30.551 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T09:46:30.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T09:46:30.554 INFO:tasks.ceph.mon.c:Started 2024-09-19T09:46:30.555 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:46:30.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.662+0000 7f9f95703640 1 Processor -- start 2024-09-19T09:46:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.662+0000 7f9f95703640 1 -- start start 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f95703640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f90155650 0x7f9f900cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f95703640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f900c7f40 0x7f9f900ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f95703640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9f900c8400 0x7f9f900cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f95703640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9f9015c240 con 0x7f9f900c7f40 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f95703640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9f90155a30 con 0x7f9f900c8400 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f95703640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9f9015b3e0 con 0x7f9f90155650 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f8effd640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f90155650 msgr2=0x7f9f900cc850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f90155650 0x7f9f900cc850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f900c7f40 0x7f9f900ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f900c7f40 0x7f9f900ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56336/0 (socket says 172.21.15.123:56336) 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 -- 172.21.15.123:0/2713900797 learned_addr learned my addr 172.21.15.123:0/2713900797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f8f7fe640 1 --2- 172.21.15.123:0/2713900797 >> v2:172.21.15.194:3300/0 conn(0x7f9f900c8400 0x7f9f900cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 -- 172.21.15.123:0/2713900797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f90155650 msgr2=0x7f9f900cc850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 --2- 172.21.15.123:0/2713900797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f90155650 0x7f9f900cc850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 -- 172.21.15.123:0/2713900797 >> v2:172.21.15.194:3300/0 conn(0x7f9f900c8400 msgr2=0x7f9f900cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 --2- 172.21.15.123:0/2713900797 >> v2:172.21.15.194:3300/0 conn(0x7f9f900c8400 0x7f9f900cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.663+0000 7f9f87fff640 1 -- 172.21.15.123:0/2713900797 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9015b6c0 con 0x7f9f900c7f40 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.664+0000 7f9f87fff640 1 --2- 172.21.15.123:0/2713900797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f900ccd90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f9008e140 tx=0x7f9f7802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4f4777d4808536 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.664+0000 7f9f8e7fc640 1 -- 172.21.15.123:0/2713900797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78037070 con 0x7f9f900c7f40 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.664+0000 7f9f8e7fc640 1 -- 172.21.15.123:0/2713900797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f78032440 con 0x7f9f900c7f40 2024-09-19T09:46:30.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.664+0000 7f9f8e7fc640 1 -- 172.21.15.123:0/2713900797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78032810 con 0x7f9f900c7f40 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 -- 172.21.15.123:0/2713900797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 msgr2=0x7f9f900ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 --2- 172.21.15.123:0/2713900797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f900ccd90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f9008e140 tx=0x7f9f7802a200 comp rx=0 tx=0).stop 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 -- 172.21.15.123:0/2713900797 shutdown_connections 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 --2- 172.21.15.123:0/2713900797 >> v2:172.21.15.194:3300/0 conn(0x7f9f900c8400 0x7f9f900cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 --2- 172.21.15.123:0/2713900797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f900ccd90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 --2- 172.21.15.123:0/2713900797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f90155650 0x7f9f900cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 -- 172.21.15.123:0/2713900797 >> 172.21.15.123:0/2713900797 conn(0x7f9f900cd5c0 msgr2=0x7f9f900cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 -- 172.21.15.123:0/2713900797 shutdown_connections 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.665+0000 7f9f95703640 1 -- 172.21.15.123:0/2713900797 wait complete. 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.666+0000 7f9f95703640 1 Processor -- start 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.666+0000 7f9f95703640 1 -- start start 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f901ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f900c8400 0x7f9f901eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f90155650 0x7f9f901f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9015bf60 con 0x7f9f900c7f40 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9015bc80 con 0x7f9f90155650 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9f900ce430 con 0x7f9f900c8400 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f87fff640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f900c8400 msgr2=0x7f9f901eaf20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f901ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f900c8400 0x7f9f901eaf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f901ea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56348/0 (socket says 172.21.15.123:56348) 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 -- 172.21.15.123:0/68227374 learned_addr learned my addr 172.21.15.123:0/68227374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8f7fe640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f90155650 0x7f9f901f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 -- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f900c8400 msgr2=0x7f9f901eaf20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f900c8400 0x7f9f901eaf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 -- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f90155650 msgr2=0x7f9f901f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f90155650 0x7f9f901f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 -- 172.21.15.123:0/68227374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f900ca070 con 0x7f9f900c7f40 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f8effd640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f901ea9e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000b580 tx=0x7f9f8000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80013020 con 0x7f9f900c7f40 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f80003de0 con 0x7f9f900c7f40 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f901f1a50 con 0x7f9f900c7f40 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f800052b0 con 0x7f9f900c7f40 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.667+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f901e29c0 con 0x7f9f900c7f40 2024-09-19T09:46:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.668+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f901e3290 con 0x7f9f900c7f40 2024-09-19T09:46:30.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.669+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9f80016020 con 0x7f9f900c7f40 2024-09-19T09:46:30.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.669+0000 7f9f877fe640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9f7006c290 0x7f9f7006e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:30.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.669+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f9f8008afe0 con 0x7f9f900c7f40 2024-09-19T09:46:30.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.669+0000 7f9f87fff640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9f7006c290 0x7f9f7006e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:30.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.670+0000 7f9f87fff640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9f7006c290 0x7f9f7006e750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f78034000 tx=0x7f9f7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:30.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.674+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9f8001d020 con 0x7f9f900c7f40 2024-09-19T09:46:30.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.989+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f900d0460 con 0x7f9f900c7f40 2024-09-19T09:46:30.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.989+0000 7f9f877fe640 1 -- 172.21.15.123:0/68227374 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f9f80059760 con 0x7f9f900c7f40 2024-09-19T09:46:30.991 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:30.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9f7006c290 msgr2=0x7f9f7006e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:30.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9f7006c290 0x7f9f7006e750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f78034000 tx=0x7f9f7802e000 comp rx=0 tx=0).stop 2024-09-19T09:46:30.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 msgr2=0x7f9f901ea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f901ea9e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000b580 tx=0x7f9f8000ba40 comp rx=0 tx=0).stop 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 shutdown_connections 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f90155650 0x7f9f901f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9f7006c290 0x7f9f7006e750 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f900c8400 0x7f9f901eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 --2- 172.21.15.123:0/68227374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f900c7f40 0x7f9f901ea9e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 >> 172.21.15.123:0/68227374 conn(0x7f9f900cd5c0 msgr2=0x7f9f900c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 shutdown_connections 2024-09-19T09:46:30.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:30.991+0000 7f9f95703640 1 -- 172.21.15.123:0/68227374 wait complete. 2024-09-19T09:46:31.004 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:46:31.004 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:46:31.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:46:31.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.131+0000 7f9b05386640 1 Processor -- start 2024-09-19T09:46:31.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.131+0000 7f9b05386640 1 -- start start 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9b05386640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b0006e770 0x7f9b000ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9b05386640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b000cf0b0 0x7f9b000c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9b05386640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b00158f10 con 0x7f9b0013ed00 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9b05386640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9b000ca070 con 0x7f9b0006e770 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9b05386640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9b00159190 con 0x7f9b000cf0b0 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9afeffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9b0013ed00 0x7f9b000c95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:34556/0 (socket says 172.21.15.123:34556) 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9afeffd640 1 -- 172.21.15.123:0/1818376085 learned_addr learned my addr 172.21.15.123:0/1818376085 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/1818376085 >> v2:172.21.15.123:3300/0 conn(0x7f9b0006e770 0x7f9b000ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9aff7fe640 1 --2- 172.21.15.123:0/1818376085 >> v2:172.21.15.194:3300/0 conn(0x7f9b000cf0b0 0x7f9b000c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9afdffb640 1 -- 172.21.15.123:0/1818376085 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097888409 0 0) 0x7f9af0001110 con 0x7f9b0013ed00 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.133+0000 7f9afdffb640 1 -- 172.21.15.123:0/1818376085 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae8003520 con 0x7f9b0013ed00 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.134+0000 7f9afe7fc640 1 -- 172.21.15.123:0/1818376085 >> v2:172.21.15.194:3300/0 conn(0x7f9b000cf0b0 msgr2=0x7f9b000c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:31.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.134+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/1818376085 >> v2:172.21.15.194:3300/0 conn(0x7f9b000cf0b0 0x7f9b000c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.134+0000 7f9afe7fc640 1 -- 172.21.15.123:0/1818376085 >> v1:172.21.15.194:6789/0 conn(0x7f9b0013ed00 legacy=0x7f9b000c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.134+0000 7f9afe7fc640 1 -- 172.21.15.123:0/1818376085 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b00159470 con 0x7f9b0006e770 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.135+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/1818376085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b000ceb70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b00070df0 tx=0x7f9af402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11fe459c5157704 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.135+0000 7f9afdffb640 1 -- 172.21.15.123:0/1818376085 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4037070 con 0x7f9b0006e770 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.135+0000 7f9afdffb640 1 -- 172.21.15.123:0/1818376085 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af4032440 con 0x7f9b0006e770 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.135+0000 7f9afdffb640 1 -- 172.21.15.123:0/1818376085 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4032810 con 0x7f9b0006e770 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 -- 172.21.15.123:0/1818376085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 msgr2=0x7f9b000ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 --2- 172.21.15.123:0/1818376085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b000ceb70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b00070df0 tx=0x7f9af402a230 comp rx=0 tx=0).stop 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 -- 172.21.15.123:0/1818376085 shutdown_connections 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 --2- 172.21.15.123:0/1818376085 >> v2:172.21.15.194:3300/0 conn(0x7f9b000cf0b0 0x7f9b000c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 --2- 172.21.15.123:0/1818376085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b000ceb70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 -- 172.21.15.123:0/1818376085 >> 172.21.15.123:0/1818376085 conn(0x7f9b00073390 msgr2=0x7f9b000737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:31.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 -- 172.21.15.123:0/1818376085 shutdown_connections 2024-09-19T09:46:31.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.136+0000 7f9b05386640 1 -- 172.21.15.123:0/1818376085 wait complete. 2024-09-19T09:46:31.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.137+0000 7f9b05386640 1 Processor -- start 2024-09-19T09:46:31.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 -- start start 2024-09-19T09:46:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b0006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 0x7f9b000ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b0013ed00 0x7f9b001f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b000c9cf0 con 0x7f9b0006e770 2024-09-19T09:46:31.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00159a30 con 0x7f9b0013ed00 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.138+0000 7f9b05386640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9b000c6620 con 0x7f9b000cf0b0 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b0013ed00 0x7f9b001f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b0013ed00 0x7f9b001f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:39158/0 (socket says 172.21.15.123:39158) 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 -- 172.21.15.123:0/2146825701 learned_addr learned my addr 172.21.15.123:0/2146825701 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afe7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 0x7f9b000ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afeffd640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b0006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afe7fc640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 msgr2=0x7f9b000ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afe7fc640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 msgr2=0x7f9b000ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 0x7f9b000ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 msgr2=0x7f9b000ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 0x7f9b000ccc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b000cf0b0 0x7f9b000ccc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 msgr2=0x7f9b0006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b0006d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9aff7fe640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b001f1150 con 0x7f9b0013ed00 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.139+0000 7f9afeffd640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0006e770 0x7f9b0006d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.140+0000 7f9aff7fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b0013ed00 0x7f9b001f1600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9af800efc0 tx=0x7f9af800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.140+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8018020 con 0x7f9b0013ed00 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.140+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af8014480 con 0x7f9b0013ed00 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.140+0000 7f9b05386640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0006c6c0 con 0x7f9b0013ed00 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.140+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8014870 con 0x7f9b0013ed00 2024-09-19T09:46:31.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.140+0000 7f9b05386640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b001e7420 con 0x7f9b0013ed00 2024-09-19T09:46:31.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.142+0000 7f9ae57fa640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 0x7f9ad8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.142+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad8007ec0 con 0x7f9ad8002a70 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.142+0000 7f9afeffd640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 0x7f9ad8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.142+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9af8005d10 con 0x7f9b0013ed00 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.142+0000 7f9afeffd640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ad80080c0 con 0x7f9ad8002a70 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9afeffd640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 0x7f9ad8004f30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9af0000f60 tx=0x7f9af000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9aec06c2e0 0x7f9aec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9aec06c2e0 0x7f9aec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f9af808bed0 con 0x7f9b0013ed00 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0005ac0 con 0x7f9ad8002a70 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9af0018070 con 0x7f9ad8002a70 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 msgr2=0x7f9ad8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 0x7f9ad8004f30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9af0000f60 tx=0x7f9af000ff70 comp rx=0 tx=0).stop 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 msgr2=0x7f9ad8004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:31.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.143+0000 7f9ae77fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8002a70 0x7f9ad8004f30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.144+0000 7f9afe7fc640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9aec06c2e0 0x7f9aec06e7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9af4034000 tx=0x7f9af402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.153+0000 7f9ae57fa640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 0x7f9ad8007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.153+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad800a4a0 con 0x7f9ad8006ee0 2024-09-19T09:46:31.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.153+0000 7f9afeffd640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 0x7f9ad8007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.154+0000 7f9afeffd640 1 -- 172.21.15.123:0/2146825701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9ad80078b0 con 0x7f9ad8006ee0 2024-09-19T09:46:31.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.154+0000 7f9afeffd640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 0x7f9ad8007370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af0017000 tx=0x7f9af0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.154+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af001eb40 con 0x7f9ad8006ee0 2024-09-19T09:46:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5199 (secure 0 0 0) 0x7f9af000d750 con 0x7f9ad8006ee0 2024-09-19T09:46:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 msgr2=0x7f9ad8007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae77fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 0x7f9ad8007370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af0017000 tx=0x7f9af0000ed0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae77fe640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 msgr2=0x7f9ad8007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae77fe640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad8006ee0 0x7f9ad8007370 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af0017000 tx=0x7f9af0000ed0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 20, 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 256724, 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:46:31.158 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:31.159 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:31.160 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:31.161 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:31.162 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:31.163 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.164 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.165 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:31.166 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.167 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.168 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:46:31.169 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 8 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:31.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.171 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.172 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:31.172 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:31.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9aec06c2e0 msgr2=0x7f9aec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae57fa640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9aec06c2e0 0x7f9aec06e7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9af4034000 tx=0x7f9af402e000 comp rx=0 tx=0).stop 2024-09-19T09:46:31.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b0013ed00 msgr2=0x7f9b001f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae57fa640 1 --2- 172.21.15.123:0/2146825701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b0013ed00 0x7f9b001f1600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9af800efc0 tx=0x7f9af800c490 comp rx=0 tx=0).stop 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9aff7fe640 1 -- 172.21.15.123:0/2146825701 reap_dead start 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9aff7fe640 1 -- 172.21.15.123:0/2146825701 reap_dead start 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 shutdown_connections 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.155+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 >> 172.21.15.123:0/2146825701 conn(0x7f9b00073390 msgr2=0x7f9b0013c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.156+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 shutdown_connections 2024-09-19T09:46:31.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.156+0000 7f9ae57fa640 1 -- 172.21.15.123:0/2146825701 wait complete. 2024-09-19T09:46:31.181 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:46:31.182 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:46:31.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:46:31.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.308+0000 7fa1b12e6640 1 Processor -- start 2024-09-19T09:46:31.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.308+0000 7fa1b12e6640 1 -- start start 2024-09-19T09:46:31.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1b12e6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 0x7fa1ac0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1b12e6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1ac0cdbb0 0x7fa1ac15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1b12e6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1ac15b580 con 0x7fa1ac155360 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1b12e6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ac15c100 con 0x7fa1ac0cdbb0 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1b12e6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ac15e910 con 0x7fa1ac0cd040 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 0x7fa1ac0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1ab7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1ac0cdbb0 0x7fa1ac15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1aaffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa1ac155360 0x7fa1ac0cb900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:34558/0 (socket says 172.21.15.123:34558) 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1aaffd640 1 -- 172.21.15.123:0/1507081609 learned_addr learned my addr 172.21.15.123:0/1507081609 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1a3fff640 1 -- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 msgr2=0x7fa1ac0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1a3fff640 1 -- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 msgr2=0x7fa1ac0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1a3fff640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 0x7fa1ac0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1a3fff640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 0x7fa1ac0cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 msgr2=0x7fa1ac0cd670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:31.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1ab7fe640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 0x7fa1ac0cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/1507081609 >> v1:172.21.15.194:6789/0 conn(0x7fa1ac155360 legacy=0x7fa1ac0cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1aa7fc640 1 -- 172.21.15.123:0/1507081609 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536565609 0 0) 0x7fa1ac15b580 con 0x7fa1ac155360 2024-09-19T09:46:31.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.309+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/1507081609 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac15b860 con 0x7fa1ac0cdbb0 2024-09-19T09:46:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.310+0000 7fa1ab7fe640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cdbb0 0x7fa1ac15eda0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009d90 tx=0x7fa1a402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52b144e01d7de42b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.310+0000 7fa1aa7fc640 1 -- 172.21.15.123:0/1507081609 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4007740 con 0x7fa1ac0cdbb0 2024-09-19T09:46:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.310+0000 7fa1aa7fc640 1 -- 172.21.15.123:0/1507081609 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a40078e0 con 0x7fa1ac0cdbb0 2024-09-19T09:46:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.310+0000 7fa1aa7fc640 1 -- 172.21.15.123:0/1507081609 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4007cb0 con 0x7fa1ac0cdbb0 2024-09-19T09:46:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 -- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cdbb0 msgr2=0x7fa1ac15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cdbb0 0x7fa1ac15eda0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009d90 tx=0x7fa1a402a660 comp rx=0 tx=0).stop 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 -- 172.21.15.123:0/1507081609 shutdown_connections 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cdbb0 0x7fa1ac15eda0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/1507081609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cd040 0x7fa1ac0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 -- 172.21.15.123:0/1507081609 >> 172.21.15.123:0/1507081609 conn(0x7fa1ac06cb60 msgr2=0x7fa1ac06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 -- 172.21.15.123:0/1507081609 shutdown_connections 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.311+0000 7fa1b12e6640 1 -- 172.21.15.123:0/1507081609 wait complete. 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.312+0000 7fa1b12e6640 1 Processor -- start 2024-09-19T09:46:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.312+0000 7fa1b12e6640 1 -- start start 2024-09-19T09:46:31.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1b12e6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cd040 0x7fa1ac155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1b12e6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 0x7fa1ac14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1b12e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1ac155360 0x7fa1ac14f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1b12e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac155740 con 0x7fa1ac155360 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1b12e6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac15be20 con 0x7fa1ac0cd040 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1b12e6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ac1558c0 con 0x7fa1ac0cdbb0 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1ac155360 0x7fa1ac14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1aaffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cd040 0x7fa1ac155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 0x7fa1ac14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 0x7fa1ac14f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:45062/0 (socket says 172.21.15.123:45062) 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 -- 172.21.15.123:0/2548205969 learned_addr learned my addr 172.21.15.123:0/2548205969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1aaffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cd040 0x7fa1ac155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:39184/0 (socket says 172.21.15.123:39184) 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1ac155360 0x7fa1ac14f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56398/0 (socket says 172.21.15.123:56398) 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 msgr2=0x7fa1ac14f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-19T09:46:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 msgr2=0x7fa1ac14f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 0x7fa1ac14f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1a3fff640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 0x7fa1ac14f3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 msgr2=0x7fa1ac14f3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0cdbb0 0x7fa1ac14f3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cd040 msgr2=0x7fa1ac155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0cd040 0x7fa1ac155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac15dee0 con 0x7fa1ac155360 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.313+0000 7fa1ab7fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1ac155360 0x7fa1ac14f920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac08e550 tx=0x7fa1a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4040070 con 0x7fa1ac155360 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a4031bc0 con 0x7fa1ac155360 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac1f14b0 con 0x7fa1ac155360 2024-09-19T09:46:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4045460 con 0x7fa1ac155360 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac15d3f0 con 0x7fa1ac155360 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 0x7fa1ac0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.314+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac15dcb0 con 0x7fa1ac1f3e20 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.315+0000 7fa1aaffd640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 0x7fa1ac0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.315+0000 7fa1aaffd640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1ac15e1c0 con 0x7fa1ac1f3e20 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.315+0000 7fa1aaffd640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 0x7fa1ac0cfe30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000f60 tx=0x7fa19c0018d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.315+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa1a4039040 con 0x7fa1ac155360 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa18c06c2e0 0x7fa18c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa1a40acba0 con 0x7fa1ac155360 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a3fff640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa18c06c2e0 0x7fa18c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c011580 con 0x7fa1ac1f3e20 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa19c018070 con 0x7fa1ac1f3e20 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 msgr2=0x7fa1ac0cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 0x7fa1ac0cfe30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000f60 tx=0x7fa19c0018d0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 msgr2=0x7fa1ac0cfe30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a37fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac1f3e20 0x7fa1ac0cfe30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.316+0000 7fa1a3fff640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa18c06c2e0 0x7fa18c06e7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac154cd0 tx=0x7fa194008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.322+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 0x7fa1ac0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.322+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac069af0 con 0x7fa1ac151ea0 2024-09-19T09:46:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.322+0000 7fa1aaffd640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 0x7fa1ac0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.322+0000 7fa1aaffd640 1 -- 172.21.15.123:0/2548205969 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa1ac15b160 con 0x7fa1ac151ea0 2024-09-19T09:46:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1aaffd640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 0x7fa1ac0d0370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000f60 tx=0x7fa19c001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c011e30 con 0x7fa1ac151ea0 2024-09-19T09:46:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7fa19c011e30 con 0x7fa1ac151ea0 2024-09-19T09:46:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 msgr2=0x7fa1ac0d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1a37fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 0x7fa1ac0d0370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000f60 tx=0x7fa19c001080 comp rx=0 tx=0).stop 2024-09-19T09:46:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1a37fe640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 msgr2=0x7fa1ac0d0370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1a37fe640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac151ea0 0x7fa1ac0d0370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 20, 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 52397, 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:31.326 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:31.327 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:31.328 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:31.329 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:31.330 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:31.331 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:31.332 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.334 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:31.336 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:31.337 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:31.338 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:31.338 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:31.338 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:31.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:31.338 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:31.338 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa18c06c2e0 msgr2=0x7fa18c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa18c06c2e0 0x7fa18c06e7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac154cd0 tx=0x7fa194008040 comp rx=0 tx=0).stop 2024-09-19T09:46:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1ac155360 msgr2=0x7fa1ac14f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 --2- 172.21.15.123:0/2548205969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1ac155360 0x7fa1ac14f920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac08e550 tx=0x7fa1a4004a40 comp rx=0 tx=0).stop 2024-09-19T09:46:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/2548205969 reap_dead start 2024-09-19T09:46:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1ab7fe640 1 -- 172.21.15.123:0/2548205969 reap_dead start 2024-09-19T09:46:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 shutdown_connections 2024-09-19T09:46:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 >> 172.21.15.123:0/2548205969 conn(0x7fa1ac06cb60 msgr2=0x7fa1ac1592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 shutdown_connections 2024-09-19T09:46:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.323+0000 7fa1b12e6640 1 -- 172.21.15.123:0/2548205969 wait complete. 2024-09-19T09:46:31.340 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:46:31.340 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:46:31.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:46:31.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.507+0000 7ff4f3f78640 1 Processor -- start 2024-09-19T09:46:31.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.508+0000 7ff4f3f78640 1 -- start start 2024-09-19T09:46:31.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.508+0000 7ff4f3f78640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4ec152dc0 0x7ff4ec0c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.508+0000 7ff4f3f78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 0x7ff4ec1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f3f78640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4ec0c7ca0 con 0x7ff4ec159c00 2024-09-19T09:46:31.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f3f78640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ec0c5d50 con 0x7ff4ec152dc0 2024-09-19T09:46:31.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f3f78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec159230 con 0x7ff4ec0c7540 2024-09-19T09:46:31.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4ec152dc0 0x7ff4ec0c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4ec152dc0 0x7ff4ec0c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56404/0 (socket says 172.21.15.123:56404) 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4134990520 learned_addr learned my addr 172.21.15.123:0/4134990520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4134990520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 msgr2=0x7ff4ec1596c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4134990520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 0x7ff4ec1596c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4134990520 >> v1:172.21.15.194:6789/0 conn(0x7ff4ec159c00 legacy=0x7ff4ec0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.509+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4134990520 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec073490 con 0x7ff4ec152dc0 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.510+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4134990520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec0c4680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca196b556d4bf93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.510+0000 7ff4f0d12640 1 -- 172.21.15.123:0/4134990520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8037070 con 0x7ff4ec152dc0 2024-09-19T09:46:31.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.511+0000 7ff4f0d12640 1 -- 172.21.15.123:0/4134990520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e8032440 con 0x7ff4ec152dc0 2024-09-19T09:46:31.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.511+0000 7ff4f0d12640 1 -- 172.21.15.123:0/4134990520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8032810 con 0x7ff4ec152dc0 2024-09-19T09:46:31.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4134990520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 msgr2=0x7ff4ec0c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4134990520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec0c4680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e802a230 comp rx=0 tx=0).stop 2024-09-19T09:46:31.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4134990520 shutdown_connections 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4134990520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 0x7ff4ec1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4134990520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec0c4680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4134990520 >> 172.21.15.123:0/4134990520 conn(0x7ff4ec06ed00 msgr2=0x7ff4ec06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4134990520 shutdown_connections 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.512+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4134990520 wait complete. 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.513+0000 7ff4f3f78640 1 Processor -- start 2024-09-19T09:46:31.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.513+0000 7ff4f3f78640 1 -- start start 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f3f78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 0x7ff4ec0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f3f78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec1e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f3f78640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ec1e3e40 0x7ff4ec0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f3f78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec0c7980 con 0x7ff4ec152dc0 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f3f78640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec073a10 con 0x7ff4ec1e3e40 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f3f78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec0ca0c0 con 0x7ff4ec0c7540 2024-09-19T09:46:31.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f1513640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec1e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f1513640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec1e3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56412/0 (socket says 172.21.15.123:56412) 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.514+0000 7ff4f1513640 1 -- 172.21.15.123:0/4018354277 learned_addr learned my addr 172.21.15.123:0/4018354277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.515+0000 7ff4f1513640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 msgr2=0x7ff4ec0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.515+0000 7ff4f1513640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec0c7540 0x7ff4ec0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.515+0000 7ff4f1513640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ec1e3e40 msgr2=0x7ff4ec0cb2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.515+0000 7ff4f1513640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4ec1e3e40 0x7ff4ec0cb2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.515+0000 7ff4f1513640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec1e42d0 con 0x7ff4ec152dc0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.515+0000 7ff4f1513640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec1e3900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00b3f0 tx=0x7ff4dc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.516+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc015020 con 0x7ff4ec152dc0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.516+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4dc011830 con 0x7ff4ec152dc0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.516+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc011c00 con 0x7ff4ec152dc0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.516+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec1507e0 con 0x7ff4ec152dc0 2024-09-19T09:46:31.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.516+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec150a80 con 0x7ff4ec152dc0 2024-09-19T09:46:31.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.517+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.517+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec0cc5a0 con 0x7ff4ec159af0 2024-09-19T09:46:31.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.518+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.518+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff4dc018020 con 0x7ff4ec152dc0 2024-09-19T09:46:31.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.519+0000 7ff4e27fc640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff4d006c2b0 0x7ff4d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.519+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7ff4dc08b400 con 0x7ff4ec152dc0 2024-09-19T09:46:31.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.519+0000 7ff4f2515640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff4d006c2b0 0x7ff4d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.519+0000 7ff4f2515640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff4d006c2b0 0x7ff4d006e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4001b70 tx=0x7ff4e4007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.520+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:46:31.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.520+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:31.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.520+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:31.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.520+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.721+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.721+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:46:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.721+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.721+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:31.721+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:46:31.987 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:46:31.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:46:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.122+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.122+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:46:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.122+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.122+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.122+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:46:32.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.923+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.923+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:46:32.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.923+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:32.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.923+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:32.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:32.923+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:46:34.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:34.525+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:34.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:34.525+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:46:34.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:34.525+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:34.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:34.525+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:34.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:34.525+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-19T09:46:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.514+0000 7ff4e17fa640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.514+0000 7ff4e17fa640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.514+0000 7ff4e17fa640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.514+0000 7ff4e17fa640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 msgr2=0x7ff4ec0cb830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.514+0000 7ff4e17fa640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec159af0 0x7ff4ec0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.514+0000 7ff4e17fa640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c8006080 con 0x7ff4c8003540 2024-09-19T09:46:35.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.515+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.516+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 msgr2=0x7ff4c80059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:46:35.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.516+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 msgr2=0x7ff4c80059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:46:35.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.516+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:35.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.516+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:35.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.717+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.717+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4c8006230 con 0x7ff4c8003540 2024-09-19T09:46:35.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.717+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec156a20 tx=0x7ff4e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.718+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8037040 con 0x7ff4c8003540 2024-09-19T09:46:35.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.718+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff4e8047650 con 0x7ff4c8003540 2024-09-19T09:46:35.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.718+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 msgr2=0x7ff4c80059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.718+0000 7ff4e27fc640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec156a20 tx=0x7ff4e80046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.718+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 msgr2=0x7ff4c80059d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:35.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.718+0000 7ff4e27fc640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4c8003540 0x7ff4c80059d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.725+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 0x7ff4ec1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.725+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec158e50 con 0x7ff4ec1e3340 2024-09-19T09:46:35.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.725+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 0x7ff4ec1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.725+0000 7ff4f1d14640 1 -- 172.21.15.123:0/4018354277 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4ec0c7320 con 0x7ff4ec1e3340 2024-09-19T09:46:35.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.726+0000 7ff4f1d14640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 0x7ff4ec1f2330 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.726+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8056070 con 0x7ff4ec1e3340 2024-09-19T09:46:35.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.727+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7ff4e804f950 con 0x7ff4ec1e3340 2024-09-19T09:46:35.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.727+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 msgr2=0x7ff4ec1f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.727+0000 7ff4e27fc640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 0x7ff4ec1f2330 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e8008030 comp rx=0 tx=0).stop 2024-09-19T09:46:35.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.727+0000 7ff4e27fc640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 msgr2=0x7ff4ec1f2330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:35.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.727+0000 7ff4e27fc640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4ec1e3340 0x7ff4ec1f2330 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e8008030 comp rx=0 tx=0).stop 2024-09-19T09:46:35.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.727+0000 7ff4f2515640 1 -- 172.21.15.123:0/4018354277 reap_dead start 2024-09-19T09:46:35.729 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 20, 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 5043, 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 4, 2024-09-19T09:46:35.730 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:35.731 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:35.732 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:35.733 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:35.734 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:35.735 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:35.736 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:35.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:35.738 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:35.739 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:35.740 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:35.741 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:35.742 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff4d006c2b0 msgr2=0x7ff4d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff4d006c2b0 0x7ff4d006e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4001b70 tx=0x7ff4e4007d10 comp rx=0 tx=0).stop 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 msgr2=0x7ff4ec1e3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec1e3900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00b3f0 tx=0x7ff4dc00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 shutdown_connections 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4ec152dc0 0x7ff4ec1e3900 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 --2- 172.21.15.123:0/4018354277 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7ff4d006c2b0 0x7ff4d006e770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 >> 172.21.15.123:0/4018354277 conn(0x7ff4ec06ed00 msgr2=0x7ff4ec0c8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 shutdown_connections 2024-09-19T09:46:35.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.728+0000 7ff4f3f78640 1 -- 172.21.15.123:0/4018354277 wait complete. 2024-09-19T09:46:35.777 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:46:35.777 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:46:35.777 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:46:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.903+0000 7f7da639a640 1 Processor -- start 2024-09-19T09:46:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.903+0000 7f7da639a640 1 -- start start 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7da639a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da00c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7da639a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7da00738b0 0x7f7da0155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7da639a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7da00c74d0 con 0x7f7da00c6610 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7da639a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7da00c6bd0 con 0x7f7da00738b0 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7da639a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7da00c6eb0 con 0x7f7da00734d0 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7d9f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7da00c6610 0x7f7da0154d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58460/0 (socket says 172.21.15.123:58460) 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.904+0000 7f7d9f7fe640 1 -- 172.21.15.123:0/660521358 learned_addr learned my addr 172.21.15.123:0/660521358 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9ffff640 1 --2- 172.21.15.123:0/660521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da00c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7da4937640 1 --2- 172.21.15.123:0/660521358 >> v2:172.21.15.194:3300/0 conn(0x7f7da00738b0 0x7f7da0155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9effd640 1 -- 172.21.15.123:0/660521358 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391627078 0 0) 0x7f7da00c74d0 con 0x7f7da00c6610 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9effd640 1 -- 172.21.15.123:0/660521358 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d88003520 con 0x7f7da00c6610 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9ffff640 1 -- 172.21.15.123:0/660521358 >> v2:172.21.15.194:3300/0 conn(0x7f7da00738b0 msgr2=0x7f7da0155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9ffff640 1 --2- 172.21.15.123:0/660521358 >> v2:172.21.15.194:3300/0 conn(0x7f7da00738b0 0x7f7da0155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9ffff640 1 -- 172.21.15.123:0/660521358 >> v1:172.21.15.123:6789/0 conn(0x7f7da00c6610 legacy=0x7f7da0154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.905+0000 7f7d9ffff640 1 -- 172.21.15.123:0/660521358 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da00c7190 con 0x7f7da00734d0 2024-09-19T09:46:35.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7d9ffff640 1 --2- 172.21.15.123:0/660521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da00c7c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d900097a0 tx=0x7f7d9002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd57c9a547ce9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7d9effd640 1 -- 172.21.15.123:0/660521358 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90037070 con 0x7f7da00734d0 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7d9effd640 1 -- 172.21.15.123:0/660521358 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90032440 con 0x7f7da00734d0 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7d9effd640 1 -- 172.21.15.123:0/660521358 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90032810 con 0x7f7da00734d0 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7da639a640 1 -- 172.21.15.123:0/660521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 msgr2=0x7f7da00c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7da639a640 1 --2- 172.21.15.123:0/660521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da00c7c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d900097a0 tx=0x7f7d9002a210 comp rx=0 tx=0).stop 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7da639a640 1 -- 172.21.15.123:0/660521358 shutdown_connections 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.906+0000 7f7da639a640 1 --2- 172.21.15.123:0/660521358 >> v2:172.21.15.194:3300/0 conn(0x7f7da00738b0 0x7f7da0155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.907+0000 7f7da639a640 1 --2- 172.21.15.123:0/660521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da00c7c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.907+0000 7f7da639a640 1 -- 172.21.15.123:0/660521358 >> 172.21.15.123:0/660521358 conn(0x7f7da00ce9b0 msgr2=0x7f7da00ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.907+0000 7f7da639a640 1 -- 172.21.15.123:0/660521358 shutdown_connections 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.907+0000 7f7da639a640 1 -- 172.21.15.123:0/660521358 wait complete. 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.908+0000 7f7da639a640 1 Processor -- start 2024-09-19T09:46:35.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.908+0000 7f7da639a640 1 -- start start 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7da00738b0 0x7f7da01f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 0x7f7da00ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7da00c5e30 con 0x7f7da00c6610 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7da00c5ab0 con 0x7f7da00738b0 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7da00c5fb0 con 0x7f7da00734d0 2024-09-19T09:46:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 0x7f7da00ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 0x7f7da00ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51960/0 (socket says 172.21.15.123:51960) 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 -- 172.21.15.123:0/417065075 learned_addr learned my addr 172.21.15.123:0/417065075 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7d9ffff640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7d9f7fe640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7da00738b0 0x7f7da01f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 -- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 msgr2=0x7f7da014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 -- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7da00738b0 msgr2=0x7f7da01f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7da00738b0 0x7f7da01f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 -- 172.21.15.123:0/417065075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da01f49a0 con 0x7f7da00c6610 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da4937640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 0x7f7da00ca070 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800efc0 tx=0x7f7d9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98018020 con 0x7f7da00c6610 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d98014480 con 0x7f7da00c6610 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98009e60 con 0x7f7da00c6610 2024-09-19T09:46:35.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da01f4c40 con 0x7f7da00c6610 2024-09-19T09:46:35.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.909+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01e46c0 con 0x7f7da00c6610 2024-09-19T09:46:35.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.911+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da015f060 con 0x7f7da00c6610 2024-09-19T09:46:35.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.911+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d98005d10 con 0x7f7da00c6610 2024-09-19T09:46:35.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.911+0000 7f7d9cff9640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d8c06c2b0 0x7f7d8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:35.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.911+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7d9808c050 con 0x7f7da00c6610 2024-09-19T09:46:35.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.912+0000 7f7d9ffff640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d8c06c2b0 0x7f7d8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:35.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.912+0000 7f7d9ffff640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d8c06c2b0 0x7f7d8c06e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d90034000 tx=0x7f7d9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:35.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:35.917+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7d98022030 con 0x7f7da00c6610 2024-09-19T09:46:36.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.263+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f7da00ced90 con 0x7f7da00c6610 2024-09-19T09:46:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.264+0000 7f7d9cff9640 1 -- 172.21.15.123:0/417065075 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f7d98010040 con 0x7f7da00c6610 2024-09-19T09:46:36.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d8c06c2b0 msgr2=0x7f7d8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:36.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d8c06c2b0 0x7f7d8c06e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d90034000 tx=0x7f7d9002e000 comp rx=0 tx=0).stop 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 msgr2=0x7f7da00ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 0x7f7da00ca070 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800efc0 tx=0x7f7d9800c490 comp rx=0 tx=0).stop 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 shutdown_connections 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7da00c6610 0x7f7da00ca070 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7da00738b0 0x7f7da01f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d8c06c2b0 0x7f7d8c06e770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 --2- 172.21.15.123:0/417065075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7da00734d0 0x7f7da014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 >> 172.21.15.123:0/417065075 conn(0x7f7da00ce9b0 msgr2=0x7f7da014f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 shutdown_connections 2024-09-19T09:46:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:36.266+0000 7f7da639a640 1 -- 172.21.15.123:0/417065075 wait complete. 2024-09-19T09:46:36.280 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:46:46.282 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:46:46.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:46.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.401+0000 7f2707c74640 1 Processor -- start 2024-09-19T09:46:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.402+0000 7f2707c74640 1 -- start start 2024-09-19T09:46:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.402+0000 7f2707c74640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27001557e0 0x7f270015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.402+0000 7f2707c74640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000cc790 0x7f27000ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.402+0000 7f2707c74640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f270015b450 con 0x7f27000725a0 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.402+0000 7f2707c74640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f270015f790 con 0x7f27001557e0 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.402+0000 7f2707c74640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f270015b6f0 con 0x7f27000cc790 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2706211640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000cc790 0x7f27000ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2705a10640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27001557e0 0x7f270015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f270520f640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f27000725a0 0x7f27000729a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:44178/0 (socket says 172.21.15.123:44178) 2024-09-19T09:46:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f270520f640 1 -- 172.21.15.123:0/3664430337 learned_addr learned my addr 172.21.15.123:0/3664430337 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2704a0e640 1 -- 172.21.15.123:0/3664430337 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336311927 0 0) 0x7f270015b450 con 0x7f27000725a0 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2704a0e640 1 -- 172.21.15.123:0/3664430337 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26ec003520 con 0x7f27000725a0 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2706211640 1 -- 172.21.15.123:0/3664430337 >> v2:172.21.15.194:3300/0 conn(0x7f27001557e0 msgr2=0x7f270015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2706211640 1 --2- 172.21.15.123:0/3664430337 >> v2:172.21.15.194:3300/0 conn(0x7f27001557e0 0x7f270015f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2706211640 1 -- 172.21.15.123:0/3664430337 >> v1:172.21.15.194:6789/0 conn(0x7f27000725a0 legacy=0x7f27000729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2706211640 1 -- 172.21.15.123:0/3664430337 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270015b9d0 con 0x7f27000cc790 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.403+0000 7f2705a10640 1 --2- 172.21.15.123:0/3664430337 >> v2:172.21.15.194:3300/0 conn(0x7f27001557e0 0x7f270015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.404+0000 7f2706211640 1 --2- 172.21.15.123:0/3664430337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000cc790 0x7f27000ccc20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009d90 tx=0x7f26f802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c684e35662c214fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.404+0000 7f2704a0e640 1 -- 172.21.15.123:0/3664430337 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8007740 con 0x7f27000cc790 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.404+0000 7f2704a0e640 1 -- 172.21.15.123:0/3664430337 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f80078e0 con 0x7f27000cc790 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.404+0000 7f2704a0e640 1 -- 172.21.15.123:0/3664430337 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8007cb0 con 0x7f27000cc790 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 -- 172.21.15.123:0/3664430337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000cc790 msgr2=0x7f27000ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 --2- 172.21.15.123:0/3664430337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000cc790 0x7f27000ccc20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009d90 tx=0x7f26f802a530 comp rx=0 tx=0).stop 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 -- 172.21.15.123:0/3664430337 shutdown_connections 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 --2- 172.21.15.123:0/3664430337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000cc790 0x7f27000ccc20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 --2- 172.21.15.123:0/3664430337 >> v2:172.21.15.194:3300/0 conn(0x7f27001557e0 0x7f270015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 -- 172.21.15.123:0/3664430337 >> 172.21.15.123:0/3664430337 conn(0x7f27000ca380 msgr2=0x7f27000ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 -- 172.21.15.123:0/3664430337 shutdown_connections 2024-09-19T09:46:46.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.405+0000 7f2707c74640 1 -- 172.21.15.123:0/3664430337 wait complete. 2024-09-19T09:46:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.406+0000 7f2707c74640 1 Processor -- start 2024-09-19T09:46:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.406+0000 7f2707c74640 1 -- start start 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2707c74640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000725a0 0x7f2700151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2707c74640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 0x7f270014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2707c74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27001557e0 0x7f27001f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2707c74640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f270006f980 con 0x7f27001557e0 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2707c74640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f270015bf90 con 0x7f27000cc790 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2707c74640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f27000cd160 con 0x7f27000725a0 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 0x7f270014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2706211640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27001557e0 0x7f27001f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2705a10640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000725a0 0x7f2700151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 0x7f270014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:52550/0 (socket says 172.21.15.123:52550) 2024-09-19T09:46:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 -- 172.21.15.123:0/918517205 learned_addr learned my addr 172.21.15.123:0/918517205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 -- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000725a0 msgr2=0x7f2700151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000725a0 0x7f2700151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 -- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27001557e0 msgr2=0x7f27001f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27001557e0 0x7f27001f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f270520f640 1 -- 172.21.15.123:0/918517205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27001f43c0 con 0x7f27000cc790 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.407+0000 7f2705a10640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000725a0 0x7f2700151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.408+0000 7f270520f640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 0x7f270014e5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c490 tx=0x7f26f000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.408+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f27000cc790 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.408+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0005ce0 con 0x7f27000cc790 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.408+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001f46a0 con 0x7f27000cc790 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.408+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0007290 con 0x7f27000cc790 2024-09-19T09:46:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.408+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001f4c60 con 0x7f27000cc790 2024-09-19T09:46:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.409+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27001f5030 con 0x7f27000cc790 2024-09-19T09:46:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.409+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26f001a070 con 0x7f27000cc790 2024-09-19T09:46:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.410+0000 7f26f67fc640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26e406c2b0 0x7f26e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.410+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f26f008a7e0 con 0x7f27000cc790 2024-09-19T09:46:46.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.410+0000 7f2705a10640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26e406c2b0 0x7f26e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.410+0000 7f2705a10640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26e406c2b0 0x7f26e406e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009560 tx=0x7f26fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.414+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f26f0058820 con 0x7f27000cc790 2024-09-19T09:46:46.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.734+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2700154b30 con 0x7f27000cc790 2024-09-19T09:46:46.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.734+0000 7f26f67fc640 1 -- 172.21.15.123:0/918517205 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f26f005cb20 con 0x7f27000cc790 2024-09-19T09:46:46.736 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.736+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26e406c2b0 msgr2=0x7f26e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.736+0000 7f2707c74640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26e406c2b0 0x7f26e406e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009560 tx=0x7f26fc009190 comp rx=0 tx=0).stop 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.736+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 msgr2=0x7f270014e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.736+0000 7f2707c74640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 0x7f270014e5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c490 tx=0x7f26f000c950 comp rx=0 tx=0).stop 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 shutdown_connections 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27001557e0 0x7f27001f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000cc790 0x7f270014e5d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26e406c2b0 0x7f26e406e770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 --2- 172.21.15.123:0/918517205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000725a0 0x7f2700151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 >> 172.21.15.123:0/918517205 conn(0x7f27000ca380 msgr2=0x7f27000ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 shutdown_connections 2024-09-19T09:46:46.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.737+0000 7f2707c74640 1 -- 172.21.15.123:0/918517205 wait complete. 2024-09-19T09:46:46.749 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:46:46.749 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:46:46.749 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:46:46.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:46:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.849+0000 7fefee778640 1 Processor -- start 2024-09-19T09:46:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.849+0000 7fefee778640 1 -- start start 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefee778640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefe8070c30 0x7fefe80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefee778640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefee778640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe815b5f0 con 0x7fefe80c9200 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefee778640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fefe815b8d0 con 0x7fefe8070c30 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefee778640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fefe815bbb0 con 0x7fefe8071010 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefe7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefe8070c30 0x7fefe80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefe7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefe8070c30 0x7fefe80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58918/0 (socket says 172.21.15.123:58918) 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefe7fff640 1 -- 172.21.15.123:0/1077764105 learned_addr learned my addr 172.21.15.123:0/1077764105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.850+0000 7fefe77fe640 1 --2- 172.21.15.123:0/1077764105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe7fff640 1 -- 172.21.15.123:0/1077764105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 msgr2=0x7fefe80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1077764105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe80ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe7fff640 1 -- 172.21.15.123:0/1077764105 >> v1:172.21.15.194:6789/0 conn(0x7fefe80c9200 legacy=0x7fefe81440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe7fff640 1 -- 172.21.15.123:0/1077764105 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe815be90 con 0x7fefe8070c30 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1077764105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe8070c30 0x7fefe80cdda0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009870 tx=0x7fefd802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d0f74294f1e86e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe6ffd640 1 -- 172.21.15.123:0/1077764105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8037070 con 0x7fefe8070c30 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe6ffd640 1 -- 172.21.15.123:0/1077764105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd802ae50 con 0x7fefe8070c30 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.851+0000 7fefe6ffd640 1 -- 172.21.15.123:0/1077764105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8032860 con 0x7fefe8070c30 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 -- 172.21.15.123:0/1077764105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe8070c30 msgr2=0x7fefe80cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 --2- 172.21.15.123:0/1077764105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe8070c30 0x7fefe80cdda0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009870 tx=0x7fefd802a300 comp rx=0 tx=0).stop 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 -- 172.21.15.123:0/1077764105 shutdown_connections 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 --2- 172.21.15.123:0/1077764105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 --2- 172.21.15.123:0/1077764105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe8070c30 0x7fefe80cdda0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 -- 172.21.15.123:0/1077764105 >> 172.21.15.123:0/1077764105 conn(0x7fefe80ce8d0 msgr2=0x7fefe80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 -- 172.21.15.123:0/1077764105 shutdown_connections 2024-09-19T09:46:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.852+0000 7fefee778640 1 -- 172.21.15.123:0/1077764105 wait complete. 2024-09-19T09:46:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.853+0000 7fefee778640 1 Processor -- start 2024-09-19T09:46:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.853+0000 7fefee778640 1 -- start start 2024-09-19T09:46:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefee778640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe8070c30 0x7fefe80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefee778640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefee778640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe80c9200 0x7fefe81f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefee778640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefe815b220 con 0x7fefe80c9200 2024-09-19T09:46:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefee778640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fefe80ca0f0 con 0x7fefe8070c30 2024-09-19T09:46:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefee778640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fefe815b3a0 con 0x7fefe8071010 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe80c9200 0x7fefe81f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe80c9200 0x7fefe81f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58922/0 (socket says 172.21.15.123:58922) 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 -- 172.21.15.123:0/1067531481 learned_addr learned my addr 172.21.15.123:0/1067531481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe8070c30 0x7fefe80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefe77fe640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 msgr2=0x7fefe815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe8071010 0x7fefe815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe8070c30 msgr2=0x7fefe80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe8070c30 0x7fefe80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.854+0000 7fefecd15640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe80c65f0 con 0x7fefe80c9200 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.855+0000 7fefecd15640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe80c9200 0x7fefe81f5190 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c730 tx=0x7fefe000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.855+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0003b70 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.855+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe0003d30 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.855+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0005310 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.855+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe81f1560 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.855+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81f1b20 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.856+0000 7fefee778640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 0x7fefe813f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.856+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81f56d0 con 0x7fefe815f4e0 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.856+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 0x7fefe813f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.856+0000 7fefe7fff640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefe806d7a0 con 0x7fefe815f4e0 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.856+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fefe00054b0 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.856+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 0x7fefe813f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c9730 tx=0x7fefd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fefd406c2b0 0x7fefd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fefe008b2c0 con 0x7fefe80c9200 2024-09-19T09:46:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe77fe640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fefd406c2b0 0x7fefd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8043070 con 0x7fefe815f4e0 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fefd802ae50 con 0x7fefe815f4e0 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 msgr2=0x7fefe813f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 0x7fefe813f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c9730 tx=0x7fefd80046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 msgr2=0x7fefe813f470 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe4ff9640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe815f4e0 0x7fefe813f470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.857+0000 7fefe77fe640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fefd406c2b0 0x7fefd406e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefe813c720 tx=0x7fefdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.863+0000 7fefee778640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 0x7fefe80c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.863+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefe80cde60 con 0x7fefe813f9b0 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.863+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 0x7fefe80c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.863+0000 7fefe7fff640 1 -- 172.21.15.123:0/1067531481 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fefe8158c40 con 0x7fefe813f9b0 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe7fff640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 0x7fefe80c6c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefd80090b0 tx=0x7fefd8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8037040 con 0x7fefe813f9b0 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5200 (secure 0 0 0) 0x7fefd80044c0 con 0x7fefe813f9b0 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 msgr2=0x7fefe80c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe4ff9640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 0x7fefe80c6c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefd80090b0 tx=0x7fefd8008030 comp rx=0 tx=0).stop 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe4ff9640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 msgr2=0x7fefe80c6c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:46.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefe4ff9640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe813f9b0 0x7fefe80c6c50 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefd80090b0 tx=0x7fefd8008030 comp rx=0 tx=0).stop 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 20, 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 272435, 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:46:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 15, 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:46.871 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:46.872 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:46.873 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.874 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:46.875 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:46.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:46.877 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:46.878 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 8 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.879 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:46.880 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fefd406c2b0 msgr2=0x7fefd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fefd406c2b0 0x7fefd406e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefe813c720 tx=0x7fefdc008040 comp rx=0 tx=0).stop 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe80c9200 msgr2=0x7fefe81f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 --2- 172.21.15.123:0/1067531481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe80c9200 0x7fefe81f5190 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c730 tx=0x7fefe000cbf0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefecd15640 1 -- 172.21.15.123:0/1067531481 reap_dead start 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefecd15640 1 -- 172.21.15.123:0/1067531481 reap_dead start 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 shutdown_connections 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 >> 172.21.15.123:0/1067531481 conn(0x7fefe80ce8d0 msgr2=0x7fefe815aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 shutdown_connections 2024-09-19T09:46:46.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.864+0000 7fefee778640 1 -- 172.21.15.123:0/1067531481 wait complete. 2024-09-19T09:46:46.882 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:46:46.883 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:46:46.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:46:46.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.981+0000 7f908b6e4640 1 Processor -- start 2024-09-19T09:46:46.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.981+0000 7f908b6e4640 1 -- start start 2024-09-19T09:46:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f908b6e4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f90840c5e30 0x7f908415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f908b6e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90841581d0 0x7f9084071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f908b6e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f908406c050 con 0x7f908406c9c0 2024-09-19T09:46:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f908b6e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f908406c330 con 0x7f90841581d0 2024-09-19T09:46:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f908b6e4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f90841576f0 con 0x7f90840c5e30 2024-09-19T09:46:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9088c7f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90841581d0 0x7f9084071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9089c81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f908406c9c0 0x7f9084071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48794/0 (socket says 172.21.15.123:48794) 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9089c81640 1 -- 172.21.15.123:0/2008458191 learned_addr learned my addr 172.21.15.123:0/2008458191 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9088c7f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90841581d0 0x7f9084071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58930/0 (socket says 172.21.15.123:58930) 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9089480640 1 --2- 172.21.15.123:0/2008458191 >> v2:172.21.15.194:3300/0 conn(0x7f90840c5e30 0x7f908415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9088c7f640 1 -- 172.21.15.123:0/2008458191 >> v2:172.21.15.194:3300/0 conn(0x7f90840c5e30 msgr2=0x7f908415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9088c7f640 1 --2- 172.21.15.123:0/2008458191 >> v2:172.21.15.194:3300/0 conn(0x7f90840c5e30 0x7f908415aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9088c7f640 1 -- 172.21.15.123:0/2008458191 >> v1:172.21.15.123:6789/0 conn(0x7f908406c9c0 legacy=0x7f9084071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f9088c7f640 1 -- 172.21.15.123:0/2008458191 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90841579d0 con 0x7f90841581d0 2024-09-19T09:46:46.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.982+0000 7f907bfff640 1 -- 172.21.15.123:0/2008458191 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778040236 0 0) 0x7f908406c050 con 0x7f908406c9c0 2024-09-19T09:46:46.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f9088c7f640 1 --2- 172.21.15.123:0/2008458191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f9084071110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f90840760a0 tx=0x7f907402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a453c83e5fd6388 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f907bfff640 1 -- 172.21.15.123:0/2008458191 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074037070 con 0x7f90841581d0 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f907bfff640 1 -- 172.21.15.123:0/2008458191 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074032440 con 0x7f90841581d0 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f907bfff640 1 -- 172.21.15.123:0/2008458191 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074032810 con 0x7f90841581d0 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f908b6e4640 1 -- 172.21.15.123:0/2008458191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 msgr2=0x7f9084071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f908b6e4640 1 --2- 172.21.15.123:0/2008458191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f9084071110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f90840760a0 tx=0x7f907402a230 comp rx=0 tx=0).stop 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f908b6e4640 1 -- 172.21.15.123:0/2008458191 shutdown_connections 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f908b6e4640 1 --2- 172.21.15.123:0/2008458191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f9084071110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f908b6e4640 1 --2- 172.21.15.123:0/2008458191 >> v2:172.21.15.194:3300/0 conn(0x7f90840c5e30 0x7f908415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.983+0000 7f908b6e4640 1 -- 172.21.15.123:0/2008458191 >> 172.21.15.123:0/2008458191 conn(0x7f908406ed00 msgr2=0x7f908406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.984+0000 7f908b6e4640 1 -- 172.21.15.123:0/2008458191 shutdown_connections 2024-09-19T09:46:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.984+0000 7f908b6e4640 1 -- 172.21.15.123:0/2008458191 wait complete. 2024-09-19T09:46:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 Processor -- start 2024-09-19T09:46:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 -- start start 2024-09-19T09:46:46.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f908406c9c0 0x7f908414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90840c5e30 0x7f90840cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f90840cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f90840c4110 con 0x7f90841581d0 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f908415afb0 con 0x7f90840c5e30 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.985+0000 7f908b6e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9084071d60 con 0x7f908406c9c0 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f90840cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f90840cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58938/0 (socket says 172.21.15.123:58938) 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 -- 172.21.15.123:0/411734365 learned_addr learned my addr 172.21.15.123:0/411734365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9088c7f640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90840c5e30 0x7f90840cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f908406c9c0 msgr2=0x7f908414be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f908406c9c0 0x7f908414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90840c5e30 msgr2=0x7f90840cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90840c5e30 0x7f90840cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908414c740 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9088c7f640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90840c5e30 0x7f90840cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9089c81640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f90840cbfa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c7d0 tx=0x7f907c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c018070 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c00a640 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90841ef240 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c00aa70 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.986+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90841ef800 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.987+0000 7f908b6e4640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 0x7f9084148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.987+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9084159690 con 0x7f90841efc00 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.987+0000 7f9089480640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 0x7f9084148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f907c01b070 con 0x7f90841581d0 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9089480640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90840699a0 con 0x7f90841efc00 2024-09-19T09:46:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9089480640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 0x7f9084148b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f908000e810 tx=0x7f908000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f906806c2e0 0x7f906806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f907c08aae0 con 0x7f90841581d0 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9088c7f640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f906806c2e0 0x7f906806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080017070 con 0x7f90841efc00 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9080004020 con 0x7f90841efc00 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 msgr2=0x7f9084148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 0x7f9084148b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f908000e810 tx=0x7f908000ecd0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 msgr2=0x7f9084148b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.988+0000 7f9079ffb640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90841efc00 0x7f9084148b40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.989+0000 7f9088c7f640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f906806c2e0 0x7f906806e7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9074034000 tx=0x7f907402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.994+0000 7f908b6e4640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 0x7f9084159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.994+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f90840c74f0 con 0x7f9084149080 2024-09-19T09:46:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9089480640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 0x7f9084159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9089480640 1 -- 172.21.15.123:0/411734365 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9084149490 con 0x7f9084149080 2024-09-19T09:46:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9089480640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 0x7f9084159970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f908000e810 tx=0x7f90800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080017040 con 0x7f9084149080 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4720 (secure 0 0 0) 0x7f9080003a50 con 0x7f9084149080 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 msgr2=0x7f9084159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9079ffb640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 0x7f9084159970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f908000e810 tx=0x7f90800046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9079ffb640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 msgr2=0x7f9084159970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.995+0000 7f9079ffb640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9084149080 0x7f9084159970 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f908000e810 tx=0x7f90800046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:46.998 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 20, 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 68069, 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:46.999 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:47.000 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:47.002 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:47.004 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:47.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:47.007 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:47.008 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.009 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.011 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:47.011 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:47.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f906806c2e0 msgr2=0x7f906806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f906806c2e0 0x7f906806e7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9074034000 tx=0x7f907402e000 comp rx=0 tx=0).stop 2024-09-19T09:46:47.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 msgr2=0x7f90840cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 --2- 172.21.15.123:0/411734365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90841581d0 0x7f90840cbfa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c7d0 tx=0x7f907c00cc90 comp rx=0 tx=0).stop 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f9089c81640 1 -- 172.21.15.123:0/411734365 reap_dead start 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f9089c81640 1 -- 172.21.15.123:0/411734365 reap_dead start 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 shutdown_connections 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 >> 172.21.15.123:0/411734365 conn(0x7f908406ed00 msgr2=0x7f90841634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 shutdown_connections 2024-09-19T09:46:47.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:46.996+0000 7f908b6e4640 1 -- 172.21.15.123:0/411734365 wait complete. 2024-09-19T09:46:47.013 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:46:47.013 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:46:47.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:46:47.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.111+0000 7f06766a5640 1 Processor -- start 2024-09-19T09:46:47.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.111+0000 7f06766a5640 1 -- start start 2024-09-19T09:46:47.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f06766a5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06701581d0 0x7f0670071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f06766a5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f067006c9c0 0x7f0670071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f06766a5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067006c050 con 0x7f06700c5e30 2024-09-19T09:46:47.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f06766a5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f067006c330 con 0x7f06701581d0 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f06766a5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f06701576f0 con 0x7f067006c9c0 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f066f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06701581d0 0x7f0670071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f066f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06701581d0 0x7f0670071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58944/0 (socket says 172.21.15.123:58944) 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f066f7fe640 1 -- 172.21.15.123:0/763075008 learned_addr learned my addr 172.21.15.123:0/763075008 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f0674c42640 1 --2- 172.21.15.123:0/763075008 >> v2:172.21.15.194:3300/0 conn(0x7f067006c9c0 0x7f0670071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f066f7fe640 1 -- 172.21.15.123:0/763075008 >> v2:172.21.15.194:3300/0 conn(0x7f067006c9c0 msgr2=0x7f0670071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.112+0000 7f066f7fe640 1 --2- 172.21.15.123:0/763075008 >> v2:172.21.15.194:3300/0 conn(0x7f067006c9c0 0x7f0670071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.113+0000 7f066f7fe640 1 -- 172.21.15.123:0/763075008 >> v1:172.21.15.194:6789/0 conn(0x7f06700c5e30 legacy=0x7f067015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.113+0000 7f066effd640 1 -- 172.21.15.123:0/763075008 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641078194 0 0) 0x7f067006c050 con 0x7f06700c5e30 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.113+0000 7f066f7fe640 1 -- 172.21.15.123:0/763075008 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06701579d0 con 0x7f06701581d0 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.113+0000 7f066f7fe640 1 --2- 172.21.15.123:0/763075008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670071110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f06700c3b20 tx=0x7f066402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494bba2f702b7203 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.113+0000 7f066effd640 1 -- 172.21.15.123:0/763075008 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664037070 con 0x7f06701581d0 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.113+0000 7f066effd640 1 -- 172.21.15.123:0/763075008 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066402ae50 con 0x7f06701581d0 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f066effd640 1 -- 172.21.15.123:0/763075008 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664032860 con 0x7f06701581d0 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 -- 172.21.15.123:0/763075008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 msgr2=0x7f0670071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 --2- 172.21.15.123:0/763075008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670071110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f06700c3b20 tx=0x7f066402a300 comp rx=0 tx=0).stop 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 -- 172.21.15.123:0/763075008 shutdown_connections 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 --2- 172.21.15.123:0/763075008 >> v2:172.21.15.194:3300/0 conn(0x7f067006c9c0 0x7f0670071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 --2- 172.21.15.123:0/763075008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670071110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 -- 172.21.15.123:0/763075008 >> 172.21.15.123:0/763075008 conn(0x7f067006ed00 msgr2=0x7f067006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 -- 172.21.15.123:0/763075008 shutdown_connections 2024-09-19T09:46:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.114+0000 7f06766a5640 1 -- 172.21.15.123:0/763075008 wait complete. 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.115+0000 7f06766a5640 1 Processor -- start 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.115+0000 7f06766a5640 1 -- start start 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f06766a5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067006c9c0 0x7f0670071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f06766a5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06700c5e30 0x7f0670155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f06766a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f06766a5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f067006bc10 con 0x7f06701581d0 2024-09-19T09:46:47.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f06766a5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f06700c4110 con 0x7f067006c9c0 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f06766a5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f067006bd90 con 0x7f06700c5e30 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58952/0 (socket says 172.21.15.123:58952) 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 -- 172.21.15.123:0/1900296368 learned_addr learned my addr 172.21.15.123:0/1900296368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f066ffff640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067006c9c0 0x7f0670071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f066f7fe640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06700c5e30 0x7f0670155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06700c5e30 msgr2=0x7f0670155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06700c5e30 0x7f0670155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067006c9c0 msgr2=0x7f0670071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067006c9c0 0x7f0670071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.116+0000 7f0674c42640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067014c160 con 0x7f06701581d0 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.117+0000 7f0674c42640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670155a60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f066800efc0 tx=0x7f066800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.117+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668018020 con 0x7f06701581d0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.117+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0668014480 con 0x7f06701581d0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.117+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668014850 con 0x7f06701581d0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.117+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067014ca40 con 0x7f06701581d0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.117+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06700cb0a0 con 0x7f06701581d0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.118+0000 7f06766a5640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 0x7f0670152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.118+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f067014cf60 con 0x7f06701527b0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.118+0000 7f066ffff640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 0x7f0670152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.118+0000 7f066ffff640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0670155200 con 0x7f06701527b0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.118+0000 7f066ffff640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 0x7f0670152b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f066000e960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.118+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0668005d10 con 0x7f06701581d0 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f065c06c2b0 0x7f065c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f066808bf40 con 0x7f06701581d0 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066f7fe640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f065c06c2b0 0x7f065c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06600052e0 con 0x7f06701527b0 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0660018070 con 0x7f06701527b0 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 msgr2=0x7f0670152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 0x7f0670152b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f066000e960 comp rx=0 tx=0).stop 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 msgr2=0x7f0670152b90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066cff9640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701527b0 0x7f0670152b90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.119+0000 7f066f7fe640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f065c06c2b0 0x7f065c06e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0664034000 tx=0x7f066402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.125+0000 7f06766a5640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 0x7f06701f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.125+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f067014c830 con 0x7f06701f3d50 2024-09-19T09:46:47.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.125+0000 7f066ffff640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 0x7f06701f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066ffff640 1 -- 172.21.15.123:0/1900296368 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f06700c6210 con 0x7f06701f3d50 2024-09-19T09:46:47.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066ffff640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 0x7f06701f4130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f0660001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660003a00 con 0x7f06701f3d50 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f0660003a00 con 0x7f06701f3d50 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 msgr2=0x7f06701f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066cff9640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 0x7f06701f4130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f0660001080 comp rx=0 tx=0).stop 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066cff9640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 msgr2=0x7f06701f4130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.126+0000 7f066cff9640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06701f3d50 0x7f06701f4130 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:47.129 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 20, 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 16443, 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:47.131 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:46:47.132 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:46:47.133 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:46:47.134 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:46:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:46:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:46:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:47.135 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.136 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:47.137 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:46:47.138 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.139 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.140 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:46:47.141 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:46:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:46:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:46:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:46:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:46:47.142 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:46:47.142 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:46:47.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f065c06c2b0 msgr2=0x7f065c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f065c06c2b0 0x7f065c06e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0664034000 tx=0x7f066402e000 comp rx=0 tx=0).stop 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 msgr2=0x7f0670155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 --2- 172.21.15.123:0/1900296368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701581d0 0x7f0670155a60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f066800efc0 tx=0x7f066800c490 comp rx=0 tx=0).stop 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f0674c42640 1 -- 172.21.15.123:0/1900296368 reap_dead start 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f0674c42640 1 -- 172.21.15.123:0/1900296368 reap_dead start 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 shutdown_connections 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 >> 172.21.15.123:0/1900296368 conn(0x7f067006ed00 msgr2=0x7f067014d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 shutdown_connections 2024-09-19T09:46:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.127+0000 7f06766a5640 1 -- 172.21.15.123:0/1900296368 wait complete. 2024-09-19T09:46:47.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:46:47.145 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-19T09:46:47.145 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:46:47.145 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-19T09:46:47.145 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:46:47.145 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:46:47.145 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:46:47.156 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:46:47.157 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:46:47.157 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.252+0000 7f9ff7128640 1 Processor -- start 2024-09-19T09:46:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.252+0000 7f9ff7128640 1 -- start start 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff7128640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9ff0155340 0x7f9ff0075c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff7128640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ff00c82a0 0x7f9ff006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff7128640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff015b150 con 0x7f9ff006db20 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff7128640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff015f5e0 con 0x7f9ff00c82a0 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff7128640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff015f040 con 0x7f9ff0155340 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff56c5640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7f9ff006db20 legacy=0x7f9ff015b630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ff00c82a0 0x7f9ff006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff4ec4640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f9ff0155340 msgr2=0x7f9ff0075c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ff00c82a0 0x7f9ff006d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58960/0 (socket says 172.21.15.123:58960) 2024-09-19T09:46:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 -- 172.21.15.123:0/1820550310 learned_addr learned my addr 172.21.15.123:0/1820550310 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9ff4ec4640 1 --2- 172.21.15.123:0/1820550310 >> v2:172.21.15.194:3300/0 conn(0x7f9ff0155340 0x7f9ff0075c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 -- 172.21.15.123:0/1820550310 >> v2:172.21.15.194:3300/0 conn(0x7f9ff0155340 msgr2=0x7f9ff0075c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 --2- 172.21.15.123:0/1820550310 >> v2:172.21.15.194:3300/0 conn(0x7f9ff0155340 0x7f9ff0075c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 -- 172.21.15.123:0/1820550310 >> v1:172.21.15.194:6789/0 conn(0x7f9ff006db20 legacy=0x7f9ff015b630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.253+0000 7f9feffff640 1 -- 172.21.15.123:0/1820550310 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff015f300 con 0x7f9ff00c82a0 2024-09-19T09:46:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.254+0000 7f9feffff640 1 --2- 172.21.15.123:0/1820550310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff006d5e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00703e0 tx=0x7f9fdc02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813cb41b6bb830e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.254+0000 7f9fef7fe640 1 -- 172.21.15.123:0/1820550310 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc037070 con 0x7f9ff00c82a0 2024-09-19T09:46:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.254+0000 7f9fef7fe640 1 -- 172.21.15.123:0/1820550310 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc032440 con 0x7f9ff00c82a0 2024-09-19T09:46:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.254+0000 7f9fef7fe640 1 -- 172.21.15.123:0/1820550310 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc032810 con 0x7f9ff00c82a0 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 -- 172.21.15.123:0/1820550310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 msgr2=0x7f9ff006d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 --2- 172.21.15.123:0/1820550310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff006d5e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00703e0 tx=0x7f9fdc02a2e0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 -- 172.21.15.123:0/1820550310 shutdown_connections 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 --2- 172.21.15.123:0/1820550310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff006d5e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 --2- 172.21.15.123:0/1820550310 >> v2:172.21.15.194:3300/0 conn(0x7f9ff0155340 0x7f9ff0075c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 -- 172.21.15.123:0/1820550310 >> 172.21.15.123:0/1820550310 conn(0x7f9ff006c4c0 msgr2=0x7f9ff00cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 -- 172.21.15.123:0/1820550310 shutdown_connections 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.255+0000 7f9ff7128640 1 -- 172.21.15.123:0/1820550310 wait complete. 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.256+0000 7f9ff7128640 1 Processor -- start 2024-09-19T09:46:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.256+0000 7f9ff7128640 1 -- start start 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ff006db20 0x7f9ff0147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff015d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff0155340 0x7f9ff0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0155720 con 0x7f9ff00c82a0 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff00c9770 con 0x7f9ff0155340 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff00c9a50 con 0x7f9ff006db20 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff56c5640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff0155340 msgr2=0x7f9ff0158c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff56c5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff0155340 0x7f9ff0158c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff4ec4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ff006db20 0x7f9ff0147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff015d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58964/0 (socket says 172.21.15.123:58964) 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 -- 172.21.15.123:0/56233345 learned_addr learned my addr 172.21.15.123:0/56233345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 -- 172.21.15.123:0/56233345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ff006db20 msgr2=0x7f9ff0147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ff006db20 0x7f9ff0147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 -- 172.21.15.123:0/56233345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff0155340 msgr2=0x7f9ff0158c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff0155340 0x7f9ff0158c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 -- 172.21.15.123:0/56233345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff0147f40 con 0x7f9ff00c82a0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9feffff640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff015d790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc000c00 tx=0x7f9fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc041070 con 0x7f9ff00c82a0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc03c870 con 0x7f9ff00c82a0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff00cb250 con 0x7f9ff00c82a0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.257+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc037040 con 0x7f9ff00c82a0 2024-09-19T09:46:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.258+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff014db00 con 0x7f9ff00c82a0 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.259+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff00c7c60 con 0x7f9ff00c82a0 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.259+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9fdc044070 con 0x7f9ff00c82a0 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.260+0000 7f9fed7fa640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fd406c260 0x7f9fd406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.260+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f9fdc0abd50 con 0x7f9ff00c82a0 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.260+0000 7f9ff4ec4640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fd406c260 0x7f9fd406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.260+0000 7f9ff4ec4640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fd406c260 0x7f9fd406e720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00cd0e0 tx=0x7f9fe4003b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.264+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9fdc0af030 con 0x7f9ff00c82a0 2024-09-19T09:46:47.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.493+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ff0158a10 con 0x7f9ff00c82a0 2024-09-19T09:46:47.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.494+0000 7f9fed7fa640 1 -- 172.21.15.123:0/56233345 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f9ff0147f40 con 0x7f9ff00c82a0 2024-09-19T09:46:47.496 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fd406c260 msgr2=0x7f9fd406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fd406c260 0x7f9fd406e720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00cd0e0 tx=0x7f9fe4003b90 comp rx=0 tx=0).stop 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 msgr2=0x7f9ff015d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff015d790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc000c00 tx=0x7f9fdc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 shutdown_connections 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff0155340 0x7f9ff0158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ff00c82a0 0x7f9ff015d790 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9fd406c260 0x7f9fd406e720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 --2- 172.21.15.123:0/56233345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ff006db20 0x7f9ff0147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:47.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 >> 172.21.15.123:0/56233345 conn(0x7f9ff006c4c0 msgr2=0x7f9ff014ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:47.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 shutdown_connections 2024-09-19T09:46:47.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:47.496+0000 7f9ff7128640 1 -- 172.21.15.123:0/56233345 wait complete. 2024-09-19T09:46:49.403 INFO:tasks.workunit.client.0.smithi123.stdout:fs setup took 24 secs 2024-09-19T09:46:50.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.768+0000 7fb68af0a640 1 Processor -- start 2024-09-19T09:46:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.769+0000 7fb68af0a640 1 -- start start 2024-09-19T09:46:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.770+0000 7fb68af0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6841552a0 0x7fb6840ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.770+0000 7fb68af0a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb68415bb50 0x7fb6840c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.771+0000 7fb68af0a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6840cd130 con 0x7fb6840cb7f0 2024-09-19T09:46:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.771+0000 7fb68af0a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840c5f50 con 0x7fb6841552a0 2024-09-19T09:46:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.771+0000 7fb68af0a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840c61a0 con 0x7fb68415bb50 2024-09-19T09:46:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.771+0000 7fb683fff640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7fb68415bb50 msgr2=0x7fb6840c6f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:46:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.772+0000 7fb683fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb68415bb50 0x7fb6840c6f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.772+0000 7fb688ca6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6841552a0 0x7fb6840ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.777+0000 7fb6894a7640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7fb6840cb7f0 legacy=0x7fb68415e640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.778+0000 7fb688ca6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6841552a0 0x7fb6840ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58966/0 (socket says 172.21.15.123:58966) 2024-09-19T09:46:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.778+0000 7fb688ca6640 1 -- 172.21.15.123:0/164219509 learned_addr learned my addr 172.21.15.123:0/164219509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.784+0000 7fb688ca6640 1 -- 172.21.15.123:0/164219509 >> v2:172.21.15.194:3300/0 conn(0x7fb68415bb50 msgr2=0x7fb6840c6f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.784+0000 7fb688ca6640 1 --2- 172.21.15.123:0/164219509 >> v2:172.21.15.194:3300/0 conn(0x7fb68415bb50 0x7fb6840c6f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:50.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.784+0000 7fb688ca6640 1 -- 172.21.15.123:0/164219509 >> v1:172.21.15.194:6789/0 conn(0x7fb6840cb7f0 legacy=0x7fb68415e640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:50.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.784+0000 7fb688ca6640 1 -- 172.21.15.123:0/164219509 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840c6480 con 0x7fb6841552a0 2024-09-19T09:46:50.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.787+0000 7fb688ca6640 1 --2- 172.21.15.123:0/164219509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6841552a0 0x7fb6840ccaa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb68408e3a0 tx=0x7fb67802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4895b93b9bb169 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:50.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.788+0000 7fb6837fe640 1 -- 172.21.15.123:0/164219509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678037070 con 0x7fb6841552a0 2024-09-19T09:46:50.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.788+0000 7fb6837fe640 1 -- 172.21.15.123:0/164219509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678032440 con 0x7fb6841552a0 2024-09-19T09:46:50.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.788+0000 7fb6837fe640 1 -- 172.21.15.123:0/164219509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678032810 con 0x7fb6841552a0 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.789+0000 7fb68af0a640 1 -- 172.21.15.123:0/164219509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6841552a0 msgr2=0x7fb6840ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.789+0000 7fb68af0a640 1 --2- 172.21.15.123:0/164219509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6841552a0 0x7fb6840ccaa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb68408e3a0 tx=0x7fb67802a2e0 comp rx=0 tx=0).stop 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.789+0000 7fb68af0a640 1 -- 172.21.15.123:0/164219509 shutdown_connections 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.789+0000 7fb68af0a640 1 --2- 172.21.15.123:0/164219509 >> v2:172.21.15.194:3300/0 conn(0x7fb68415bb50 0x7fb6840c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.789+0000 7fb68af0a640 1 --2- 172.21.15.123:0/164219509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6841552a0 0x7fb6840ccaa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.789+0000 7fb68af0a640 1 -- 172.21.15.123:0/164219509 >> 172.21.15.123:0/164219509 conn(0x7fb6840d0a00 msgr2=0x7fb6840d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.790+0000 7fb68af0a640 1 -- 172.21.15.123:0/164219509 shutdown_connections 2024-09-19T09:46:50.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.790+0000 7fb68af0a640 1 -- 172.21.15.123:0/164219509 wait complete. 2024-09-19T09:46:50.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.792+0000 7fb68af0a640 1 Processor -- start 2024-09-19T09:46:50.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.792+0000 7fb68af0a640 1 -- start start 2024-09-19T09:46:50.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.793+0000 7fb68af0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 0x7fb6841519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:50.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.793+0000 7fb68af0a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6841552a0 0x7fb6841f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:50.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb688ca6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 0x7fb6841519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:50.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb688ca6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 0x7fb6841519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58974/0 (socket says 172.21.15.123:58974) 2024-09-19T09:46:50.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb68af0a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb68415bb50 0x7fb68414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:50.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb68af0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb68415bf50 con 0x7fb6840cb7f0 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb68af0a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840c6a40 con 0x7fb6841552a0 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb68af0a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb6840c5c20 con 0x7fb68415bb50 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.794+0000 7fb688ca6640 1 -- 172.21.15.123:0/3119438919 learned_addr learned my addr 172.21.15.123:0/3119438919 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb688ca6640 1 -- 172.21.15.123:0/3119438919 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb68415bb50 msgr2=0x7fb68414b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb688ca6640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb68415bb50 0x7fb68414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb688ca6640 1 -- 172.21.15.123:0/3119438919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6841552a0 msgr2=0x7fb6841f4600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:46:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb688ca6640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6841552a0 0x7fb6841f4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb688ca6640 1 -- 172.21.15.123:0/3119438919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840d0460 con 0x7fb6840cb7f0 2024-09-19T09:46:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb688ca6640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 0x7fb6841519e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb678009960 tx=0x7fb6780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.795+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678041070 con 0x7fb6840cb7f0 2024-09-19T09:46:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.796+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67803c720 con 0x7fb6840cb7f0 2024-09-19T09:46:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.796+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6840d0700 con 0x7fb6840cb7f0 2024-09-19T09:46:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.796+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678037040 con 0x7fb6840cb7f0 2024-09-19T09:46:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.796+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6840cf490 con 0x7fb6840cb7f0 2024-09-19T09:46:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.801+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb684154e00 con 0x7fb6840cb7f0 2024-09-19T09:46:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.807+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb678044070 con 0x7fb6840cb7f0 2024-09-19T09:46:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.807+0000 7fb6817fa640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb67006c300 0x7fb67006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.808+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb6780abcb0 con 0x7fb6840cb7f0 2024-09-19T09:46:50.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.812+0000 7fb683fff640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb67006c300 0x7fb67006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.813+0000 7fb683fff640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb67006c300 0x7fb67006e7c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb6840cbd80 tx=0x7fb67c009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:50.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:50.819+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb684154e00 con 0x7fb6840cb7f0 2024-09-19T09:46:51.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.441+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6840c5a00 con 0x7fb6840cb7f0 2024-09-19T09:46:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.444+0000 7fb6817fa640 1 -- 172.21.15.123:0/3119438919 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb67807a630 con 0x7fb6840cb7f0 2024-09-19T09:46:51.449 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb67006c300 msgr2=0x7fb67006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb67006c300 0x7fb67006e7c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb6840cbd80 tx=0x7fb67c009230 comp rx=0 tx=0).stop 2024-09-19T09:46:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 msgr2=0x7fb6841519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 0x7fb6841519e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb678009960 tx=0x7fb6780046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 shutdown_connections 2024-09-19T09:46:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb67006c300 0x7fb67006e7c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb68415bb50 0x7fb68414b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6841552a0 0x7fb6841f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 --2- 172.21.15.123:0/3119438919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6840cb7f0 0x7fb6841519e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 >> 172.21.15.123:0/3119438919 conn(0x7fb6840d0a00 msgr2=0x7fb6840c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.447+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 shutdown_connections 2024-09-19T09:46:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:51.448+0000 7fb68af0a640 1 -- 172.21.15.123:0/3119438919 wait complete. 2024-09-19T09:46:52.950 INFO:tasks.workunit.client.0.smithi123.stdout:Syncing()...3 sec 2024-09-19T09:46:52.951 INFO:tasks.workunit.client.0.smithi123.stdout:Starting Actual Benchmark At: Thu Sep 19 09:46:52 2024 2024-09-19T09:46:52.951 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:46:54.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:54.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.675+0000 7fbac0477640 1 Processor -- start 2024-09-19T09:46:54.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.676+0000 7fbac0477640 1 -- start start 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.677+0000 7fbac0477640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbab815b350 0x7fbab8157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.677+0000 7fbac0477640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab80c7b30 con 0x7fbab80c8710 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.677+0000 7fbac0477640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab80c7e10 con 0x7fbab81514a0 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.677+0000 7fbac0477640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbab8151880 con 0x7fbab815b350 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.677+0000 7fbabe213640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7fbab81514a0 legacy=0x7fbab80c23b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.678+0000 7fbabea14640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbab80c8710 0x7fbab80c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32888/0 (socket says 172.21.15.123:32888) 2024-09-19T09:46:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.678+0000 7fbabea14640 1 -- 172.21.15.123:0/2136984232 learned_addr learned my addr 172.21.15.123:0/2136984232 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.678+0000 7fbabda12640 1 --2- 172.21.15.123:0/2136984232 >> v2:172.21.15.123:3300/0 conn(0x7fbab815b350 0x7fbab8157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.679+0000 7fbabda12640 1 -- 172.21.15.123:0/2136984232 >> v1:172.21.15.194:6789/0 conn(0x7fbab81514a0 legacy=0x7fbab80c23b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:54.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.679+0000 7fbabda12640 1 -- 172.21.15.123:0/2136984232 >> v1:172.21.15.123:6789/0 conn(0x7fbab80c8710 legacy=0x7fbab80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:54.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.679+0000 7fbabda12640 1 -- 172.21.15.123:0/2136984232 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab815a870 con 0x7fbab815b350 2024-09-19T09:46:54.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.681+0000 7fbabda12640 1 --2- 172.21.15.123:0/2136984232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab815b350 0x7fbab8157b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40097a0 tx=0x7fbaa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92520ebac94454b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:54.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.684+0000 7fbabd211640 1 -- 172.21.15.123:0/2136984232 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4037070 con 0x7fbab815b350 2024-09-19T09:46:54.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.684+0000 7fbabd211640 1 -- 172.21.15.123:0/2136984232 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa4032440 con 0x7fbab815b350 2024-09-19T09:46:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.684+0000 7fbabd211640 1 -- 172.21.15.123:0/2136984232 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4032810 con 0x7fbab815b350 2024-09-19T09:46:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.685+0000 7fbac0477640 1 -- 172.21.15.123:0/2136984232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab815b350 msgr2=0x7fbab8157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.685+0000 7fbac0477640 1 --2- 172.21.15.123:0/2136984232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab815b350 0x7fbab8157b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40097a0 tx=0x7fbaa402a270 comp rx=0 tx=0).stop 2024-09-19T09:46:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.685+0000 7fbac0477640 1 -- 172.21.15.123:0/2136984232 shutdown_connections 2024-09-19T09:46:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.685+0000 7fbac0477640 1 --2- 172.21.15.123:0/2136984232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab815b350 0x7fbab8157b50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.685+0000 7fbac0477640 1 -- 172.21.15.123:0/2136984232 >> 172.21.15.123:0/2136984232 conn(0x7fbab806f110 msgr2=0x7fbab806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.687+0000 7fbac0477640 1 -- 172.21.15.123:0/2136984232 shutdown_connections 2024-09-19T09:46:54.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.689+0000 7fbac0477640 1 -- 172.21.15.123:0/2136984232 wait complete. 2024-09-19T09:46:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.690+0000 7fbac0477640 1 Processor -- start 2024-09-19T09:46:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.692+0000 7fbac0477640 1 -- start start 2024-09-19T09:46:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbac0477640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab80c8710 0x7fbab814c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbac0477640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 0x7fbab814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbabe213640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab80c8710 msgr2=0x7fbab814c760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbabe213640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab80c8710 0x7fbab814c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbac0477640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbab815b350 0x7fbab8150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbac0477640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbab80c9250 con 0x7fbab81514a0 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbac0477640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbab815ae30 con 0x7fbab80c8710 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.693+0000 7fbac0477640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fbab80c93d0 con 0x7fbab815b350 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.694+0000 7fbabda12640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 0x7fbab814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.694+0000 7fbabda12640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 0x7fbab814fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37570/0 (socket says 172.21.15.123:37570) 2024-09-19T09:46:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.694+0000 7fbabda12640 1 -- 172.21.15.123:0/1469947305 learned_addr learned my addr 172.21.15.123:0/1469947305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:46:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.695+0000 7fbabea14640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbab815b350 0x7fbab8150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.695+0000 7fbabda12640 1 -- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbab815b350 msgr2=0x7fbab8150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.695+0000 7fbabda12640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbab815b350 0x7fbab8150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.695+0000 7fbabda12640 1 -- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab80c8710 msgr2=0x7fbab814c760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:46:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.695+0000 7fbabda12640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab80c8710 0x7fbab814c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.695+0000 7fbabda12640 1 -- 172.21.15.123:0/1469947305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab81f5ba0 con 0x7fbab81514a0 2024-09-19T09:46:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.696+0000 7fbabda12640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 0x7fbab814fd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaa402a860 tx=0x7fbaa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.696+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4042020 con 0x7fbab81514a0 2024-09-19T09:46:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.696+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa4030890 con 0x7fbab81514a0 2024-09-19T09:46:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.696+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4037040 con 0x7fbab81514a0 2024-09-19T09:46:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.698+0000 7fbac0477640 1 -- 172.21.15.123:0/1469947305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab81f5e80 con 0x7fbab81514a0 2024-09-19T09:46:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.698+0000 7fbac0477640 1 -- 172.21.15.123:0/1469947305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab81f6440 con 0x7fbab81514a0 2024-09-19T09:46:54.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.699+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab8068f50 con 0x7fbab81514a0 2024-09-19T09:46:54.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.703+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbaa4045020 con 0x7fbab81514a0 2024-09-19T09:46:54.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.703+0000 7fbab6ffd640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fba9c06c2e0 0x7fba9c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:54.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.704+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fbaa4078700 con 0x7fbab81514a0 2024-09-19T09:46:54.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.704+0000 7fbabe213640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fba9c06c2e0 0x7fba9c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:54.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.705+0000 7fbabe213640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fba9c06c2e0 0x7fba9c06e7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaac003cb0 tx=0x7fbaac009270 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:54.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:54.709+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbaa404c030 con 0x7fbab81514a0 2024-09-19T09:46:55.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.248+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbab80c1f80 con 0x7fbab81514a0 2024-09-19T09:46:55.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.249+0000 7fbab6ffd640 1 -- 172.21.15.123:0/1469947305 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fbaa404c030 con 0x7fbab81514a0 2024-09-19T09:46:55.251 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:46:55.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.254+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fba9c06c2e0 msgr2=0x7fba9c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:55.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.254+0000 7fbab4ff9640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fba9c06c2e0 0x7fba9c06e7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaac003cb0 tx=0x7fbaac009270 comp rx=0 tx=0).stop 2024-09-19T09:46:55.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.254+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 msgr2=0x7fbab814fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:55.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.254+0000 7fbab4ff9640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 0x7fbab814fd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaa402a860 tx=0x7fbaa40046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.255+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 shutdown_connections 2024-09-19T09:46:55.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.255+0000 7fbab4ff9640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fba9c06c2e0 0x7fba9c06e7a0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaac003cb0 tx=0x7fbaac009270 comp rx=0 tx=0).stop 2024-09-19T09:46:55.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.255+0000 7fbab4ff9640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbab815b350 0x7fbab8150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.255+0000 7fbab4ff9640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbab81514a0 0x7fbab814fd30 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaa402a860 tx=0x7fbaa40046c0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.255+0000 7fbab4ff9640 1 --2- 172.21.15.123:0/1469947305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbab80c8710 0x7fbab814c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:55.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.255+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 >> 172.21.15.123:0/1469947305 conn(0x7fbab806f110 msgr2=0x7fbab81e1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:55.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.256+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 shutdown_connections 2024-09-19T09:46:55.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:55.257+0000 7fbab4ff9640 1 -- 172.21.15.123:0/1469947305 wait complete. 2024-09-19T09:46:58.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:46:58.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.496+0000 7fc9ed752640 1 Processor -- start 2024-09-19T09:46:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.497+0000 7fc9ed752640 1 -- start start 2024-09-19T09:46:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.498+0000 7fc9ed752640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.498+0000 7fc9ed752640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e80c7c00 con 0x7fc9e80c2870 2024-09-19T09:46:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.498+0000 7fc9ed752640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e8162b70 con 0x7fc9e8159720 2024-09-19T09:46:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.498+0000 7fc9ed752640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e8162e50 con 0x7fc9e80c34c0 2024-09-19T09:46:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.499+0000 7fc9e6ffd640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7fc9e8159720 legacy=0x7fc9e815ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.499+0000 7fc9e77fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc9e80c2870 0x7fc9e80c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32902/0 (socket says 172.21.15.123:32902) 2024-09-19T09:46:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.499+0000 7fc9e77fe640 1 -- 172.21.15.123:0/1812708933 learned_addr learned my addr 172.21.15.123:0/1812708933 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:46:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.503+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.503+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.503+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.503+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.503+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:46:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.700+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1812708933 >> v1:172.21.15.194:6789/0 conn(0x7fc9e8159720 legacy=0x7fc9e815ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.704+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.704+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.704+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.704+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:58.704+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:46:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.101+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1812708933 >> v1:172.21.15.194:6789/0 conn(0x7fc9e8159720 legacy=0x7fc9e815ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.105+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.105+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.105+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.105+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.106+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:46:59.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.902+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1812708933 >> v1:172.21.15.194:6789/0 conn(0x7fc9e8159720 legacy=0x7fc9e815ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:46:59.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.907+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:59.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.908+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:46:59.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.908+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:46:59.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.908+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:46:59.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:46:59.908+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.498+0000 7fc9e4ff9640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 msgr2=0x7fc9e80c7590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.498+0000 7fc9e4ff9640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e80c34c0 0x7fc9e80c7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.498+0000 7fc9e4ff9640 1 -- 172.21.15.123:0/1812708933 >> v1:172.21.15.194:6789/0 conn(0x7fc9e8159720 legacy=0x7fc9e815ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.498+0000 7fc9e4ff9640 1 -- 172.21.15.123:0/1812708933 >> v1:172.21.15.123:6789/0 conn(0x7fc9e80c2870 legacy=0x7fc9e80c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e4ff9640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 0x7fc9d4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e4ff9640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e4ff9640 1 -- 172.21.15.123:0/1812708933 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e8162e50 con 0x7fc9d40061a0 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e4ff9640 1 -- 172.21.15.123:0/1812708933 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d4008d10 con 0x7fc9d40036d0 2024-09-19T09:47:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 msgr2=0x7fc9d4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e6ffd640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 0x7fc9d4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 msgr2=0x7fc9d4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 msgr2=0x7fc9d4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.499+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:01.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.700+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 msgr2=0x7fc9d4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:01.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.700+0000 7fc9e6ffd640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 0x7fc9d4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:47:01.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.700+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.700+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 msgr2=0x7fc9d4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:47:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.700+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 msgr2=0x7fc9d4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.700+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:01.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:01.701+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:47:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.101+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 msgr2=0x7fc9d4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.101+0000 7fc9e6ffd640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 0x7fc9d4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:47:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.102+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.123:3300/0 conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:47:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.102+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 msgr2=0x7fc9d4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.102+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> v2:172.21.15.194:3300/0 conn(0x7fc9d40036d0 0x7fc9d4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.102+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1812708933 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e8163130 con 0x7fc9d40061a0 2024-09-19T09:47:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.104+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9d4008660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4003660 tx=0x7fc9e002bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497d4eba5d838364 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:47:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.108+0000 7fc9e5ffb640 1 -- 172.21.15.123:0/1812708933 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e002d4b0 con 0x7fc9d40061a0 2024-09-19T09:47:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.108+0000 7fc9e5ffb640 1 -- 172.21.15.123:0/1812708933 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e002d650 con 0x7fc9d40061a0 2024-09-19T09:47:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.109+0000 7fc9ed752640 1 -- 172.21.15.123:0/1812708933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 msgr2=0x7fc9d4008660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.109+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9d4008660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4003660 tx=0x7fc9e002bba0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.109+0000 7fc9e77fe640 1 -- 172.21.15.123:0/1812708933 reap_dead start 2024-09-19T09:47:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.110+0000 7fc9ed752640 1 -- 172.21.15.123:0/1812708933 shutdown_connections 2024-09-19T09:47:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.110+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1812708933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9d4008660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.110+0000 7fc9ed752640 1 -- 172.21.15.123:0/1812708933 >> 172.21.15.123:0/1812708933 conn(0x7fc9e806f110 msgr2=0x7fc9e806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.110+0000 7fc9ed752640 1 -- 172.21.15.123:0/1812708933 shutdown_connections 2024-09-19T09:47:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.110+0000 7fc9ed752640 1 -- 172.21.15.123:0/1812708933 wait complete. 2024-09-19T09:47:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.112+0000 7fc9ed752640 1 Processor -- start 2024-09-19T09:47:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.113+0000 7fc9ed752640 1 -- start start 2024-09-19T09:47:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.114+0000 7fc9ed752640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9e80c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.114+0000 7fc9ed752640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9e815c4d0 0x7fc9e81fe300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.114+0000 7fc9ed752640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e81fe840 0x7fc9e8201520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.114+0000 7fc9ed752640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e80c8990 con 0x7fc9d40061a0 2024-09-19T09:47:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.114+0000 7fc9ed752640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8159b00 con 0x7fc9e815c4d0 2024-09-19T09:47:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.114+0000 7fc9ed752640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e80c8b10 con 0x7fc9e81fe840 2024-09-19T09:47:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9e80c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9e80c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37592/0 (socket says 172.21.15.123:37592) 2024-09-19T09:47:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1572480582 learned_addr learned my addr 172.21.15.123:0/1572480582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e67fc640 1 -- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9e815c4d0 msgr2=0x7fc9e81fe300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e77fe640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e81fe840 0x7fc9e8201520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9e815c4d0 0x7fc9e81fe300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e81fe840 msgr2=0x7fc9e8201520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e81fe840 0x7fc9e8201520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9e815c4d0 msgr2=0x7fc9e81fe300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9e815c4d0 0x7fc9e81fe300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 -- 172.21.15.123:0/1572480582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e815ba00 con 0x7fc9d40061a0 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.115+0000 7fc9e6ffd640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9e80c4ea0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00b980 tx=0x7fc9dc00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.116+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00cc30 con 0x7fc9d40061a0 2024-09-19T09:47:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.116+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e81fecc0 con 0x7fc9d40061a0 2024-09-19T09:47:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.116+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e80c67f0 con 0x7fc9d40061a0 2024-09-19T09:47:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.119+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9dc010030 con 0x7fc9d40061a0 2024-09-19T09:47:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.119+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e80c7590 con 0x7fc9d40061a0 2024-09-19T09:47:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.120+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc015420 con 0x7fc9d40061a0 2024-09-19T09:47:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.121+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc9dc0143d0 con 0x7fc9d40061a0 2024-09-19T09:47:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.121+0000 7fc9cf7fe640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc9d406d050 0x7fc9d406f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.121+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc9dc08aeb0 con 0x7fc9d40061a0 2024-09-19T09:47:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.125+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc9d406d050 0x7fc9d406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.134+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc9e81fecc0 con 0x7fc9d40061a0 2024-09-19T09:47:02.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.149+0000 7fc9e67fc640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc9d406d050 0x7fc9d406f510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0036000 tx=0x7fc9e002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.660+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc9e815ce00 con 0x7fc9d40061a0 2024-09-19T09:47:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.662+0000 7fc9cf7fe640 1 -- 172.21.15.123:0/1572480582 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fc9dc058fc0 con 0x7fc9d40061a0 2024-09-19T09:47:02.675 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":24,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:02.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.677+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc9d406d050 msgr2=0x7fc9d406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.678+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc9d406d050 0x7fc9d406f510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0036000 tx=0x7fc9e002f000 comp rx=0 tx=0).stop 2024-09-19T09:47:02.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.678+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 msgr2=0x7fc9e80c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.678+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9e80c4ea0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00b980 tx=0x7fc9dc00be40 comp rx=0 tx=0).stop 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.678+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 shutdown_connections 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc9d406d050 0x7fc9d406f510 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9e81fe840 0x7fc9e8201520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9e815c4d0 0x7fc9e81fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 --2- 172.21.15.123:0/1572480582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9d40061a0 0x7fc9e80c4ea0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 >> 172.21.15.123:0/1572480582 conn(0x7fc9e806f110 msgr2=0x7fc9e80c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 shutdown_connections 2024-09-19T09:47:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.679+0000 7fc9ed752640 1 -- 172.21.15.123:0/1572480582 wait complete. 2024-09-19T09:47:02.711 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:47:02.712 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:47:02.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:47:02.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.921+0000 7f93a7594640 1 Processor -- start 2024-09-19T09:47:02.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.921+0000 7f93a7594640 1 -- start start 2024-09-19T09:47:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.922+0000 7f93a7594640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 0x7f9398045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.922+0000 7f93a7594640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f939804a680 0x7f939804aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.922+0000 7f93a7594640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93980e6d30 con 0x7f93980e5f30 2024-09-19T09:47:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.922+0000 7f93a7594640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f9398044d40 con 0x7f939804a680 2024-09-19T09:47:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.922+0000 7f93a7594640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f93980dd170 con 0x7f93980dcd90 2024-09-19T09:47:02.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.922+0000 7f93a5d91640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f939804a680 msgr2=0x7f939804aa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:02.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.923+0000 7f93a6d93640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7f93980e5f30 legacy=0x7f93980e63c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:47:02.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.923+0000 7f93a5d91640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f939804a680 0x7f939804aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:02.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.925+0000 7f93a6592640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 0x7f9398045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.927+0000 7f93a6592640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 0x7f9398045d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:48508/0 (socket says 172.21.15.123:48508) 2024-09-19T09:47:02.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.927+0000 7f93a6592640 1 -- 172.21.15.123:0/319079749 learned_addr learned my addr 172.21.15.123:0/319079749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:02.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.930+0000 7f93a6592640 1 -- 172.21.15.123:0/319079749 >> v2:172.21.15.194:3300/0 conn(0x7f939804a680 msgr2=0x7f939804aa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:02.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.930+0000 7f93a6592640 1 --2- 172.21.15.123:0/319079749 >> v2:172.21.15.194:3300/0 conn(0x7f939804a680 0x7f939804aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.930+0000 7f93a6592640 1 -- 172.21.15.123:0/319079749 >> v1:172.21.15.194:6789/0 conn(0x7f93980e5f30 legacy=0x7f93980e63c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:02.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.930+0000 7f93a6592640 1 -- 172.21.15.123:0/319079749 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9398044f90 con 0x7f93980dcd90 2024-09-19T09:47:02.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.932+0000 7f93a6592640 1 --2- 172.21.15.123:0/319079749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 0x7f9398045d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f939c009870 tx=0x7f939c02a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fee4052cdc935d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.935+0000 7f93a5590640 1 -- 172.21.15.123:0/319079749 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c037070 con 0x7f93980dcd90 2024-09-19T09:47:02.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.935+0000 7f93a5590640 1 -- 172.21.15.123:0/319079749 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c032440 con 0x7f93980dcd90 2024-09-19T09:47:02.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.935+0000 7f93a5590640 1 -- 172.21.15.123:0/319079749 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c032810 con 0x7f93980dcd90 2024-09-19T09:47:02.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.937+0000 7f93a7594640 1 -- 172.21.15.123:0/319079749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 msgr2=0x7f9398045d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.937+0000 7f93a7594640 1 --2- 172.21.15.123:0/319079749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 0x7f9398045d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f939c009870 tx=0x7f939c02a2c0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.937+0000 7f93a7594640 1 -- 172.21.15.123:0/319079749 shutdown_connections 2024-09-19T09:47:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.937+0000 7f93a7594640 1 --2- 172.21.15.123:0/319079749 >> v2:172.21.15.194:3300/0 conn(0x7f939804a680 0x7f939804aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.937+0000 7f93a7594640 1 --2- 172.21.15.123:0/319079749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980dcd90 0x7f9398045d50 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f939c009870 tx=0x7f939c02a2c0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.937+0000 7f93a7594640 1 -- 172.21.15.123:0/319079749 >> 172.21.15.123:0/319079749 conn(0x7f939804fc50 msgr2=0x7f9398050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.943+0000 7f93a7594640 1 -- 172.21.15.123:0/319079749 shutdown_connections 2024-09-19T09:47:02.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.947+0000 7f93a7594640 1 -- 172.21.15.123:0/319079749 wait complete. 2024-09-19T09:47:02.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.949+0000 7f93a7594640 1 Processor -- start 2024-09-19T09:47:02.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.950+0000 7f93a7594640 1 -- start start 2024-09-19T09:47:02.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.951+0000 7f93a7594640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939804a680 0x7f93980dd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.951+0000 7f93a7594640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980e5f30 0x7f93980c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.951+0000 7f93a7594640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 0x7f93980c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a6d93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 0x7f93980c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a6d93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 0x7f93980c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37600/0 (socket says 172.21.15.123:37600) 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a6d93640 1 -- 172.21.15.123:0/412950248 learned_addr learned my addr 172.21.15.123:0/412950248 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a7594640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9398045550 con 0x7f93980ddb40 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a6592640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939804a680 msgr2=0x7f93980dd600 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a6592640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939804a680 0x7f93980dd600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a5d91640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980e5f30 0x7f93980c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a7594640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f93980e6ad0 con 0x7f939804a680 2024-09-19T09:47:02.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.952+0000 7f93a7594640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9398045830 con 0x7f93980e5f30 2024-09-19T09:47:02.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.953+0000 7f93a6d93640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980e5f30 msgr2=0x7f93980c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.953+0000 7f93a6d93640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980e5f30 0x7f93980c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.953+0000 7f93a6d93640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939804a680 msgr2=0x7f93980dd600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.953+0000 7f93a6d93640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939804a680 0x7f93980dd600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.953+0000 7f93a6d93640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980cea10 con 0x7f93980ddb40 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.954+0000 7f93a6d93640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 0x7f93980c3420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f93a006a960 tx=0x7f93a0069a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.954+0000 7f93a5d91640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980e5f30 0x7f93980c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.955+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0091070 con 0x7f93980ddb40 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.955+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a0074260 con 0x7f93980ddb40 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.955+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0095610 con 0x7f93980ddb40 2024-09-19T09:47:02.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.955+0000 7f93a7594640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93980bcd60 con 0x7f93980ddb40 2024-09-19T09:47:02.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.957+0000 7f93a7594640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93980e3de0 con 0x7f93980ddb40 2024-09-19T09:47:02.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.957+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f93a0094070 con 0x7f93980ddb40 2024-09-19T09:47:02.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.958+0000 7f9396ffd640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938c06c470 0x7f938c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.959+0000 7f93a6592640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938c06c470 0x7f938c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.962+0000 7f93a6592640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938c06c470 0x7f938c06e930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f939c034000 tx=0x7f939c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.962+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f93a00d31b0 con 0x7f93980ddb40 2024-09-19T09:47:02.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.962+0000 7f9394ff9640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 0x7f939804ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.963+0000 7f93a5d91640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 0x7f939804ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.963+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93980d0170 con 0x7f93980cfc50 2024-09-19T09:47:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.964+0000 7f93a5d91640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93980e0db0 con 0x7f93980cfc50 2024-09-19T09:47:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.964+0000 7f93a5d91640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 0x7f939804ea80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f93980d0a90 tx=0x7f939000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.964+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390003ba0 con 0x7f93980cfc50 2024-09-19T09:47:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.965+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9390016070 con 0x7f93980cfc50 2024-09-19T09:47:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.965+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 msgr2=0x7f939804ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.965+0000 7f9396ffd640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 0x7f939804ea80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f93980d0a90 tx=0x7f939000cc50 comp rx=0 tx=0).stop 2024-09-19T09:47:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.965+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 msgr2=0x7f939804ea80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.965+0000 7f9396ffd640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980cfc50 0x7f939804ea80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.987+0000 7f9394ff9640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 0x7f93980bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.987+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93980ceea0 con 0x7f93980bb1e0 2024-09-19T09:47:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.988+0000 7f93a5d91640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 0x7f93980bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.988+0000 7f93a5d91640 1 -- 172.21.15.123:0/412950248 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f939804b1c0 con 0x7f93980bb1e0 2024-09-19T09:47:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:02.989+0000 7f93a5d91640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 0x7f93980bb5c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93980d02f0 tx=0x7f93900059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.003+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93900055e0 con 0x7f93980bb1e0 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.003+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5188 (secure 0 0 0) 0x7f9390005780 con 0x7f93980bb1e0 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.003+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 msgr2=0x7f93980bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.003+0000 7f9396ffd640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 0x7f93980bb5c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93980d02f0 tx=0x7f93900059c0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.003+0000 7f9396ffd640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 msgr2=0x7f93980bb5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.003+0000 7f9396ffd640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980bb1e0 0x7f93980bb5c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:03.006 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 24, 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 288571, 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:03.007 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:03.008 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:03.009 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:03.010 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.013 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:03.014 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:03.015 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:03.016 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:03.017 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.018 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 8 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.019 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.020 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.004+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938c06c470 msgr2=0x7f938c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.004+0000 7f9394ff9640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938c06c470 0x7f938c06e930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f939c034000 tx=0x7f939c02e000 comp rx=0 tx=0).stop 2024-09-19T09:47:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.004+0000 7f93a6d93640 1 -- 172.21.15.123:0/412950248 reap_dead start 2024-09-19T09:47:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.004+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 msgr2=0x7f93980c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.004+0000 7f9394ff9640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 0x7f93980c3420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f93a006a960 tx=0x7f93a0069a30 comp rx=0 tx=0).stop 2024-09-19T09:47:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.004+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 shutdown_connections 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.005+0000 7f9394ff9640 1 --2- 172.21.15.123:0/412950248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93980ddb40 0x7f93980c3420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.005+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 >> 172.21.15.123:0/412950248 conn(0x7f939804fc50 msgr2=0x7f9398006800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.005+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 shutdown_connections 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.005+0000 7f9394ff9640 1 -- 172.21.15.123:0/412950248 wait complete. 2024-09-19T09:47:03.043 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:47:03.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:47:03.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:47:03.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.279+0000 7fd837223640 1 Processor -- start 2024-09-19T09:47:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.280+0000 7fd837223640 1 -- start start 2024-09-19T09:47:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.281+0000 7fd837223640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 0x7fd8300c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.281+0000 7fd837223640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd830164f20 0x7fd830165350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.281+0000 7fd837223640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd830167e70 con 0x7fd83006be80 2024-09-19T09:47:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.281+0000 7fd837223640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fd830168150 con 0x7fd830164f20 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.281+0000 7fd837223640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd830168430 con 0x7fd83006c260 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.282+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 0x7fd8300c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.282+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 0x7fd8300c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:43352/0 (socket says 172.21.15.123:43352) 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.282+0000 7fd82ffff640 1 -- 172.21.15.123:0/1872236529 learned_addr learned my addr 172.21.15.123:0/1872236529 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.294+0000 7fd8357c0640 1 -- 172.21.15.123:0/1872236529 >> v2:172.21.15.194:3300/0 conn(0x7fd830164f20 msgr2=0x7fd830165350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.294+0000 7fd8357c0640 1 --2- 172.21.15.123:0/1872236529 >> v2:172.21.15.194:3300/0 conn(0x7fd830164f20 0x7fd830165350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.294+0000 7fd82ffff640 1 -- 172.21.15.123:0/1872236529 >> v2:172.21.15.194:3300/0 conn(0x7fd830164f20 msgr2=0x7fd830165350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.294+0000 7fd82ffff640 1 --2- 172.21.15.123:0/1872236529 >> v2:172.21.15.194:3300/0 conn(0x7fd830164f20 0x7fd830165350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.294+0000 7fd82ffff640 1 -- 172.21.15.123:0/1872236529 >> v1:172.21.15.123:6789/0 conn(0x7fd83006be80 legacy=0x7fd83016bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.294+0000 7fd82ffff640 1 -- 172.21.15.123:0/1872236529 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd830168710 con 0x7fd83006c260 2024-09-19T09:47:03.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.302+0000 7fd82ffff640 1 --2- 172.21.15.123:0/1872236529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 0x7fd8300c7390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd828008f20 tx=0x7fd82802ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e4d43e54c31ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.303+0000 7fd82f7fe640 1 -- 172.21.15.123:0/1872236529 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82803db50 con 0x7fd83006c260 2024-09-19T09:47:03.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.304+0000 7fd82f7fe640 1 -- 172.21.15.123:0/1872236529 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82803dcf0 con 0x7fd83006c260 2024-09-19T09:47:03.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.305+0000 7fd837223640 1 -- 172.21.15.123:0/1872236529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 msgr2=0x7fd8300c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.305+0000 7fd837223640 1 --2- 172.21.15.123:0/1872236529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 0x7fd8300c7390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd828008f20 tx=0x7fd82802ed60 comp rx=0 tx=0).stop 2024-09-19T09:47:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.307+0000 7fd837223640 1 -- 172.21.15.123:0/1872236529 shutdown_connections 2024-09-19T09:47:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.307+0000 7fd837223640 1 --2- 172.21.15.123:0/1872236529 >> v2:172.21.15.194:3300/0 conn(0x7fd830164f20 0x7fd830165350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.307+0000 7fd837223640 1 --2- 172.21.15.123:0/1872236529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83006c260 0x7fd8300c7390 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.307+0000 7fd837223640 1 -- 172.21.15.123:0/1872236529 >> 172.21.15.123:0/1872236529 conn(0x7fd8300cc670 msgr2=0x7fd8300cca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.310+0000 7fd837223640 1 -- 172.21.15.123:0/1872236529 shutdown_connections 2024-09-19T09:47:03.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.310+0000 7fd837223640 1 -- 172.21.15.123:0/1872236529 wait complete. 2024-09-19T09:47:03.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.313+0000 7fd837223640 1 Processor -- start 2024-09-19T09:47:03.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.313+0000 7fd837223640 1 -- start start 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.314+0000 7fd837223640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 0x7fd8300c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.314+0000 7fd837223640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83006c260 0x7fd8300c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.314+0000 7fd837223640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd830164f20 0x7fd83015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.314+0000 7fd837223640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd83006e6a0 con 0x7fd83006be80 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.314+0000 7fd837223640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd83006e520 con 0x7fd83006c260 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.314+0000 7fd837223640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd83006e820 con 0x7fd830164f20 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.317+0000 7fd834fbf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 0x7fd8300c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 0x7fd8300c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49228/0 (socket says 172.21.15.123:49228) 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 -- 172.21.15.123:0/2452171124 learned_addr learned my addr 172.21.15.123:0/2452171124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd82ffff640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83006c260 msgr2=0x7fd8300c3e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd82ffff640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83006c260 0x7fd8300c3e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd830164f20 msgr2=0x7fd83015ce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd830164f20 0x7fd83015ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83006c260 msgr2=0x7fd8300c3e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:03.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83006c260 0x7fd8300c3e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.318+0000 7fd834fbf640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd830167480 con 0x7fd83006be80 2024-09-19T09:47:03.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.319+0000 7fd834fbf640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 0x7fd8300c5080 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c8c0 tx=0x7fd82000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.320+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820017070 con 0x7fd83006be80 2024-09-19T09:47:03.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.321+0000 7fd837223640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8300cc3a0 con 0x7fd83006be80 2024-09-19T09:47:03.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.324+0000 7fd837223640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd830165610 con 0x7fd83006be80 2024-09-19T09:47:03.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.327+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd820005270 con 0x7fd83006be80 2024-09-19T09:47:03.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.327+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82000a640 con 0x7fd83006be80 2024-09-19T09:47:03.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.327+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd82001a070 con 0x7fd83006be80 2024-09-19T09:47:03.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.329+0000 7fd82d7fa640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd81c06c330 0x7fd81c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.330+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fd82008a7b0 con 0x7fd83006be80 2024-09-19T09:47:03.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.330+0000 7fd82ffff640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd81c06c330 0x7fd81c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.332+0000 7fd82ffff640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd81c06c330 0x7fd81c06e7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd828011000 tx=0x7fd828033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.333+0000 7fd816ffd640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 0x7fd810004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.333+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd810007ec0 con 0x7fd810002a70 2024-09-19T09:47:03.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.334+0000 7fd8357c0640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 0x7fd810004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.335+0000 7fd8357c0640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8100080c0 con 0x7fd810002a70 2024-09-19T09:47:03.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.335+0000 7fd8357c0640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 0x7fd810004f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd824003860 tx=0x7fd82400b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.335+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824005cf0 con 0x7fd810002a70 2024-09-19T09:47:03.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.336+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd824003aa0 con 0x7fd810002a70 2024-09-19T09:47:03.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.336+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 msgr2=0x7fd810004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.336+0000 7fd82d7fa640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 0x7fd810004f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd824003860 tx=0x7fd82400b7a0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.336+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 msgr2=0x7fd810004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:03.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.337+0000 7fd82d7fa640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810002a70 0x7fd810004f30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.355+0000 7fd816ffd640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 0x7fd810007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.355+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd81000a4a0 con 0x7fd810006ee0 2024-09-19T09:47:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.357+0000 7fd8357c0640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 0x7fd810007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.357+0000 7fd8357c0640 1 -- 172.21.15.123:0/2452171124 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd8100078b0 con 0x7fd810006ee0 2024-09-19T09:47:03.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.362+0000 7fd8357c0640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 0x7fd810007370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd824012000 tx=0x7fd8240037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.364+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824018880 con 0x7fd810006ee0 2024-09-19T09:47:03.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.364+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7fd824018a20 con 0x7fd810006ee0 2024-09-19T09:47:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.364+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 msgr2=0x7fd810007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.364+0000 7fd82d7fa640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 0x7fd810007370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd824012000 tx=0x7fd8240037f0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.364+0000 7fd82d7fa640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 msgr2=0x7fd810007370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:03.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.364+0000 7fd82d7fa640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd810006ee0 0x7fd810007370 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.367 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 24, 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 32679, 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:03.368 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.369 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:03.370 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:03.371 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:03.372 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:03.372 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:03.372 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:03.373 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:03.374 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.376 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:03.377 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:03.378 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:03.380 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:03.381 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:03.382 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:03.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.367+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd81c06c330 msgr2=0x7fd81c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.367+0000 7fd816ffd640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd81c06c330 0x7fd81c06e7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd828011000 tx=0x7fd828033000 comp rx=0 tx=0).stop 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.368+0000 7fd8357c0640 1 -- 172.21.15.123:0/2452171124 reap_dead start 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.368+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 msgr2=0x7fd8300c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.368+0000 7fd816ffd640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 0x7fd8300c5080 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c8c0 tx=0x7fd82000cd80 comp rx=0 tx=0).stop 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.368+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 shutdown_connections 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.368+0000 7fd816ffd640 1 --2- 172.21.15.123:0/2452171124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd83006be80 0x7fd8300c5080 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.368+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 >> 172.21.15.123:0/2452171124 conn(0x7fd8300cc670 msgr2=0x7fd8300752e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.369+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 shutdown_connections 2024-09-19T09:47:03.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:03.369+0000 7fd816ffd640 1 -- 172.21.15.123:0/2452171124 wait complete. 2024-09-19T09:47:03.395 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:47:03.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:47:23.396 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:47:23.396 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-19T09:47:23.396 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:47:23.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:47:23.400 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:47:23.400 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:47:23.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:47:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.603+0000 7fa836ab7640 1 Processor -- start 2024-09-19T09:47:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.603+0000 7fa836ab7640 1 -- start start 2024-09-19T09:47:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.604+0000 7fa836ab7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa8300c64a0 0x7fa8300c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.604+0000 7fa836ab7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8301680e0 con 0x7fa8300c6880 2024-09-19T09:47:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.604+0000 7fa836ab7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8301683c0 con 0x7fa83006c750 2024-09-19T09:47:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.604+0000 7fa836ab7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa8301686a0 con 0x7fa8300c64a0 2024-09-19T09:47:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.605+0000 7fa82ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa8300c6880 0x7fa83006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59878/0 (socket says 172.21.15.123:59878) 2024-09-19T09:47:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.605+0000 7fa82ffff640 1 -- 172.21.15.123:0/1403789558 learned_addr learned my addr 172.21.15.123:0/1403789558 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:47:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.606+0000 7fa834853640 1 --2- 172.21.15.123:0/1403789558 >> v2:172.21.15.123:3300/0 conn(0x7fa8300c64a0 0x7fa8300c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.606+0000 7fa834853640 1 -- 172.21.15.123:0/1403789558 >> v1:172.21.15.194:6789/0 conn(0x7fa83006c750 legacy=0x7fa8300c8a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.606+0000 7fa834853640 1 -- 172.21.15.123:0/1403789558 >> v1:172.21.15.123:6789/0 conn(0x7fa8300c6880 legacy=0x7fa83006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.606+0000 7fa834853640 1 -- 172.21.15.123:0/1403789558 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830168980 con 0x7fa8300c64a0 2024-09-19T09:47:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.608+0000 7fa834853640 1 --2- 172.21.15.123:0/1403789558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c64a0 0x7fa8300c7c30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa820009e60 tx=0x7fa82002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c080012f25b85f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.609+0000 7fa82f7fe640 1 -- 172.21.15.123:0/1403789558 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820031600 con 0x7fa8300c64a0 2024-09-19T09:47:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.609+0000 7fa82f7fe640 1 -- 172.21.15.123:0/1403789558 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8200317a0 con 0x7fa8300c64a0 2024-09-19T09:47:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.610+0000 7fa836ab7640 1 -- 172.21.15.123:0/1403789558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c64a0 msgr2=0x7fa8300c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.610+0000 7fa836ab7640 1 --2- 172.21.15.123:0/1403789558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c64a0 0x7fa8300c7c30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa820009e60 tx=0x7fa82002a710 comp rx=0 tx=0).stop 2024-09-19T09:47:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.610+0000 7fa836ab7640 1 -- 172.21.15.123:0/1403789558 shutdown_connections 2024-09-19T09:47:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.611+0000 7fa836ab7640 1 --2- 172.21.15.123:0/1403789558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c64a0 0x7fa8300c7c30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.611+0000 7fa836ab7640 1 -- 172.21.15.123:0/1403789558 >> 172.21.15.123:0/1403789558 conn(0x7fa83006eaa0 msgr2=0x7fa83006ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.611+0000 7fa836ab7640 1 -- 172.21.15.123:0/1403789558 shutdown_connections 2024-09-19T09:47:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.611+0000 7fa836ab7640 1 -- 172.21.15.123:0/1403789558 wait complete. 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.613+0000 7fa836ab7640 1 Processor -- start 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.613+0000 7fa836ab7640 1 -- start start 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa836ab7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83006c750 0x7fa830202110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa836ab7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa836ab7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c1c50 0x7fa830161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa836ab7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa83006c4a0 con 0x7fa8300c1c50 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa836ab7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa83006c320 con 0x7fa8300c6880 2024-09-19T09:47:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa836ab7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa8300c9110 con 0x7fa83006c750 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.614+0000 7fa834853640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83006c750 0x7fa830202110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:56986/0 (socket says 172.21.15.123:56986) 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 -- 172.21.15.123:0/3187987442 learned_addr learned my addr 172.21.15.123:0/3187987442 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa835054640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c1c50 0x7fa830161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 -- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 msgr2=0x7fa8300cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 -- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 msgr2=0x7fa8300cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa82ffff640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa834853640 1 -- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 msgr2=0x7fa8300cc460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa834853640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.615+0000 7fa834853640 1 -- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c1c50 msgr2=0x7fa830161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.616+0000 7fa834853640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c1c50 0x7fa830161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.616+0000 7fa834853640 1 -- 172.21.15.123:0/3187987442 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830167140 con 0x7fa83006c750 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.616+0000 7fa835054640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c1c50 0x7fa830161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.616+0000 7fa834853640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83006c750 0x7fa830202110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa820031000 tx=0x7fa8200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.617+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820045020 con 0x7fa83006c750 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.617+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8300cabe0 con 0x7fa83006c750 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.617+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8300cb1a0 con 0x7fa83006c750 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.618+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8200419d0 con 0x7fa83006c750 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.618+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820041dc0 con 0x7fa83006c750 2024-09-19T09:47:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.620+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa810005290 con 0x7fa83006c750 2024-09-19T09:47:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.621+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa820048020 con 0x7fa83006c750 2024-09-19T09:47:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.622+0000 7fa82d7fa640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81c06c380 0x7fa81c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.622+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa8200b0ae0 con 0x7fa83006c750 2024-09-19T09:47:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.624+0000 7fa82ffff640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81c06c380 0x7fa81c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.625+0000 7fa82ffff640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81c06c380 0x7fa81c06e840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa828007fd0 tx=0x7fa828005b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:23.630+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa82004f030 con 0x7fa83006c750 2024-09-19T09:47:24.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.160+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa810005580 con 0x7fa83006c750 2024-09-19T09:47:24.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.162+0000 7fa82d7fa640 1 -- 172.21.15.123:0/3187987442 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fa82007f360 con 0x7fa83006c750 2024-09-19T09:47:24.166 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.167+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81c06c380 msgr2=0x7fa81c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.167+0000 7fa836ab7640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81c06c380 0x7fa81c06e840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa828007fd0 tx=0x7fa828005b70 comp rx=0 tx=0).stop 2024-09-19T09:47:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.167+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83006c750 msgr2=0x7fa830202110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.167+0000 7fa836ab7640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83006c750 0x7fa830202110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa820031000 tx=0x7fa8200046c0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 shutdown_connections 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8300c1c50 0x7fa830161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8300c6880 0x7fa8300cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81c06c380 0x7fa81c06e840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 --2- 172.21.15.123:0/3187987442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83006c750 0x7fa830202110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 >> 172.21.15.123:0/3187987442 conn(0x7fa83006eaa0 msgr2=0x7fa830166940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 shutdown_connections 2024-09-19T09:47:24.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.168+0000 7fa836ab7640 1 -- 172.21.15.123:0/3187987442 wait complete. 2024-09-19T09:47:24.206 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:47:24.206 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:47:24.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:47:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.448+0000 7f777c4b7640 1 Processor -- start 2024-09-19T09:47:24.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.448+0000 7f777c4b7640 1 -- start start 2024-09-19T09:47:24.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.449+0000 7f777c4b7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 0x7f7774162c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.449+0000 7f777c4b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777415fcb0 con 0x7f777406d270 2024-09-19T09:47:24.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.449+0000 7f777c4b7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777415ff90 con 0x7f777406ce90 2024-09-19T09:47:24.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.449+0000 7f777c4b7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7774160c70 con 0x7f777415f800 2024-09-19T09:47:24.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.451+0000 7f777a253640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f777406ce90 0x7f7774072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:53022/0 (socket says 172.21.15.123:53022) 2024-09-19T09:47:24.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.451+0000 7f777a253640 1 -- 172.21.15.123:0/1241479428 learned_addr learned my addr 172.21.15.123:0/1241479428 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:47:24.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.452+0000 7f7779a52640 1 --2- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 0x7f7774162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.453+0000 7f7779a52640 1 -- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 msgr2=0x7f7774162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:24.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.453+0000 7f7779a52640 1 -- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 msgr2=0x7f7774162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:24.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.453+0000 7f7779a52640 1 --2- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 0x7f7774162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:24.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.453+0000 7f7779a52640 1 --2- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 0x7f7774162c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:24.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509142449 0 0) 0x7f777415fcb0 con 0x7f777406d270 2024-09-19T09:47:24.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7760003520 con 0x7f777406d270 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 310839007 0 0) 0x7f7760003520 con 0x7f777406d270 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 msgr2=0x7f7774162c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 --2- 172.21.15.123:0/1241479428 >> v2:172.21.15.194:3300/0 conn(0x7f777415f800 0x7f7774162c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 >> v1:172.21.15.194:6789/0 conn(0x7f777406ce90 legacy=0x7f7774072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7774160270 con 0x7f777406d270 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f7764001650 con 0x7f777406d270 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 >> v1:172.21.15.123:6789/0 conn(0x7f777406d270 legacy=0x7f77741596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7760003a10 0x7f7760003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760004800 0x7f7760004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600052a0 0x7f776000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f776000c1a0 con 0x7f7760004800 2024-09-19T09:47:24.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f776000c350 con 0x7f77600052a0 2024-09-19T09:47:24.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.454+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f776000c550 con 0x7f7760003a10 2024-09-19T09:47:24.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777aa54640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600052a0 0x7f776000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777a253640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7760003a10 0x7f7760003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f7779a52640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760004800 0x7f7760004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777a253640 1 -- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600052a0 msgr2=0x7f776000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:24.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777a253640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600052a0 0x7f776000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777a253640 1 -- 172.21.15.123:0/1241479428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760004800 msgr2=0x7f7760004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:24.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777a253640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760004800 0x7f7760004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777a253640 1 -- 172.21.15.123:0/1241479428 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7774160270 con 0x7f7760003a10 2024-09-19T09:47:24.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.455+0000 7f777aa54640 1 -- 172.21.15.123:0/1241479428 reap_dead start 2024-09-19T09:47:24.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.461+0000 7f777a253640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7760003a10 0x7f7760003e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c190 tx=0x7f7760005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c1cf972b41f952 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.465+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c001f10 con 0x7f7760003a10 2024-09-19T09:47:24.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.465+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c032630 con 0x7f7760003a10 2024-09-19T09:47:24.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.465+0000 7f7779251640 1 -- 172.21.15.123:0/1241479428 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c032a20 con 0x7f7760003a10 2024-09-19T09:47:24.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.466+0000 7f777c4b7640 1 -- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7760003a10 msgr2=0x7f7760003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.466+0000 7f777c4b7640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7760003a10 0x7f7760003e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c190 tx=0x7f7760005830 comp rx=0 tx=0).stop 2024-09-19T09:47:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.466+0000 7f777c4b7640 1 -- 172.21.15.123:0/1241479428 shutdown_connections 2024-09-19T09:47:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.466+0000 7f777c4b7640 1 --2- 172.21.15.123:0/1241479428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7760003a10 0x7f7760003e50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.466+0000 7f777c4b7640 1 -- 172.21.15.123:0/1241479428 >> 172.21.15.123:0/1241479428 conn(0x7f777406f9c0 msgr2=0x7f777406fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.467+0000 7f777c4b7640 1 -- 172.21.15.123:0/1241479428 shutdown_connections 2024-09-19T09:47:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.467+0000 7f777c4b7640 1 -- 172.21.15.123:0/1241479428 wait complete. 2024-09-19T09:47:24.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.469+0000 7f777c4b7640 1 Processor -- start 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.469+0000 7f777c4b7640 1 -- start start 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.472+0000 7f777c4b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 0x7f77740cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.472+0000 7f777c4b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f777415b090 0x7f777415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.472+0000 7f777a253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 0x7f77740cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.472+0000 7f777a253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 0x7f77740cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44416/0 (socket says 172.21.15.123:44416) 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.472+0000 7f777c4b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77742015a0 0x7f7774201a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777a253640 1 -- 172.21.15.123:0/3990810006 learned_addr learned my addr 172.21.15.123:0/3990810006 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f77740704e0 con 0x7f7760003a10 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7774072200 con 0x7f77742015a0 2024-09-19T09:47:24.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7774070660 con 0x7f777415b090 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777a253640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f777415b090 msgr2=0x7f777415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f7779a52640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f777415b090 0x7f777415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777a253640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f777415b090 0x7f777415bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777a253640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77742015a0 msgr2=0x7f7774201a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777a253640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77742015a0 0x7f7774201a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.473+0000 7f777a253640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77740c9dd0 con 0x7f7760003a10 2024-09-19T09:47:24.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.475+0000 7f777a253640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 0x7f77740cb780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c280 tx=0x7f776c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.475+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c03f020 con 0x7f7760003a10 2024-09-19T09:47:24.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.475+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777415ca70 con 0x7f7760003a10 2024-09-19T09:47:24.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.476+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777415c270 con 0x7f7760003a10 2024-09-19T09:47:24.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.476+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c0329f0 con 0x7f7760003a10 2024-09-19T09:47:24.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.476+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c032dc0 con 0x7f7760003a10 2024-09-19T09:47:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.479+0000 7f777c4b7640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 0x7f775c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.479+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f775c007ec0 con 0x7f775c002a70 2024-09-19T09:47:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.479+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f776c042020 con 0x7f7760003a10 2024-09-19T09:47:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.479+0000 7f7779a52640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 0x7f775c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.480+0000 7f776affd640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f775806c300 0x7f775806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.480+0000 7f7779a52640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f775c0080c0 con 0x7f775c002a70 2024-09-19T09:47:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.480+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f776c0ab670 con 0x7f7760003a10 2024-09-19T09:47:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.480+0000 7f7779a52640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 0x7f775c004f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f77740505b0 tx=0x7f777000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.481+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7770019020 con 0x7f775c002a70 2024-09-19T09:47:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.481+0000 7f777aa54640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f775806c300 0x7f775806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.482+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7770015690 con 0x7f775c002a70 2024-09-19T09:47:24.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.482+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 msgr2=0x7f775c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.482+0000 7f777aa54640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f775806c300 0x7f775806e7c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7774071430 tx=0x7f7764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.482+0000 7f776affd640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 0x7f775c004f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f77740505b0 tx=0x7f777000b890 comp rx=0 tx=0).stop 2024-09-19T09:47:24.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.482+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 msgr2=0x7f775c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:24.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.483+0000 7f776affd640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c002a70 0x7f775c004f30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.503+0000 7f777c4b7640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 0x7f775c007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.503+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f775c00a4a0 con 0x7f775c006ee0 2024-09-19T09:47:24.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.504+0000 7f7779a52640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 0x7f775c007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.504+0000 7f7779a52640 1 -- 172.21.15.123:0/3990810006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f775c0078b0 con 0x7f775c006ee0 2024-09-19T09:47:24.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.505+0000 7f7779a52640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 0x7f775c007370 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77742023f0 tx=0x7f7770004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.506+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7770019030 con 0x7f775c006ee0 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.506+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5199 (secure 0 0 0) 0x7f7770015e40 con 0x7f775c006ee0 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.506+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 msgr2=0x7f775c007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.506+0000 7f776affd640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 0x7f775c007370 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77742023f0 tx=0x7f7770004730 comp rx=0 tx=0).stop 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.506+0000 7f776affd640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 msgr2=0x7f775c007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.506+0000 7f776affd640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c006ee0 0x7f775c007370 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77742023f0 tx=0x7f7770004730 comp rx=0 tx=0).stop 2024-09-19T09:47:24.509 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 26, 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 310076, 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:24.510 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:24.511 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:24.512 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:24.513 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:24.514 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:24.515 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.516 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:24.517 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:24.518 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.519 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:24.521 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:47:24.522 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 8 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.523 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:24.524 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.507+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f775806c300 msgr2=0x7f775806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.507+0000 7f777c4b7640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f775806c300 0x7f775806e7c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7774071430 tx=0x7f7764009040 comp rx=0 tx=0).stop 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777aa54640 1 -- 172.21.15.123:0/3990810006 reap_dead start 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 msgr2=0x7f77740cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 0x7f77740cb780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c280 tx=0x7f776c0014d0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 shutdown_connections 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 --2- 172.21.15.123:0/3990810006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7760003a10 0x7f77740cb780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 >> 172.21.15.123:0/3990810006 conn(0x7f777406f9c0 msgr2=0x7f777415eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 shutdown_connections 2024-09-19T09:47:24.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.508+0000 7f777c4b7640 1 -- 172.21.15.123:0/3990810006 wait complete. 2024-09-19T09:47:24.542 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:47:24.542 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:47:24.542 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:47:24.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.760+0000 7f037071f640 1 Processor -- start 2024-09-19T09:47:24.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.760+0000 7f037071f640 1 -- start start 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f037071f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 0x7f03681571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f037071f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03680c9200 0x7f03680c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f037071f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0368158120 con 0x7f036806f7f0 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f037071f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f03680c75e0 con 0x7f03680c9200 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f037071f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f03680720f0 con 0x7f036815a760 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f036dcba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 0x7f03681571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f036ecbc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03680c9200 0x7f03680c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f036dcba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 0x7f03681571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:37148/0 (socket says 172.21.15.123:37148) 2024-09-19T09:47:24.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.762+0000 7f036dcba640 1 -- 172.21.15.123:0/360755297 learned_addr learned my addr 172.21.15.123:0/360755297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:24.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.763+0000 7f036dcba640 1 -- 172.21.15.123:0/360755297 >> v2:172.21.15.123:3300/0 conn(0x7f03680c9200 msgr2=0x7f03680c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:24.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.763+0000 7f036dcba640 1 --2- 172.21.15.123:0/360755297 >> v2:172.21.15.123:3300/0 conn(0x7f03680c9200 0x7f03680c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.763+0000 7f036dcba640 1 -- 172.21.15.123:0/360755297 >> v1:172.21.15.123:6789/0 conn(0x7f036806f7f0 legacy=0x7f0368151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.763+0000 7f036dcba640 1 -- 172.21.15.123:0/360755297 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0368157880 con 0x7f036815a760 2024-09-19T09:47:24.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.764+0000 7f036dcba640 1 --2- 172.21.15.123:0/360755297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 0x7f03681571f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0358009870 tx=0x7f035802a2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fa4d2541d467c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.765+0000 7f036d4b9640 1 -- 172.21.15.123:0/360755297 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358037070 con 0x7f036815a760 2024-09-19T09:47:24.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.765+0000 7f036d4b9640 1 -- 172.21.15.123:0/360755297 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358032640 con 0x7f036815a760 2024-09-19T09:47:24.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.765+0000 7f036d4b9640 1 -- 172.21.15.123:0/360755297 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358032a10 con 0x7f036815a760 2024-09-19T09:47:24.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.766+0000 7f037071f640 1 -- 172.21.15.123:0/360755297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 msgr2=0x7f03681571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.766+0000 7f037071f640 1 --2- 172.21.15.123:0/360755297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 0x7f03681571f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0358009870 tx=0x7f035802a2f0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.767+0000 7f037071f640 1 -- 172.21.15.123:0/360755297 shutdown_connections 2024-09-19T09:47:24.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.767+0000 7f037071f640 1 --2- 172.21.15.123:0/360755297 >> v2:172.21.15.123:3300/0 conn(0x7f03680c9200 0x7f03680c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.767+0000 7f037071f640 1 --2- 172.21.15.123:0/360755297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036815a760 0x7f03681571f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.767+0000 7f037071f640 1 -- 172.21.15.123:0/360755297 >> 172.21.15.123:0/360755297 conn(0x7f036806ed00 msgr2=0x7f036806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.767+0000 7f037071f640 1 -- 172.21.15.123:0/360755297 shutdown_connections 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.767+0000 7f037071f640 1 -- 172.21.15.123:0/360755297 wait complete. 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.769+0000 7f037071f640 1 Processor -- start 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.769+0000 7f037071f640 1 -- start start 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f037071f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036806f7f0 0x7f03680c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f037071f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03680c9200 0x7f03680cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f037071f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036815a760 0x7f0368156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f037071f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0368071d80 con 0x7f036815a760 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f037071f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0368157e40 con 0x7f03680c9200 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f037071f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f03680c6c10 con 0x7f036806f7f0 2024-09-19T09:47:24.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f036dcba640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03680c9200 0x7f03680cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f036dcba640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03680c9200 0x7f03680cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:57034/0 (socket says 172.21.15.123:57034) 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f036dcba640 1 -- 172.21.15.123:0/4057923699 learned_addr learned my addr 172.21.15.123:0/4057923699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f036e4bb640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036806f7f0 0x7f03680c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.770+0000 7f036ecbc640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036815a760 0x7f0368156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.771+0000 7f036dcba640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036806f7f0 msgr2=0x7f03680c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.771+0000 7f036dcba640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f036806f7f0 0x7f03680c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.771+0000 7f036dcba640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036815a760 msgr2=0x7f0368156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.771+0000 7f036dcba640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036815a760 0x7f0368156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.771+0000 7f036dcba640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03680cadb0 con 0x7f03680c9200 2024-09-19T09:47:24.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.771+0000 7f036ecbc640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036815a760 0x7f0368156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:24.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.772+0000 7f036dcba640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03680c9200 0x7f03680cc870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03580090b0 tx=0x7f03580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.773+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358037040 con 0x7f03680c9200 2024-09-19T09:47:24.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.773+0000 7f037071f640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03680ca570 con 0x7f03680c9200 2024-09-19T09:47:24.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.773+0000 7f037071f640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03680ca810 con 0x7f03680c9200 2024-09-19T09:47:24.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.773+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035803fc00 con 0x7f03680c9200 2024-09-19T09:47:24.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.774+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580305f0 con 0x7f03680c9200 2024-09-19T09:47:24.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.776+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0358030790 con 0x7f03680c9200 2024-09-19T09:47:24.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.776+0000 7f037071f640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 0x7f0350004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.776+0000 7f037071f640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0350007ec0 con 0x7f0350002a70 2024-09-19T09:47:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.777+0000 7f035effd640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f034c06c380 0x7f034c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.777+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f03580b3df0 con 0x7f03680c9200 2024-09-19T09:47:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.777+0000 7f036e4bb640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 0x7f0350004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.777+0000 7f036ecbc640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f034c06c380 0x7f034c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.777+0000 7f036e4bb640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03500080c0 con 0x7f0350002a70 2024-09-19T09:47:24.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.778+0000 7f036e4bb640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 0x7f0350004f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f036400f8b0 tx=0x7f036400fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.778+0000 7f036ecbc640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f034c06c380 0x7f034c06e840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0360009f30 tx=0x7f0360009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.779+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364003b80 con 0x7f0350002a70 2024-09-19T09:47:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.780+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0364018070 con 0x7f0350002a70 2024-09-19T09:47:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.781+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 msgr2=0x7f0350004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.781+0000 7f035effd640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 0x7f0350004f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f036400f8b0 tx=0x7f036400fd70 comp rx=0 tx=0).stop 2024-09-19T09:47:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.781+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 msgr2=0x7f0350004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.781+0000 7f035effd640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350002a70 0x7f0350004f30 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f036400f8b0 tx=0x7f036400fd70 comp rx=0 tx=0).stop 2024-09-19T09:47:24.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.794+0000 7f037071f640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 0x7f0350007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:24.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.794+0000 7f037071f640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f035000a4a0 con 0x7f0350006eb0 2024-09-19T09:47:24.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.795+0000 7f036e4bb640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 0x7f0350007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:24.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.796+0000 7f036e4bb640 1 -- 172.21.15.123:0/4057923699 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0350007880 con 0x7f0350006eb0 2024-09-19T09:47:24.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.798+0000 7f036e4bb640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 0x7f0350007340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f036400f8b0 tx=0x7f0364001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:24.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.798+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364006d60 con 0x7f0350006eb0 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 26, 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 1257, 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:24.803 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:24.804 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:24.806 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:24.807 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.808 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:24.809 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:24.810 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:24.811 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.812 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:24.813 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:24.814 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.799+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f0364006d60 con 0x7f0350006eb0 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 msgr2=0x7f0350007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035effd640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 0x7f0350007340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f036400f8b0 tx=0x7f0364001400 comp rx=0 tx=0).stop 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035effd640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 msgr2=0x7f0350007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035effd640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350006eb0 0x7f0350007340 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f036400f8b0 tx=0x7f0364001400 comp rx=0 tx=0).stop 2024-09-19T09:47:24.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035cff9640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f034c06c380 msgr2=0x7f034c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035cff9640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f034c06c380 0x7f034c06e840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0360009f30 tx=0x7f0360009190 comp rx=0 tx=0).stop 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035cff9640 1 -- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03680c9200 msgr2=0x7f03680cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.800+0000 7f035cff9640 1 --2- 172.21.15.123:0/4057923699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03680c9200 0x7f03680cc870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03580090b0 tx=0x7f03580046c0 comp rx=0 tx=0).stop 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.801+0000 7f036ecbc640 1 -- 172.21.15.123:0/4057923699 reap_dead start 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.801+0000 7f036ecbc640 1 -- 172.21.15.123:0/4057923699 reap_dead start 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.801+0000 7f035cff9640 1 -- 172.21.15.123:0/4057923699 shutdown_connections 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.801+0000 7f035cff9640 1 -- 172.21.15.123:0/4057923699 >> 172.21.15.123:0/4057923699 conn(0x7f036806ed00 msgr2=0x7f036806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.801+0000 7f035cff9640 1 -- 172.21.15.123:0/4057923699 shutdown_connections 2024-09-19T09:47:24.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:24.802+0000 7f035cff9640 1 -- 172.21.15.123:0/4057923699 wait complete. 2024-09-19T09:47:24.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:47:24.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:47:24.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:47:25.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.029+0000 7f582408d640 1 Processor -- start 2024-09-19T09:47:25.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.029+0000 7f582408d640 1 -- start start 2024-09-19T09:47:25.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.030+0000 7f582408d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f581c1521d0 0x7f581c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582408d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 0x7f581c162880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582408d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581c070830 con 0x7f581c0c8280 2024-09-19T09:47:25.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582408d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f581c158a20 con 0x7f581c1521d0 2024-09-19T09:47:25.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582408d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f581c070b10 con 0x7f581c0cbbe0 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 0x7f581c162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 0x7f581c162880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:37164/0 (socket says 172.21.15.123:37164) 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 -- 172.21.15.123:0/3711682682 learned_addr learned my addr 172.21.15.123:0/3711682682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f5821e29640 1 --2- 172.21.15.123:0/3711682682 >> v2:172.21.15.123:3300/0 conn(0x7f581c1521d0 0x7f581c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 -- 172.21.15.123:0/3711682682 >> v2:172.21.15.123:3300/0 conn(0x7f581c1521d0 msgr2=0x7f581c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 --2- 172.21.15.123:0/3711682682 >> v2:172.21.15.123:3300/0 conn(0x7f581c1521d0 0x7f581c0cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 -- 172.21.15.123:0/3711682682 >> v1:172.21.15.123:6789/0 conn(0x7f581c0c8280 legacy=0x7f581c06cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.031+0000 7f582262a640 1 -- 172.21.15.123:0/3711682682 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c1580f0 con 0x7f581c0cbbe0 2024-09-19T09:47:25.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.034+0000 7f582262a640 1 --2- 172.21.15.123:0/3711682682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 0x7f581c162880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5814009e50 tx=0x7f581402ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e58c700837f037e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.036+0000 7f5820e27640 1 -- 172.21.15.123:0/3711682682 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814030710 con 0x7f581c0cbbe0 2024-09-19T09:47:25.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.036+0000 7f5820e27640 1 -- 172.21.15.123:0/3711682682 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58140308b0 con 0x7f581c0cbbe0 2024-09-19T09:47:25.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.036+0000 7f5820e27640 1 -- 172.21.15.123:0/3711682682 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814030710 con 0x7f581c0cbbe0 2024-09-19T09:47:25.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.037+0000 7f582408d640 1 -- 172.21.15.123:0/3711682682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 msgr2=0x7f581c162880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.037+0000 7f582408d640 1 --2- 172.21.15.123:0/3711682682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 0x7f581c162880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5814009e50 tx=0x7f581402ebc0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.040+0000 7f582408d640 1 -- 172.21.15.123:0/3711682682 shutdown_connections 2024-09-19T09:47:25.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.040+0000 7f582408d640 1 --2- 172.21.15.123:0/3711682682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c0cbbe0 0x7f581c162880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.040+0000 7f582408d640 1 --2- 172.21.15.123:0/3711682682 >> v2:172.21.15.123:3300/0 conn(0x7f581c1521d0 0x7f581c0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.040+0000 7f582408d640 1 -- 172.21.15.123:0/3711682682 >> 172.21.15.123:0/3711682682 conn(0x7f581c06fb20 msgr2=0x7f581c06ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:25.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.041+0000 7f582408d640 1 -- 172.21.15.123:0/3711682682 shutdown_connections 2024-09-19T09:47:25.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.041+0000 7f582408d640 1 -- 172.21.15.123:0/3711682682 wait complete. 2024-09-19T09:47:25.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.043+0000 7f582408d640 1 Processor -- start 2024-09-19T09:47:25.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.043+0000 7f582408d640 1 -- start start 2024-09-19T09:47:25.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.044+0000 7f582408d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c0c8280 0x7f581c1f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.044+0000 7f582408d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f581c0cbbe0 0x7f581c149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.044+0000 7f582408d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c1521d0 0x7f581c149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.044+0000 7f582408d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f581c158eb0 con 0x7f581c0cbbe0 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.044+0000 7f582408d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f581c1586b0 con 0x7f581c0c8280 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.044+0000 7f582408d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f581c06eff0 con 0x7f581c1521d0 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c1521d0 0x7f581c149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c1521d0 0x7f581c149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:37166/0 (socket says 172.21.15.123:37166) 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 -- 172.21.15.123:0/2676890215 learned_addr learned my addr 172.21.15.123:0/2676890215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:25.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f5821e29640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c0c8280 0x7f581c1f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f5821628640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f581c0cbbe0 0x7f581c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c0c8280 msgr2=0x7f581c1f0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f581c0c8280 0x7f581c1f0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f581c0cbbe0 msgr2=0x7f581c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f581c0cbbe0 0x7f581c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.045+0000 7f582262a640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c156dd0 con 0x7f581c1521d0 2024-09-19T09:47:25.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.046+0000 7f582262a640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c1521d0 0x7f581c149860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581402ec00 tx=0x7f5814004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.047+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814030710 con 0x7f581c1521d0 2024-09-19T09:47:25.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.047+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5814039480 con 0x7f581c1521d0 2024-09-19T09:47:25.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.047+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814039870 con 0x7f581c1521d0 2024-09-19T09:47:25.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.047+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c1570b0 con 0x7f581c1521d0 2024-09-19T09:47:25.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.047+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c157670 con 0x7f581c1521d0 2024-09-19T09:47:25.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.050+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5814039a10 con 0x7f581c1521d0 2024-09-19T09:47:25.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.050+0000 7f58127fc640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c380 0x7f580006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.050+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f58140ac260 con 0x7f581c1521d0 2024-09-19T09:47:25.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.050+0000 7f57fffff640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 0x7f581c1ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.050+0000 7f57fffff640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f581c157840 con 0x7f581c14e4a0 2024-09-19T09:47:25.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.051+0000 7f5821e29640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c380 0x7f580006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.051+0000 7f5821628640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 0x7f581c1ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.052+0000 7f5821628640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f581c0c4980 con 0x7f581c14e4a0 2024-09-19T09:47:25.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.052+0000 7f5821e29640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c380 0x7f580006e840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f580c00aac0 tx=0x7f580c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.053+0000 7f5821628640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 0x7f581c1ec9a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f581c073cf0 tx=0x7f581800e800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.055+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5818019070 con 0x7f581c14e4a0 2024-09-19T09:47:25.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.055+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f58180052e0 con 0x7f581c14e4a0 2024-09-19T09:47:25.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.055+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 msgr2=0x7f581c1ec9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.055+0000 7f58127fc640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 0x7f581c1ec9a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f581c073cf0 tx=0x7f581800e800 comp rx=0 tx=0).stop 2024-09-19T09:47:25.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.055+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 msgr2=0x7f581c1ec9a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:25.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.055+0000 7f58127fc640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c14e4a0 0x7f581c1ec9a0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f581c073cf0 tx=0x7f581800e800 comp rx=0 tx=0).stop 2024-09-19T09:47:25.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.069+0000 7f57fffff640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 0x7f581c1ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.069+0000 7f57fffff640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f581c0c4550 con 0x7f581c155c40 2024-09-19T09:47:25.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.070+0000 7f5821628640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 0x7f581c1ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.071+0000 7f5821628640 1 -- 172.21.15.123:0/2676890215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f581c0cc9d0 con 0x7f581c155c40 2024-09-19T09:47:25.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.072+0000 7f5821628640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 0x7f581c1ecee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5818013000 tx=0x7f5818000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.076+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5818019040 con 0x7f581c155c40 2024-09-19T09:47:25.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.076+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7f58180035f0 con 0x7f581c155c40 2024-09-19T09:47:25.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.076+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 msgr2=0x7f581c1ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.076+0000 7f58127fc640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 0x7f581c1ecee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5818013000 tx=0x7f5818000f40 comp rx=0 tx=0).stop 2024-09-19T09:47:25.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.076+0000 7f58127fc640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 msgr2=0x7f581c1ecee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:25.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.076+0000 7f58127fc640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c155c40 0x7f581c1ecee0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5818013000 tx=0x7f5818000f40 comp rx=0 tx=0).stop 2024-09-19T09:47:25.080 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:25.080 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:25.080 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:25.080 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:47:25.080 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 26, 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 54390, 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:25.082 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:25.083 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:25.084 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:25.085 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.086 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:25.087 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:25.088 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:25.089 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:25.090 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:25.091 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:25.092 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:25.093 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:25.093 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:25.093 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:25.093 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:25.093 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:25.093 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.079+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c380 msgr2=0x7f580006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.079+0000 7f582408d640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f580006c380 0x7f580006e840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f580c00aac0 tx=0x7f580c008040 comp rx=0 tx=0).stop 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.079+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c1521d0 msgr2=0x7f581c149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.079+0000 7f582408d640 1 --2- 172.21.15.123:0/2676890215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f581c1521d0 0x7f581c149860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581402ec00 tx=0x7f5814004a40 comp rx=0 tx=0).stop 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.081+0000 7f582262a640 1 -- 172.21.15.123:0/2676890215 reap_dead start 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.081+0000 7f582262a640 1 -- 172.21.15.123:0/2676890215 reap_dead start 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.083+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 shutdown_connections 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.084+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 >> 172.21.15.123:0/2676890215 conn(0x7f581c06fb20 msgr2=0x7f581c1de060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.088+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 shutdown_connections 2024-09-19T09:47:25.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.089+0000 7f582408d640 1 -- 172.21.15.123:0/2676890215 wait complete. 2024-09-19T09:47:25.119 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:47:25.119 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:47:25.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:47:25.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.307+0000 7fe8ed56d640 1 Processor -- start 2024-09-19T09:47:25.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.308+0000 7fe8ed56d640 1 -- start start 2024-09-19T09:47:25.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8ed56d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9a00 0x7fe8e8157120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8ed56d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8e80c9de0 0x7fe8e81619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8ed56d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e80c7d20 con 0x7fe8e815b310 2024-09-19T09:47:25.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8e67fc640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe8e815b310 0x7fe8e81542a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:53030/0 (socket says 172.21.15.123:53030) 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8e67fc640 1 -- 172.21.15.123:0/1171431994 learned_addr learned my addr 172.21.15.123:0/1171431994 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e80c8000 con 0x7fe8e80c9de0 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.309+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e815a830 con 0x7fe8e80c9a00 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.310+0000 7fe8e77fe640 1 --2- 172.21.15.123:0/1171431994 >> v2:172.21.15.123:3300/0 conn(0x7fe8e80c9de0 0x7fe8e81619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.310+0000 7fe8e6ffd640 1 --2- 172.21.15.123:0/1171431994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9a00 0x7fe8e8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.311+0000 7fe8e77fe640 1 -- 172.21.15.123:0/1171431994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9a00 msgr2=0x7fe8e8157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.311+0000 7fe8e77fe640 1 --2- 172.21.15.123:0/1171431994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9a00 0x7fe8e8157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.311+0000 7fe8e77fe640 1 -- 172.21.15.123:0/1171431994 >> v1:172.21.15.194:6789/0 conn(0x7fe8e815b310 legacy=0x7fe8e81542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.311+0000 7fe8e77fe640 1 -- 172.21.15.123:0/1171431994 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e815ab10 con 0x7fe8e80c9de0 2024-09-19T09:47:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.314+0000 7fe8e77fe640 1 --2- 172.21.15.123:0/1171431994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9de0 0x7fe8e81619c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0097a0 tx=0x7fe8dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3927856d3eb45814 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.316+0000 7fe8e5ffb640 1 -- 172.21.15.123:0/1171431994 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc037070 con 0x7fe8e80c9de0 2024-09-19T09:47:25.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.316+0000 7fe8e5ffb640 1 -- 172.21.15.123:0/1171431994 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc032440 con 0x7fe8e80c9de0 2024-09-19T09:47:25.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.316+0000 7fe8e5ffb640 1 -- 172.21.15.123:0/1171431994 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc032850 con 0x7fe8e80c9de0 2024-09-19T09:47:25.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.317+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9de0 msgr2=0x7fe8e81619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.317+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/1171431994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9de0 0x7fe8e81619c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0097a0 tx=0x7fe8dc02a1c0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.317+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 shutdown_connections 2024-09-19T09:47:25.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.317+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/1171431994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9de0 0x7fe8e81619c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.317+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/1171431994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9a00 0x7fe8e8157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.317+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 >> 172.21.15.123:0/1171431994 conn(0x7fe8e806ec90 msgr2=0x7fe8e806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.319+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 shutdown_connections 2024-09-19T09:47:25.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.319+0000 7fe8ed56d640 1 -- 172.21.15.123:0/1171431994 wait complete. 2024-09-19T09:47:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.322+0000 7fe8ed56d640 1 Processor -- start 2024-09-19T09:47:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.322+0000 7fe8ed56d640 1 -- start start 2024-09-19T09:47:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.323+0000 7fe8ed56d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 0x7fe8e80c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8ed56d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9de0 0x7fe8e80ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8e6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 0x7fe8e80c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8e6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 0x7fe8e80c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44502/0 (socket says 172.21.15.123:44502) 2024-09-19T09:47:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8e6ffd640 1 -- 172.21.15.123:0/3698628914 learned_addr learned my addr 172.21.15.123:0/3698628914 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e815b310 0x7fe8e81ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8e67fc640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9de0 0x7fe8e80ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e80c3f10 con 0x7fe8e80c9a00 2024-09-19T09:47:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.324+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8157660 con 0x7fe8e815b310 2024-09-19T09:47:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.325+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e80c4090 con 0x7fe8e80c9de0 2024-09-19T09:47:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.326+0000 7fe8e77fe640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e815b310 0x7fe8e81ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.327+0000 7fe8e6ffd640 1 -- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9de0 msgr2=0x7fe8e80ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.327+0000 7fe8e6ffd640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9de0 0x7fe8e80ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.327+0000 7fe8e6ffd640 1 -- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e815b310 msgr2=0x7fe8e81ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.327+0000 7fe8e6ffd640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e815b310 0x7fe8e81ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.327+0000 7fe8e6ffd640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e81f0110 con 0x7fe8e80c9a00 2024-09-19T09:47:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.327+0000 7fe8e6ffd640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 0x7fe8e80c5690 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000ce10 tx=0x7fe8e000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.328+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0003b90 con 0x7fe8e80c9a00 2024-09-19T09:47:25.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.328+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0003d30 con 0x7fe8e80c9a00 2024-09-19T09:47:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.328+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0004220 con 0x7fe8e80c9a00 2024-09-19T09:47:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.328+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e81f03d0 con 0x7fe8e80c9a00 2024-09-19T09:47:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.329+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e81f0990 con 0x7fe8e80c9a00 2024-09-19T09:47:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.332+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe8e00043c0 con 0x7fe8e80c9a00 2024-09-19T09:47:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.332+0000 7fe8cd7fa640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c8005290 con 0x7fe8e80c9a00 2024-09-19T09:47:25.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.342+0000 7fe8cf7fe640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8d406c380 0x7fe8d406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.343+0000 7fe8e67fc640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8d406c380 0x7fe8d406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.344+0000 7fe8e67fc640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8d406c380 0x7fe8d406e840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8e81edbc0 tx=0x7fe8d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.344+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fe8e008bec0 con 0x7fe8e80c9a00 2024-09-19T09:47:25.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.344+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe8e0090490 con 0x7fe8e80c9a00 2024-09-19T09:47:25.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.939+0000 7fe8cd7fa640 1 -- 172.21.15.123:0/3698628914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe8c8005d90 con 0x7fe8e80c9a00 2024-09-19T09:47:25.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.942+0000 7fe8cf7fe640 1 -- 172.21.15.123:0/3698628914 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe8e0059f40 con 0x7fe8e80c9a00 2024-09-19T09:47:25.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8d406c380 msgr2=0x7fe8d406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8d406c380 0x7fe8d406e840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8e81edbc0 tx=0x7fe8d8009040 comp rx=0 tx=0).stop 2024-09-19T09:47:25.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 msgr2=0x7fe8e80c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 0x7fe8e80c5690 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000ce10 tx=0x7fe8e000a660 comp rx=0 tx=0).stop 2024-09-19T09:47:25.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 shutdown_connections 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e815b310 0x7fe8e81ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8d406c380 0x7fe8d406e840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8e80c9de0 0x7fe8e80ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 --2- 172.21.15.123:0/3698628914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80c9a00 0x7fe8e80c5690 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 >> 172.21.15.123:0/3698628914 conn(0x7fe8e806ec90 msgr2=0x7fe8e806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.948+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 shutdown_connections 2024-09-19T09:47:25.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:25.949+0000 7fe8ed56d640 1 -- 172.21.15.123:0/3698628914 wait complete. 2024-09-19T09:47:25.976 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:47:32.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:47:32.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:47:35.978 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:47:35.978 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:47:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.167+0000 7f6d0038d640 1 Processor -- start 2024-09-19T09:47:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.168+0000 7f6d0038d640 1 -- start start 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6d0038d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6cf80c9420 0x7f6cf80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6d0038d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6cf8160910 0x7f6cf8162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6d0038d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf815c4d0 con 0x7f6cf81521f0 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6d0038d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf815bfa0 con 0x7f6cf8160910 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6d0038d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf80cd6b0 con 0x7f6cf80c9420 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6cfe92a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6cf8160910 0x7f6cf8162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6cfe92a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6cf8160910 0x7f6cf8162d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44098/0 (socket says 172.21.15.123:44098) 2024-09-19T09:47:36.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.169+0000 7f6cfe92a640 1 -- 172.21.15.123:0/3213581447 learned_addr learned my addr 172.21.15.123:0/3213581447 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:36.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.170+0000 7f6cfd928640 1 --2- 172.21.15.123:0/3213581447 >> v2:172.21.15.194:3300/0 conn(0x7f6cf80c9420 0x7f6cf80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.172+0000 7f6cfe92a640 1 -- 172.21.15.123:0/3213581447 >> v2:172.21.15.194:3300/0 conn(0x7f6cf80c9420 msgr2=0x7f6cf80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.172+0000 7f6cfe92a640 1 --2- 172.21.15.123:0/3213581447 >> v2:172.21.15.194:3300/0 conn(0x7f6cf80c9420 0x7f6cf80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.172+0000 7f6cfe92a640 1 -- 172.21.15.123:0/3213581447 >> v1:172.21.15.194:6789/0 conn(0x7f6cf81521f0 legacy=0x7f6cf806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.172+0000 7f6cfe92a640 1 -- 172.21.15.123:0/3213581447 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf80c8720 con 0x7f6cf8160910 2024-09-19T09:47:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.173+0000 7f6cfe92a640 1 --2- 172.21.15.123:0/3213581447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf8160910 0x7f6cf8162d00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8159130 tx=0x7f6cf002c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c89f1d736a348d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.174+0000 7f6cfd127640 1 -- 172.21.15.123:0/3213581447 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0009600 con 0x7f6cf8160910 2024-09-19T09:47:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.174+0000 7f6cfd127640 1 -- 172.21.15.123:0/3213581447 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf0037070 con 0x7f6cf8160910 2024-09-19T09:47:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.174+0000 7f6cfd127640 1 -- 172.21.15.123:0/3213581447 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0009a00 con 0x7f6cf8160910 2024-09-19T09:47:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.175+0000 7f6d0038d640 1 -- 172.21.15.123:0/3213581447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf8160910 msgr2=0x7f6cf8162d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.175+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3213581447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf8160910 0x7f6cf8162d00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8159130 tx=0x7f6cf002c970 comp rx=0 tx=0).stop 2024-09-19T09:47:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.175+0000 7f6d0038d640 1 -- 172.21.15.123:0/3213581447 shutdown_connections 2024-09-19T09:47:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.175+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3213581447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf8160910 0x7f6cf8162d00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.175+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3213581447 >> v2:172.21.15.194:3300/0 conn(0x7f6cf80c9420 0x7f6cf80c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.176+0000 7f6d0038d640 1 -- 172.21.15.123:0/3213581447 >> 172.21.15.123:0/3213581447 conn(0x7f6cf80cd8c0 msgr2=0x7f6cf80cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:36.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.178+0000 7f6d0038d640 1 -- 172.21.15.123:0/3213581447 shutdown_connections 2024-09-19T09:47:36.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.178+0000 7f6d0038d640 1 -- 172.21.15.123:0/3213581447 wait complete. 2024-09-19T09:47:36.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.180+0000 7f6d0038d640 1 Processor -- start 2024-09-19T09:47:36.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.181+0000 7f6d0038d640 1 -- start start 2024-09-19T09:47:36.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.182+0000 7f6d0038d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 0x7f6cf806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.182+0000 7f6d0038d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf81521f0 0x7f6cf814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.182+0000 7f6d0038d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf8160910 0x7f6cf814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.182+0000 7f6cfe129640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 0x7f6cf806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6cfe129640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 0x7f6cf806cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44104/0 (socket says 172.21.15.123:44104) 2024-09-19T09:47:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6cfd928640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf81521f0 0x7f6cf814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6cfd928640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf81521f0 0x7f6cf814c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53826/0 (socket says 172.21.15.123:53826) 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6d0038d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80c9d70 con 0x7f6cf80c9420 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6d0038d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80c8c20 con 0x7f6cf8160910 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6cfe129640 1 -- 172.21.15.123:0/3517567074 learned_addr learned my addr 172.21.15.123:0/3517567074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6cfe92a640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf8160910 0x7f6cf814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.183+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf80c8280 con 0x7f6cf81521f0 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.184+0000 7f6cfe129640 1 -- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf81521f0 msgr2=0x7f6cf814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.184+0000 7f6cfe129640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf81521f0 0x7f6cf814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.184+0000 7f6cfe129640 1 -- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf8160910 msgr2=0x7f6cf814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.184+0000 7f6cfe129640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf8160910 0x7f6cf814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.184+0000 7f6cfe129640 1 -- 172.21.15.123:0/3517567074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf8154e60 con 0x7f6cf80c9420 2024-09-19T09:47:36.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.184+0000 7f6cfe129640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 0x7f6cf806cc00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400c400 tx=0x7f6cf400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:36.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.185+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40052d0 con 0x7f6cf80c9420 2024-09-19T09:47:36.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.186+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4005490 con 0x7f6cf80c9420 2024-09-19T09:47:36.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.186+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf8153310 con 0x7f6cf80c9420 2024-09-19T09:47:36.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.186+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4007260 con 0x7f6cf80c9420 2024-09-19T09:47:36.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.186+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81538d0 con 0x7f6cf80c9420 2024-09-19T09:47:36.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.189+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6cf4007400 con 0x7f6cf80c9420 2024-09-19T09:47:36.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.189+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce0005290 con 0x7f6cf80c9420 2024-09-19T09:47:36.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.191+0000 7f6ceeffd640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6cdc06c380 0x7f6cdc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.191+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f6cf408a900 con 0x7f6cf80c9420 2024-09-19T09:47:36.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.195+0000 7f6cfd928640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6cdc06c380 0x7f6cdc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.195+0000 7f6cfd928640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6cdc06c380 0x7f6cdc06e840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6cf806d4e0 tx=0x7f6ce8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:36.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.201+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6cf8154e60 con 0x7f6cf80c9420 2024-09-19T09:47:36.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.742+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6ce0005580 con 0x7f6cf80c9420 2024-09-19T09:47:36.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.743+0000 7f6ceeffd640 1 -- 172.21.15.123:0/3517567074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f6cf40589a0 con 0x7f6cf80c9420 2024-09-19T09:47:36.747 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:36.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.748+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6cdc06c380 msgr2=0x7f6cdc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.748+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6cdc06c380 0x7f6cdc06e840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6cf806d4e0 tx=0x7f6ce8008040 comp rx=0 tx=0).stop 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.748+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 msgr2=0x7f6cf806cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.748+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 0x7f6cf806cc00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400c400 tx=0x7f6cf400c8c0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.749+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 shutdown_connections 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.749+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf8160910 0x7f6cf814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.749+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f6cdc06c380 0x7f6cdc06e840 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6cf806d4e0 tx=0x7f6ce8008040 comp rx=0 tx=0).stop 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.749+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf81521f0 0x7f6cf814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.749+0000 7f6d0038d640 1 --2- 172.21.15.123:0/3517567074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cf80c9420 0x7f6cf806cc00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.749+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 >> 172.21.15.123:0/3517567074 conn(0x7f6cf80cd8c0 msgr2=0x7f6cf80cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:36.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.750+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 shutdown_connections 2024-09-19T09:47:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:36.754+0000 7f6d0038d640 1 -- 172.21.15.123:0/3517567074 wait complete. 2024-09-19T09:47:36.775 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:47:36.776 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:47:36.776 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:47:36.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:47:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.004+0000 7efcf73bc640 1 Processor -- start 2024-09-19T09:47:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.004+0000 7efcf73bc640 1 -- start start 2024-09-19T09:47:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.005+0000 7efcf73bc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efcf0159400 0x7efcf01633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.005+0000 7efcf73bc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf00c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.005+0000 7efcf73bc640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf00c8e70 con 0x7efcf01597e0 2024-09-19T09:47:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.005+0000 7efcf73bc640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efcf00c7ab0 con 0x7efcf0159400 2024-09-19T09:47:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.005+0000 7efcf73bc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7efcf006cc70 con 0x7efcf00c7f40 2024-09-19T09:47:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.006+0000 7efcf6bbb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf00c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.006+0000 7efcf6bbb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf00c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53838/0 (socket says 172.21.15.123:53838) 2024-09-19T09:47:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.006+0000 7efcf6bbb640 1 -- 172.21.15.123:0/2486512395 learned_addr learned my addr 172.21.15.123:0/2486512395 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.006+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2486512395 >> v2:172.21.15.123:3300/0 conn(0x7efcf0159400 0x7efcf01633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.007+0000 7efcf63ba640 1 -- 172.21.15.123:0/2486512395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 msgr2=0x7efcf00c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.007+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2486512395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf00c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.007+0000 7efcf63ba640 1 -- 172.21.15.123:0/2486512395 >> v1:172.21.15.123:6789/0 conn(0x7efcf01597e0 legacy=0x7efcf01606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.007+0000 7efcf53b8640 1 -- 172.21.15.123:0/2486512395 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927533193 0 0) 0x7efcf00c8e70 con 0x7efcf01597e0 2024-09-19T09:47:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.007+0000 7efcf63ba640 1 -- 172.21.15.123:0/2486512395 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf00c7180 con 0x7efcf0159400 2024-09-19T09:47:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.007+0000 7efcf6bbb640 1 --2- 172.21.15.123:0/2486512395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf00c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:37.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.009+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2486512395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf0159400 0x7efcf01633b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efce0009d90 tx=0x7efce002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6253ec815e4a0d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.010+0000 7efcf53b8640 1 -- 172.21.15.123:0/2486512395 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0007740 con 0x7efcf0159400 2024-09-19T09:47:37.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.010+0000 7efcf53b8640 1 -- 172.21.15.123:0/2486512395 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce00078e0 con 0x7efcf0159400 2024-09-19T09:47:37.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.011+0000 7efcf73bc640 1 -- 172.21.15.123:0/2486512395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf0159400 msgr2=0x7efcf01633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.011+0000 7efcf73bc640 1 --2- 172.21.15.123:0/2486512395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf0159400 0x7efcf01633b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efce0009d90 tx=0x7efce002a660 comp rx=0 tx=0).stop 2024-09-19T09:47:37.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.012+0000 7efcf73bc640 1 -- 172.21.15.123:0/2486512395 shutdown_connections 2024-09-19T09:47:37.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.012+0000 7efcf73bc640 1 --2- 172.21.15.123:0/2486512395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf00c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.012+0000 7efcf73bc640 1 --2- 172.21.15.123:0/2486512395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf0159400 0x7efcf01633b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.012+0000 7efcf73bc640 1 -- 172.21.15.123:0/2486512395 >> 172.21.15.123:0/2486512395 conn(0x7efcf00c9100 msgr2=0x7efcf00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.014+0000 7efcf73bc640 1 -- 172.21.15.123:0/2486512395 shutdown_connections 2024-09-19T09:47:37.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.014+0000 7efcf73bc640 1 -- 172.21.15.123:0/2486512395 wait complete. 2024-09-19T09:47:37.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.016+0000 7efcf73bc640 1 Processor -- start 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.016+0000 7efcf73bc640 1 -- start start 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.018+0000 7efcf73bc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf01f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.018+0000 7efcf73bc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcf0159400 0x7efcf0161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.018+0000 7efcf73bc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf01597e0 0x7efcf015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.018+0000 7efcf73bc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efcf006c8a0 con 0x7efcf01597e0 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.018+0000 7efcf73bc640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efcf00c7740 con 0x7efcf0159400 2024-09-19T09:47:37.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.018+0000 7efcf73bc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7efcf006ca20 con 0x7efcf00c7f40 2024-09-19T09:47:37.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.019+0000 7efcf5bb9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcf0159400 0x7efcf0161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.019+0000 7efcf5bb9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcf0159400 0x7efcf0161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40822/0 (socket says 172.21.15.123:40822) 2024-09-19T09:47:37.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.019+0000 7efcf5bb9640 1 -- 172.21.15.123:0/2215857165 learned_addr learned my addr 172.21.15.123:0/2215857165 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.019+0000 7efcf6bbb640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf01597e0 0x7efcf015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.020+0000 7efcf5bb9640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 msgr2=0x7efcf01f53e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.020+0000 7efcf5bb9640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcf00c7f40 0x7efcf01f53e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.020+0000 7efcf5bb9640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf01597e0 msgr2=0x7efcf015d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.020+0000 7efcf5bb9640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf01597e0 0x7efcf015d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.020+0000 7efcf5bb9640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf00c50c0 con 0x7efcf0159400 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.020+0000 7efcf6bbb640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcf01597e0 0x7efcf015d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:37.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.021+0000 7efcf5bb9640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcf0159400 0x7efcf0161370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efce400c3c0 tx=0x7efce400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.023+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4017070 con 0x7efcf0159400 2024-09-19T09:47:37.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.023+0000 7efcf73bc640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf00c53a0 con 0x7efcf0159400 2024-09-19T09:47:37.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.023+0000 7efcf73bc640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf015d470 con 0x7efcf0159400 2024-09-19T09:47:37.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.023+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce40035f0 con 0x7efcf0159400 2024-09-19T09:47:37.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.025+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce40039e0 con 0x7efcf0159400 2024-09-19T09:47:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.026+0000 7efcf73bc640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 0x7efcd0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.026+0000 7efcf73bc640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0007ec0 con 0x7efcd0002a70 2024-09-19T09:47:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.026+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 0x7efcd0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.027+0000 7efcf63ba640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efcd00080c0 con 0x7efcd0002a70 2024-09-19T09:47:37.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.027+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 0x7efcd0004f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efcf0070bf0 tx=0x7efce0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.028+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efce401a070 con 0x7efcf0159400 2024-09-19T09:47:37.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.028+0000 7efceeffd640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efcdc06c2b0 0x7efcdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.028+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0040070 con 0x7efcd0002a70 2024-09-19T09:47:37.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.029+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7efce408a890 con 0x7efcf0159400 2024-09-19T09:47:37.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.029+0000 7efcf6bbb640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efcdc06c2b0 0x7efcdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.030+0000 7efcf6bbb640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efcdc06c2b0 0x7efcdc06e770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efce80094a0 tx=0x7efce8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.031+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efce0045460 con 0x7efcd0002a70 2024-09-19T09:47:37.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.031+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 msgr2=0x7efcd0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.031+0000 7efceeffd640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 0x7efcd0004f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efcf0070bf0 tx=0x7efce0004a40 comp rx=0 tx=0).stop 2024-09-19T09:47:37.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.031+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 msgr2=0x7efcd0004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:37.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.031+0000 7efceeffd640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0002a70 0x7efcd0004f30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.051+0000 7efcf73bc640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 0x7efcd0007400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.052+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 0x7efcd0007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.052+0000 7efcf73bc640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efcd000a4a0 con 0x7efcd0006f70 2024-09-19T09:47:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.053+0000 7efcf63ba640 1 -- 172.21.15.123:0/2215857165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efcd0007940 con 0x7efcd0006f70 2024-09-19T09:47:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.053+0000 7efcf63ba640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 0x7efcd0007400 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efce0009d90 tx=0x7efce0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.054+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0004450 con 0x7efcd0006f70 2024-09-19T09:47:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.054+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5200 (secure 0 0 0) 0x7efce0004450 con 0x7efcd0006f70 2024-09-19T09:47:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.054+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 msgr2=0x7efcd0007400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.054+0000 7efceeffd640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 0x7efcd0007400 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efce0009d90 tx=0x7efce0009750 comp rx=0 tx=0).stop 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.054+0000 7efceeffd640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 msgr2=0x7efcd0007400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.054+0000 7efceeffd640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcd0006f70 0x7efcd0007400 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efce0009d90 tx=0x7efce0009750 comp rx=0 tx=0).stop 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 26, 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 322625, 2024-09-19T09:47:37.057 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:37.058 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.059 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.060 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:37.061 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.062 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.063 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:37.064 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.066 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.067 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:47:37.069 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 8 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.070 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.072 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:37.072 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:37.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.057+0000 7efcecff9640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efcdc06c2b0 msgr2=0x7efcdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.059+0000 7efcecff9640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efcdc06c2b0 0x7efcdc06e770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efce80094a0 tx=0x7efce8009240 comp rx=0 tx=0).stop 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.059+0000 7efcecff9640 1 -- 172.21.15.123:0/2215857165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcf0159400 msgr2=0x7efcf0161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.059+0000 7efcecff9640 1 --2- 172.21.15.123:0/2215857165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcf0159400 0x7efcf0161370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efce400c3c0 tx=0x7efce400c880 comp rx=0 tx=0).stop 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.059+0000 7efcf6bbb640 1 -- 172.21.15.123:0/2215857165 reap_dead start 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.059+0000 7efcf6bbb640 1 -- 172.21.15.123:0/2215857165 reap_dead start 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.060+0000 7efcecff9640 1 -- 172.21.15.123:0/2215857165 shutdown_connections 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.060+0000 7efcecff9640 1 -- 172.21.15.123:0/2215857165 >> 172.21.15.123:0/2215857165 conn(0x7efcf00c9100 msgr2=0x7efcf0154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.060+0000 7efcecff9640 1 -- 172.21.15.123:0/2215857165 shutdown_connections 2024-09-19T09:47:37.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.060+0000 7efcecff9640 1 -- 172.21.15.123:0/2215857165 wait complete. 2024-09-19T09:47:37.084 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:47:37.084 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:47:37.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:47:37.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.257+0000 7fe38978d640 1 Processor -- start 2024-09-19T09:47:37.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.257+0000 7fe38978d640 1 -- start start 2024-09-19T09:47:37.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe38978d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe3840c8300 0x7fe38415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe38978d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe384071f40 0x7fe384072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe38978d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3840728d0 con 0x7fe384159870 2024-09-19T09:47:37.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe38978d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fe384160460 con 0x7fe3840c8300 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe38978d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe384162a50 con 0x7fe384071f40 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe382ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe384159870 0x7fe3840c7380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32958/0 (socket says 172.21.15.123:32958) 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe382ffd640 1 -- 172.21.15.123:0/3395003628 learned_addr learned my addr 172.21.15.123:0/3395003628 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.259+0000 7fe3837fe640 1 --2- 172.21.15.123:0/3395003628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe384071f40 0x7fe384072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.260+0000 7fe3827fc640 1 --2- 172.21.15.123:0/3395003628 >> v2:172.21.15.194:3300/0 conn(0x7fe3840c8300 0x7fe38415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.260+0000 7fe3837fe640 1 -- 172.21.15.123:0/3395003628 >> v2:172.21.15.194:3300/0 conn(0x7fe3840c8300 msgr2=0x7fe38415ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.260+0000 7fe3837fe640 1 --2- 172.21.15.123:0/3395003628 >> v2:172.21.15.194:3300/0 conn(0x7fe3840c8300 0x7fe38415ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.260+0000 7fe3837fe640 1 -- 172.21.15.123:0/3395003628 >> v1:172.21.15.123:6789/0 conn(0x7fe384159870 legacy=0x7fe3840c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.260+0000 7fe3837fe640 1 -- 172.21.15.123:0/3395003628 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe384162ca0 con 0x7fe384071f40 2024-09-19T09:47:37.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.264+0000 7fe3837fe640 1 --2- 172.21.15.123:0/3395003628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe384071f40 0x7fe384072390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009d90 tx=0x7fe37c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b957bea77b2ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.269+0000 7fe381ffb640 1 -- 172.21.15.123:0/3395003628 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c007740 con 0x7fe384071f40 2024-09-19T09:47:37.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.269+0000 7fe381ffb640 1 -- 172.21.15.123:0/3395003628 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37c0078e0 con 0x7fe384071f40 2024-09-19T09:47:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.270+0000 7fe38978d640 1 -- 172.21.15.123:0/3395003628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe384071f40 msgr2=0x7fe384072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.270+0000 7fe38978d640 1 --2- 172.21.15.123:0/3395003628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe384071f40 0x7fe384072390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009d90 tx=0x7fe37c02a6f0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.273+0000 7fe38978d640 1 -- 172.21.15.123:0/3395003628 shutdown_connections 2024-09-19T09:47:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.273+0000 7fe38978d640 1 --2- 172.21.15.123:0/3395003628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe384071f40 0x7fe384072390 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.273+0000 7fe38978d640 1 --2- 172.21.15.123:0/3395003628 >> v2:172.21.15.194:3300/0 conn(0x7fe3840c8300 0x7fe38415ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.273+0000 7fe38978d640 1 -- 172.21.15.123:0/3395003628 >> 172.21.15.123:0/3395003628 conn(0x7fe38406ed00 msgr2=0x7fe38406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.275+0000 7fe38978d640 1 -- 172.21.15.123:0/3395003628 shutdown_connections 2024-09-19T09:47:37.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.276+0000 7fe38978d640 1 -- 172.21.15.123:0/3395003628 wait complete. 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.279+0000 7fe38978d640 1 Processor -- start 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.282+0000 7fe38978d640 1 -- start start 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.283+0000 7fe38978d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe384071f40 0x7fe3840cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.283+0000 7fe38978d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3840c8300 0x7fe3841f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.283+0000 7fe38978d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384159870 0x7fe3841f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.283+0000 7fe38978d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3840c6ca0 con 0x7fe384159870 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.283+0000 7fe38978d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe384071ab0 con 0x7fe384071f40 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.283+0000 7fe38978d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe384159c50 con 0x7fe3840c8300 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.284+0000 7fe3837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384159870 0x7fe3841f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.284+0000 7fe3837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384159870 0x7fe3841f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44144/0 (socket says 172.21.15.123:44144) 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.284+0000 7fe3837fe640 1 -- 172.21.15.123:0/2503591076 learned_addr learned my addr 172.21.15.123:0/2503591076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.284+0000 7fe382ffd640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe384071f40 0x7fe3840cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.285+0000 7fe3837fe640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3840c8300 msgr2=0x7fe3841f4d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.285+0000 7fe3837fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3840c8300 0x7fe3841f4d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.285+0000 7fe3837fe640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe384071f40 msgr2=0x7fe3840cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.285+0000 7fe3837fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe384071f40 0x7fe3840cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.285+0000 7fe3837fe640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38415cd70 con 0x7fe384159870 2024-09-19T09:47:37.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.286+0000 7fe3837fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384159870 0x7fe3841f5270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009eb0 tx=0x7fe37c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.289+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c041030 con 0x7fe384159870 2024-09-19T09:47:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.289+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37c03c420 con 0x7fe384159870 2024-09-19T09:47:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.289+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c03c7d0 con 0x7fe384159870 2024-09-19T09:47:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.290+0000 7fe38978d640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38415c1f0 con 0x7fe384159870 2024-09-19T09:47:37.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.290+0000 7fe38978d640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38415c7b0 con 0x7fe384159870 2024-09-19T09:47:37.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.294+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe37c039040 con 0x7fe384159870 2024-09-19T09:47:37.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.295+0000 7fe36b7fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe37006c3b0 0x7fe37006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.295+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fe37c0ac980 con 0x7fe384159870 2024-09-19T09:47:37.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.296+0000 7fe382ffd640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe37006c3b0 0x7fe37006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.296+0000 7fe38978d640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 0x7fe364004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.296+0000 7fe38978d640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe364007ec0 con 0x7fe364002a70 2024-09-19T09:47:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.297+0000 7fe382ffd640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe37006c3b0 0x7fe37006e870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe378000f60 tx=0x7fe378009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.297+0000 7fe3827fc640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 0x7fe364004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.300+0000 7fe3827fc640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3640080c0 con 0x7fe364002a70 2024-09-19T09:47:37.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.301+0000 7fe3827fc640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 0x7fe364004f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3841ef320 tx=0x7fe37400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.301+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374015070 con 0x7fe364002a70 2024-09-19T09:47:37.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.302+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe374011800 con 0x7fe364002a70 2024-09-19T09:47:37.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.302+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 msgr2=0x7fe364004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.302+0000 7fe36b7fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 0x7fe364004f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3841ef320 tx=0x7fe37400c8a0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.302+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 msgr2=0x7fe364004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:37.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.302+0000 7fe36b7fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364002a70 0x7fe364004f30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.317+0000 7fe38978d640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 0x7fe364007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.319+0000 7fe38978d640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe36400a4a0 con 0x7fe364006ee0 2024-09-19T09:47:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.319+0000 7fe3827fc640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 0x7fe364007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.323+0000 7fe3827fc640 1 -- 172.21.15.123:0/2503591076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3640078b0 con 0x7fe364006ee0 2024-09-19T09:47:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.324+0000 7fe3827fc640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 0x7fe364007370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe3841ef320 tx=0x7fe374004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.325+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374015040 con 0x7fe364006ee0 2024-09-19T09:47:37.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.325+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fe374010350 con 0x7fe364006ee0 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.325+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 msgr2=0x7fe364007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.325+0000 7fe36b7fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 0x7fe364007370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe3841ef320 tx=0x7fe374004730 comp rx=0 tx=0).stop 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.325+0000 7fe36b7fe640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 msgr2=0x7fe364007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.325+0000 7fe36b7fe640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe364006ee0 0x7fe364007370 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe3841ef320 tx=0x7fe374004730 comp rx=0 tx=0).stop 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:47:37.328 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 26, 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13783, 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.329 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.330 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:37.331 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.332 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:37.333 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.334 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.336 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.337 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:37.338 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.339 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.340 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:37.340 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.328+0000 7fe3697fa640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe37006c3b0 msgr2=0x7fe37006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.328+0000 7fe3697fa640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe37006c3b0 0x7fe37006e870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe378000f60 tx=0x7fe378009040 comp rx=0 tx=0).stop 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.329+0000 7fe3697fa640 1 -- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384159870 msgr2=0x7fe3841f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.329+0000 7fe3697fa640 1 --2- 172.21.15.123:0/2503591076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384159870 0x7fe3841f5270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009eb0 tx=0x7fe37c004a40 comp rx=0 tx=0).stop 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.330+0000 7fe3837fe640 1 -- 172.21.15.123:0/2503591076 reap_dead start 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.330+0000 7fe3837fe640 1 -- 172.21.15.123:0/2503591076 reap_dead start 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.333+0000 7fe3697fa640 1 -- 172.21.15.123:0/2503591076 shutdown_connections 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.333+0000 7fe3697fa640 1 -- 172.21.15.123:0/2503591076 >> 172.21.15.123:0/2503591076 conn(0x7fe38406ed00 msgr2=0x7fe3840c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.333+0000 7fe3697fa640 1 -- 172.21.15.123:0/2503591076 shutdown_connections 2024-09-19T09:47:37.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.333+0000 7fe3697fa640 1 -- 172.21.15.123:0/2503591076 wait complete. 2024-09-19T09:47:37.355 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:47:37.355 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:47:37.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:47:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.547+0000 7fa4b49f1640 1 Processor -- start 2024-09-19T09:47:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.547+0000 7fa4b49f1640 1 -- start start 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4b49f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a804b570 0x7fa4a8046020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4b49f1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa4a8046b60 0x7fa4a8006bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4b49f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a80e2c10 con 0x7fa4a80067e0 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4b49f1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a80e37b0 con 0x7fa4a8046b60 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4b49f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a8033510 con 0x7fa4a804b570 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4af7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4a80067e0 0x7fa4a804ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32962/0 (socket says 172.21.15.123:32962) 2024-09-19T09:47:37.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4af7fe640 1 -- 172.21.15.123:0/3091649770 learned_addr learned my addr 172.21.15.123:0/3091649770 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:47:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/3091649770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a804b570 0x7fa4a8046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.549+0000 7fa4affff640 1 --2- 172.21.15.123:0/3091649770 >> v2:172.21.15.194:3300/0 conn(0x7fa4a8046b60 0x7fa4a8006bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.550+0000 7fa4aeffd640 1 -- 172.21.15.123:0/3091649770 >> v2:172.21.15.194:3300/0 conn(0x7fa4a8046b60 msgr2=0x7fa4a8006bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.550+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/3091649770 >> v2:172.21.15.194:3300/0 conn(0x7fa4a8046b60 0x7fa4a8006bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.550+0000 7fa4aeffd640 1 -- 172.21.15.123:0/3091649770 >> v1:172.21.15.123:6789/0 conn(0x7fa4a80067e0 legacy=0x7fa4a804ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.550+0000 7fa4ae7fc640 1 -- 172.21.15.123:0/3091649770 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705989603 0 0) 0x7fa4a80e2c10 con 0x7fa4a80067e0 2024-09-19T09:47:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.550+0000 7fa4aeffd640 1 -- 172.21.15.123:0/3091649770 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80e2e80 con 0x7fa4a804b570 2024-09-19T09:47:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.551+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/3091649770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a804b570 0x7fa4a8046020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4b006af60 tx=0x7fa4b00a72b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d5e1f6da788099 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.552+0000 7fa4ae7fc640 1 -- 172.21.15.123:0/3091649770 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00b4070 con 0x7fa4a804b570 2024-09-19T09:47:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.552+0000 7fa4ae7fc640 1 -- 172.21.15.123:0/3091649770 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b00af680 con 0x7fa4a804b570 2024-09-19T09:47:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.553+0000 7fa4b49f1640 1 -- 172.21.15.123:0/3091649770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a804b570 msgr2=0x7fa4a8046020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.553+0000 7fa4b49f1640 1 --2- 172.21.15.123:0/3091649770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a804b570 0x7fa4a8046020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4b006af60 tx=0x7fa4b00a72b0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.553+0000 7fa4b49f1640 1 -- 172.21.15.123:0/3091649770 shutdown_connections 2024-09-19T09:47:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.553+0000 7fa4b49f1640 1 --2- 172.21.15.123:0/3091649770 >> v2:172.21.15.194:3300/0 conn(0x7fa4a8046b60 0x7fa4a8006bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.553+0000 7fa4b49f1640 1 --2- 172.21.15.123:0/3091649770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a804b570 0x7fa4a8046020 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.553+0000 7fa4b49f1640 1 -- 172.21.15.123:0/3091649770 >> 172.21.15.123:0/3091649770 conn(0x7fa4a80504e0 msgr2=0x7fa4a80508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.555+0000 7fa4b49f1640 1 -- 172.21.15.123:0/3091649770 shutdown_connections 2024-09-19T09:47:37.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.556+0000 7fa4b49f1640 1 -- 172.21.15.123:0/3091649770 wait complete. 2024-09-19T09:47:37.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.558+0000 7fa4b49f1640 1 Processor -- start 2024-09-19T09:47:37.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.558+0000 7fa4b49f1640 1 -- start start 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.559+0000 7fa4b49f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 0x7fa4a817cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.559+0000 7fa4b49f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a8046b60 0x7fa4a8049bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4af7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 0x7fa4a817cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4af7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 0x7fa4a817cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44160/0 (socket says 172.21.15.123:44160) 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4b49f1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a804b570 0x7fa4a816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4b49f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8046690 con 0x7fa4a80067e0 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4b49f1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80e3440 con 0x7fa4a804b570 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4b49f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a80dd0b0 con 0x7fa4a8046b60 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4af7fe640 1 -- 172.21.15.123:0/2140130376 learned_addr learned my addr 172.21.15.123:0/2140130376 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a8046b60 0x7fa4a8049bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.560+0000 7fa4affff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a804b570 0x7fa4a816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.561+0000 7fa4af7fe640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a8046b60 msgr2=0x7fa4a8049bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.561+0000 7fa4af7fe640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4a8046b60 0x7fa4a8049bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.561+0000 7fa4af7fe640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a804b570 msgr2=0x7fa4a816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.561+0000 7fa4af7fe640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a804b570 0x7fa4a816a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.561+0000 7fa4af7fe640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a804a290 con 0x7fa4a80067e0 2024-09-19T09:47:37.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.561+0000 7fa4af7fe640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 0x7fa4a817cdf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00c4d0 tx=0x7fa49c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.562+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c018070 con 0x7fa4a80067e0 2024-09-19T09:47:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.562+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c0074e0 con 0x7fa4a80067e0 2024-09-19T09:47:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.562+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c004a20 con 0x7fa4a80067e0 2024-09-19T09:47:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.562+0000 7fa4b49f1640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a804a570 con 0x7fa4a80067e0 2024-09-19T09:47:37.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.562+0000 7fa4b49f1640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a817c5f0 con 0x7fa4a80067e0 2024-09-19T09:47:37.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.565+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa49c01b070 con 0x7fa4a80067e0 2024-09-19T09:47:37.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.566+0000 7fa499ffb640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 0x7fa490004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.566+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa490007ec0 con 0x7fa490002a70 2024-09-19T09:47:37.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.566+0000 7fa49bfff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa49406c3b0 0x7fa49406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.567+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa49c08a870 con 0x7fa4a80067e0 2024-09-19T09:47:37.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.567+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 0x7fa490004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.567+0000 7fa4aeffd640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4900080c0 con 0x7fa490002a70 2024-09-19T09:47:37.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.568+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 0x7fa490004f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa4b006b2c0 tx=0x7fa4b00749f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.568+0000 7fa4affff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa49406c3b0 0x7fa49406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.569+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00bd070 con 0x7fa490002a70 2024-09-19T09:47:37.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.569+0000 7fa4affff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa49406c3b0 0x7fa49406e870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4006fd0 tx=0x7fa4a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.570+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa4b0062cf0 con 0x7fa490002a70 2024-09-19T09:47:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.571+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 msgr2=0x7fa490004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.571+0000 7fa49bfff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 0x7fa490004f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa4b006b2c0 tx=0x7fa4b00749f0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.571+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 msgr2=0x7fa490004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.571+0000 7fa49bfff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490002a70 0x7fa490004f30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.583+0000 7fa499ffb640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 0x7fa490007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.583+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa49000a4a0 con 0x7fa490006ee0 2024-09-19T09:47:37.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.588+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 0x7fa490007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.589+0000 7fa4aeffd640 1 -- 172.21.15.123:0/2140130376 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa4900078b0 con 0x7fa490006ee0 2024-09-19T09:47:37.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.590+0000 7fa4aeffd640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 0x7fa490007370 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00766e0 tx=0x7fa4b00ac000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.592+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00bd050 con 0x7fa490006ee0 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.592+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4720 (secure 0 0 0) 0x7fa4b00c29d0 con 0x7fa490006ee0 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.592+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 msgr2=0x7fa490007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.592+0000 7fa49bfff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 0x7fa490007370 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00766e0 tx=0x7fa4b00ac000 comp rx=0 tx=0).stop 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.592+0000 7fa49bfff640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 msgr2=0x7fa490007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.592+0000 7fa49bfff640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa490006ee0 0x7fa490007370 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:37.594 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 26, 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 66908, 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:37.595 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.596 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.597 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:37.598 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:37.599 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:37.600 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:37.601 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.602 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:37.603 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:37.604 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.605 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.606 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:37.607 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:37.608 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:37.608 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:37.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:37.608 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:37.608 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:37.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa49406c3b0 msgr2=0x7fa49406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa499ffb640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa49406c3b0 0x7fa49406e870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4006fd0 tx=0x7fa4a4008040 comp rx=0 tx=0).stop 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa4affff640 1 -- 172.21.15.123:0/2140130376 reap_dead start 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 msgr2=0x7fa4a817cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa499ffb640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 0x7fa4a817cdf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00c4d0 tx=0x7fa49c00c990 comp rx=0 tx=0).stop 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 shutdown_connections 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.595+0000 7fa499ffb640 1 --2- 172.21.15.123:0/2140130376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4a80067e0 0x7fa4a817cdf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.596+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 >> 172.21.15.123:0/2140130376 conn(0x7fa4a80504e0 msgr2=0x7fa4a804b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.598+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 shutdown_connections 2024-09-19T09:47:37.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.598+0000 7fa499ffb640 1 -- 172.21.15.123:0/2140130376 wait complete. 2024-09-19T09:47:37.625 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:47:37.625 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-19T09:47:37.625 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:47:37.626 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-19T09:47:37.626 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-19T09:47:37.626 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T09:47:37.626 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:47:37.658 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T09:47:37.658 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:47:37.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:47:37.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.878+0000 7f75ab444640 1 Processor -- start 2024-09-19T09:47:37.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.878+0000 7f75ab444640 1 -- start start 2024-09-19T09:47:37.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.880+0000 7f75ab444640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c0059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.880+0000 7f75ab444640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f759c0ff820 0x7f759c0ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.880+0000 7f75ab444640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759c1005b0 con 0x7f759c046380 2024-09-19T09:47:37.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.880+0000 7f75ab444640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f759c045650 con 0x7f759c0ff820 2024-09-19T09:47:37.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.880+0000 7f75ab444640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f759c045ef0 con 0x7f759c04aa30 2024-09-19T09:47:37.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.881+0000 7f75aac43640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f759c0ff820 0x7f759c0ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.881+0000 7f75aac43640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f759c0ff820 0x7f759c0ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:41028/0 (socket says 172.21.15.123:41028) 2024-09-19T09:47:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.881+0000 7f75aac43640 1 -- 172.21.15.123:0/4188634248 learned_addr learned my addr 172.21.15.123:0/4188634248 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.881+0000 7f75aa442640 1 --2- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c0059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.882+0000 7f75aac43640 1 -- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 msgr2=0x7f759c0059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.882+0000 7f75aac43640 1 --2- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c0059f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.882+0000 7f75aac43640 1 -- 172.21.15.123:0/4188634248 >> v1:172.21.15.194:6789/0 conn(0x7f759c046380 legacy=0x7f759c0f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.882+0000 7f75aac43640 1 -- 172.21.15.123:0/4188634248 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c0458a0 con 0x7f759c0ff820 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.883+0000 7f75aac43640 1 --2- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c0ff820 0x7f759c0ffc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75a406a660 tx=0x7f75a409aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9200b9bc9343874b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.883+0000 7f75a9440640 1 -- 172.21.15.123:0/4188634248 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a409c980 con 0x7f759c0ff820 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.883+0000 7f75a9440640 1 -- 172.21.15.123:0/4188634248 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a409cb20 con 0x7f759c0ff820 2024-09-19T09:47:37.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.883+0000 7f75a9440640 1 -- 172.21.15.123:0/4188634248 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40a4420 con 0x7f759c0ff820 2024-09-19T09:47:37.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.884+0000 7f75ab444640 1 -- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c0ff820 msgr2=0x7f759c0ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.884+0000 7f75ab444640 1 --2- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c0ff820 0x7f759c0ffc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75a406a660 tx=0x7f75a409aba0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.885+0000 7f75ab444640 1 -- 172.21.15.123:0/4188634248 shutdown_connections 2024-09-19T09:47:37.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.885+0000 7f75ab444640 1 --2- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c0ff820 0x7f759c0ffc70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.885+0000 7f75ab444640 1 --2- 172.21.15.123:0/4188634248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c0059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.885+0000 7f75ab444640 1 -- 172.21.15.123:0/4188634248 >> 172.21.15.123:0/4188634248 conn(0x7f759c04fc40 msgr2=0x7f759c050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.889+0000 7f75ab444640 1 -- 172.21.15.123:0/4188634248 shutdown_connections 2024-09-19T09:47:37.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.889+0000 7f75ab444640 1 -- 172.21.15.123:0/4188634248 wait complete. 2024-09-19T09:47:37.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.892+0000 7f75ab444640 1 Processor -- start 2024-09-19T09:47:37.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.892+0000 7f75ab444640 1 -- start start 2024-09-19T09:47:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75ab444640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c046380 0x7f759c1925a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75ab444640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c006550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75ab444640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c0ff820 0x7f759c049500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75ab444640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f759c046900 con 0x7f759c0ff820 2024-09-19T09:47:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75ab444640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f759c046780 con 0x7f759c046380 2024-09-19T09:47:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75ab444640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f759c044b20 con 0x7f759c04aa30 2024-09-19T09:47:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75aac43640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c0ff820 msgr2=0x7f759c049500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75aac43640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c0ff820 0x7f759c049500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75a9c41640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c006550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75a9c41640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c006550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53994/0 (socket says 172.21.15.123:53994) 2024-09-19T09:47:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.893+0000 7f75a9c41640 1 -- 172.21.15.123:0/1280264475 learned_addr learned my addr 172.21.15.123:0/1280264475 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.894+0000 7f75aa442640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c046380 0x7f759c1925a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.894+0000 7f75a9c41640 1 -- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c046380 msgr2=0x7f759c1925a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.894+0000 7f75a9c41640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c046380 0x7f759c1925a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.894+0000 7f75a9c41640 1 -- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c0ff820 msgr2=0x7f759c049500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.894+0000 7f75a9c41640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c0ff820 0x7f759c049500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.894+0000 7f75a9c41640 1 -- 172.21.15.123:0/1280264475 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c0f2cc0 con 0x7f759c04aa30 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.895+0000 7f75a9c41640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c006550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f759800c480 tx=0x7f759800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.895+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75980052d0 con 0x7f759c04aa30 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.896+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598005470 con 0x7f759c04aa30 2024-09-19T09:47:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.896+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598012850 con 0x7f759c04aa30 2024-09-19T09:47:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.896+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c195f50 con 0x7f759c04aa30 2024-09-19T09:47:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.896+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c0f29e0 con 0x7f759c04aa30 2024-09-19T09:47:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.898+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c046aa0 con 0x7f759c04aa30 2024-09-19T09:47:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.904+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75980129f0 con 0x7f759c04aa30 2024-09-19T09:47:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.904+0000 7f7596ffd640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f758806c2b0 0x7f758806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.904+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f759808b350 con 0x7f759c04aa30 2024-09-19T09:47:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.905+0000 7f75aa442640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f758806c2b0 0x7f758806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.906+0000 7f75aa442640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f758806c2b0 0x7f758806e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75a000ab10 tx=0x7f75a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:37.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:37.912+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7598059a20 con 0x7f759c04aa30 2024-09-19T09:47:38.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.426+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f759c033f20 con 0x7f759c04aa30 2024-09-19T09:47:38.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.427+0000 7f7596ffd640 1 -- 172.21.15.123:0/1280264475 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f7598059320 con 0x7f759c04aa30 2024-09-19T09:47:38.432 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:38.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.434+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f758806c2b0 msgr2=0x7f758806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:38.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.434+0000 7f75ab444640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f758806c2b0 0x7f758806e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75a000ab10 tx=0x7f75a0008040 comp rx=0 tx=0).stop 2024-09-19T09:47:38.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.434+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 msgr2=0x7f759c006550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:38.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.434+0000 7f75ab444640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c006550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f759800c480 tx=0x7f759800c940 comp rx=0 tx=0).stop 2024-09-19T09:47:38.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.435+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 shutdown_connections 2024-09-19T09:47:38.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.435+0000 7f75ab444640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c0ff820 0x7f759c049500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.435+0000 7f75ab444640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f758806c2b0 0x7f758806e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.435+0000 7f75ab444640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f759c04aa30 0x7f759c006550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.435+0000 7f75ab444640 1 --2- 172.21.15.123:0/1280264475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f759c046380 0x7f759c1925a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.435+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 >> 172.21.15.123:0/1280264475 conn(0x7f759c04fc40 msgr2=0x7f759c0358e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:38.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.437+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 shutdown_connections 2024-09-19T09:47:38.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:38.437+0000 7f75ab444640 1 -- 172.21.15.123:0/1280264475 wait complete. 2024-09-19T09:47:41.466 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:47:41.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.681+0000 7f896726e640 1 Processor -- start 2024-09-19T09:47:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.681+0000 7f896726e640 1 -- start start 2024-09-19T09:47:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f896726e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 0x7f89600c7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f896726e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89601598a0 0x7f896015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f896726e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89600c7f20 con 0x7f89600c8c50 2024-09-19T09:47:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f896726e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8960072200 con 0x7f89601598a0 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f896726e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f89600c81e0 con 0x7f89600c8870 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f8966a6d640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7f89601598a0 msgr2=0x7f896015f370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f8966a6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89601598a0 0x7f896015f370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.683+0000 7f8965a6b640 1 -- >> v1:172.21.15.123:6789/0 conn(0x7f89600c8c50 legacy=0x7f8960159190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.684+0000 7f896626c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 0x7f89600c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.684+0000 7f896626c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 0x7f89600c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:54010/0 (socket says 172.21.15.123:54010) 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.684+0000 7f896626c640 1 -- 172.21.15.123:0/2336275035 learned_addr learned my addr 172.21.15.123:0/2336275035 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:41.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.685+0000 7f896626c640 1 -- 172.21.15.123:0/2336275035 >> v2:172.21.15.123:3300/0 conn(0x7f89601598a0 msgr2=0x7f896015f370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.685+0000 7f896626c640 1 --2- 172.21.15.123:0/2336275035 >> v2:172.21.15.123:3300/0 conn(0x7f89601598a0 0x7f896015f370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.685+0000 7f896626c640 1 -- 172.21.15.123:0/2336275035 >> v1:172.21.15.123:6789/0 conn(0x7f89600c8c50 legacy=0x7f8960159190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.685+0000 7f896626c640 1 -- 172.21.15.123:0/2336275035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89600718d0 con 0x7f89600c8870 2024-09-19T09:47:41.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.687+0000 7f896626c640 1 --2- 172.21.15.123:0/2336275035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 0x7f89600c7730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8960075df0 tx=0x7f895c02a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efee53fc4fe244bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:41.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.688+0000 7f896526a640 1 -- 172.21.15.123:0/2336275035 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c037070 con 0x7f89600c8870 2024-09-19T09:47:41.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.688+0000 7f896526a640 1 -- 172.21.15.123:0/2336275035 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c032440 con 0x7f89600c8870 2024-09-19T09:47:41.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.689+0000 7f896726e640 1 -- 172.21.15.123:0/2336275035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 msgr2=0x7f89600c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:41.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.689+0000 7f896726e640 1 --2- 172.21.15.123:0/2336275035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 0x7f89600c7730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8960075df0 tx=0x7f895c02a2a0 comp rx=0 tx=0).stop 2024-09-19T09:47:41.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.689+0000 7f896726e640 1 -- 172.21.15.123:0/2336275035 shutdown_connections 2024-09-19T09:47:41.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.689+0000 7f896726e640 1 --2- 172.21.15.123:0/2336275035 >> v2:172.21.15.123:3300/0 conn(0x7f89601598a0 0x7f896015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:41.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.689+0000 7f896726e640 1 --2- 172.21.15.123:0/2336275035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8870 0x7f89600c7730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:41.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.689+0000 7f896726e640 1 -- 172.21.15.123:0/2336275035 >> 172.21.15.123:0/2336275035 conn(0x7f8960067b30 msgr2=0x7f89600cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:41.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.690+0000 7f896726e640 1 -- 172.21.15.123:0/2336275035 shutdown_connections 2024-09-19T09:47:41.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.690+0000 7f896726e640 1 -- 172.21.15.123:0/2336275035 wait complete. 2024-09-19T09:47:41.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.692+0000 7f896726e640 1 Processor -- start 2024-09-19T09:47:41.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.692+0000 7f896726e640 1 -- start start 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f896726e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89600c8870 0x7f89600ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f896726e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 0x7f896015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f896726e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89601598a0 0x7f896015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f896726e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8960068200 con 0x7f89601598a0 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f896726e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8960071e90 con 0x7f89600c8870 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f896726e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f89600c7170 con 0x7f89600c8c50 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f8966a6d640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89601598a0 msgr2=0x7f896015c540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f8966a6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89601598a0 0x7f896015c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f8965a6b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 0x7f896015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f8965a6b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 0x7f896015fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:54016/0 (socket says 172.21.15.123:54016) 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.693+0000 7f8965a6b640 1 -- 172.21.15.123:0/4027754544 learned_addr learned my addr 172.21.15.123:0/4027754544 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.694+0000 7f8965a6b640 1 -- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89600c8870 msgr2=0x7f89600ba0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.694+0000 7f8965a6b640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89600c8870 0x7f89600ba0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.694+0000 7f8965a6b640 1 -- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89601598a0 msgr2=0x7f896015c540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.694+0000 7f8965a6b640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89601598a0 0x7f896015c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.694+0000 7f8965a6b640 1 -- 172.21.15.123:0/4027754544 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89601535b0 con 0x7f89600c8c50 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.694+0000 7f8965a6b640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 0x7f896015fe00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f895000b550 tx=0x7f895000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.695+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950003af0 con 0x7f89600c8c50 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.695+0000 7f896726e640 1 -- 172.21.15.123:0/4027754544 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896015de10 con 0x7f89600c8c50 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.695+0000 7f896726e640 1 -- 172.21.15.123:0/4027754544 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8960159ce0 con 0x7f89600c8c50 2024-09-19T09:47:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.695+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8950015070 con 0x7f89600c8c50 2024-09-19T09:47:41.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.697+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950005070 con 0x7f89600c8c50 2024-09-19T09:47:41.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.700+0000 7f896726e640 1 -- 172.21.15.123:0/4027754544 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8948005290 con 0x7f89600c8c50 2024-09-19T09:47:41.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.701+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8950005250 con 0x7f89600c8c50 2024-09-19T09:47:41.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.702+0000 7f8956ffd640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f894406c300 0x7f894406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:41.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.702+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f895008add0 con 0x7f89600c8c50 2024-09-19T09:47:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.705+0000 7f896626c640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f894406c300 0x7f894406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:41.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.706+0000 7f896626c640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f894406c300 0x7f894406e7c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f895c034000 tx=0x7f895c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:41.714+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f895008e030 con 0x7f89600c8c50 2024-09-19T09:47:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.226+0000 7f896726e640 1 -- 172.21.15.123:0/4027754544 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8948005580 con 0x7f89600c8c50 2024-09-19T09:47:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.228+0000 7f8956ffd640 1 -- 172.21.15.123:0/4027754544 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8950059550 con 0x7f89600c8c50 2024-09-19T09:47:42.231 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 -- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f894406c300 msgr2=0x7f894406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f894406c300 0x7f894406e7c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f895c034000 tx=0x7f895c02e000 comp rx=0 tx=0).stop 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 -- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 msgr2=0x7f896015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 0x7f896015fe00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f895000b550 tx=0x7f895000ba10 comp rx=0 tx=0).stop 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 -- 172.21.15.123:0/4027754544 shutdown_connections 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89601598a0 0x7f896015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f894406c300 0x7f894406e7c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89600c8c50 0x7f896015fe00 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f895000b550 tx=0x7f895000ba10 comp rx=0 tx=0).stop 2024-09-19T09:47:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 --2- 172.21.15.123:0/4027754544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89600c8870 0x7f89600ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.233+0000 7f8954ff9640 1 -- 172.21.15.123:0/4027754544 >> 172.21.15.123:0/4027754544 conn(0x7f8960067b30 msgr2=0x7f89600c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:42.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.239+0000 7f8954ff9640 1 -- 172.21.15.123:0/4027754544 shutdown_connections 2024-09-19T09:47:42.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:42.239+0000 7f8954ff9640 1 -- 172.21.15.123:0/4027754544 wait complete. 2024-09-19T09:47:45.264 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:47:45.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.447+0000 7efd19518640 1 Processor -- start 2024-09-19T09:47:45.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.447+0000 7efd19518640 1 -- start start 2024-09-19T09:47:45.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd19518640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 0x7efd140c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:45.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd19518640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd1406c750 0x7efd140c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:45.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd19518640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd141680e0 con 0x7efd140c6880 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd19518640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efd141683c0 con 0x7efd1406c750 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd19518640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7efd141686a0 con 0x7efd140c64a0 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd127fc640 1 -- >> v1:172.21.15.123:6789/0 conn(0x7efd140c6880 legacy=0x7efd1406bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd137fe640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7efd1406c750 msgr2=0x7efd140c7400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.449+0000 7efd137fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd1406c750 0x7efd140c7400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.450+0000 7efd12ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 0x7efd140c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.450+0000 7efd12ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 0x7efd140c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:40000/0 (socket says 172.21.15.123:40000) 2024-09-19T09:47:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.450+0000 7efd12ffd640 1 -- 172.21.15.123:0/1223238678 learned_addr learned my addr 172.21.15.123:0/1223238678 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.453+0000 7efd12ffd640 1 -- 172.21.15.123:0/1223238678 >> v2:172.21.15.123:3300/0 conn(0x7efd1406c750 msgr2=0x7efd140c7400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.453+0000 7efd12ffd640 1 --2- 172.21.15.123:0/1223238678 >> v2:172.21.15.123:3300/0 conn(0x7efd1406c750 0x7efd140c7400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.453+0000 7efd12ffd640 1 -- 172.21.15.123:0/1223238678 >> v1:172.21.15.123:6789/0 conn(0x7efd140c6880 legacy=0x7efd1406bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.453+0000 7efd12ffd640 1 -- 172.21.15.123:0/1223238678 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd14168980 con 0x7efd140c64a0 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.454+0000 7efd12ffd640 1 --2- 172.21.15.123:0/1223238678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 0x7efd140c7c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd0400a900 tx=0x7efd0402e7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc4683d8a1dd481b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.455+0000 7efd11ffb640 1 -- 172.21.15.123:0/1223238678 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0403c070 con 0x7efd140c64a0 2024-09-19T09:47:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.455+0000 7efd11ffb640 1 -- 172.21.15.123:0/1223238678 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd04034480 con 0x7efd140c64a0 2024-09-19T09:47:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 -- 172.21.15.123:0/1223238678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 msgr2=0x7efd140c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 --2- 172.21.15.123:0/1223238678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 0x7efd140c7c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd0400a900 tx=0x7efd0402e7d0 comp rx=0 tx=0).stop 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 -- 172.21.15.123:0/1223238678 shutdown_connections 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 --2- 172.21.15.123:0/1223238678 >> v2:172.21.15.123:3300/0 conn(0x7efd1406c750 0x7efd140c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 --2- 172.21.15.123:0/1223238678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd140c64a0 0x7efd140c7c30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 -- 172.21.15.123:0/1223238678 >> 172.21.15.123:0/1223238678 conn(0x7efd1406eaa0 msgr2=0x7efd1406ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 -- 172.21.15.123:0/1223238678 shutdown_connections 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.456+0000 7efd19518640 1 -- 172.21.15.123:0/1223238678 wait complete. 2024-09-19T09:47:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.458+0000 7efd19518640 1 Processor -- start 2024-09-19T09:47:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.459+0000 7efd19518640 1 -- start start 2024-09-19T09:47:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd19518640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd1406c750 0x7efd14165da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd19518640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140c6880 0x7efd141fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd19518640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd141fab00 0x7efd140c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd19518640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd1406c4a0 con 0x7efd140c6880 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd19518640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd1406c320 con 0x7efd1406c750 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd19518640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7efd140c8a00 con 0x7efd141fab00 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd127fc640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140c6880 msgr2=0x7efd141fa5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd127fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140c6880 0x7efd141fa5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd12ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd1406c750 0x7efd14165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd12ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd1406c750 0x7efd14165da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:49558/0 (socket says 172.21.15.123:49558) 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd12ffd640 1 -- 172.21.15.123:0/2313992385 learned_addr learned my addr 172.21.15.123:0/2313992385 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.460+0000 7efd137fe640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd141fab00 0x7efd140c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.461+0000 7efd137fe640 1 -- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd1406c750 msgr2=0x7efd14165da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.461+0000 7efd137fe640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd1406c750 0x7efd14165da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.461+0000 7efd137fe640 1 -- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140c6880 msgr2=0x7efd141fa5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.461+0000 7efd137fe640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140c6880 0x7efd141fa5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.461+0000 7efd137fe640 1 -- 172.21.15.123:0/2313992385 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd141fc0a0 con 0x7efd141fab00 2024-09-19T09:47:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.462+0000 7efd137fe640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd141fab00 0x7efd140c1370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd14073de0 tx=0x7efd0800b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.463+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08016070 con 0x7efd141fab00 2024-09-19T09:47:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.463+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd141fc380 con 0x7efd141fab00 2024-09-19T09:47:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.463+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1420e910 con 0x7efd141fab00 2024-09-19T09:47:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.464+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd08003ce0 con 0x7efd141fab00 2024-09-19T09:47:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.464+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd080052b0 con 0x7efd141fab00 2024-09-19T09:47:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.467+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efd08019070 con 0x7efd141fab00 2024-09-19T09:47:45.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.470+0000 7efcfb7fe640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efd0006c2e0 0x7efd0006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:45.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.471+0000 7efd12ffd640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efd0006c2e0 0x7efd0006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:45.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.471+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7efd0808a700 con 0x7efd141fab00 2024-09-19T09:47:45.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.473+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf4005290 con 0x7efd141fab00 2024-09-19T09:47:45.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.474+0000 7efd12ffd640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efd0006c2e0 0x7efd0006e7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd04006fd0 tx=0x7efd04032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:45.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:45.482+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efd080586f0 con 0x7efd141fab00 2024-09-19T09:47:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.065+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efcf4005580 con 0x7efd141fab00 2024-09-19T09:47:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.067+0000 7efcfb7fe640 1 -- 172.21.15.123:0/2313992385 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7efd0805c9f0 con 0x7efd141fab00 2024-09-19T09:47:46.073 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.075+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efd0006c2e0 msgr2=0x7efd0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.075+0000 7efd19518640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efd0006c2e0 0x7efd0006e7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd04006fd0 tx=0x7efd04032000 comp rx=0 tx=0).stop 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd141fab00 msgr2=0x7efd140c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd141fab00 0x7efd140c1370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd14073de0 tx=0x7efd0800b8f0 comp rx=0 tx=0).stop 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 shutdown_connections 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efd0006c2e0 0x7efd0006e7a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd141fab00 0x7efd140c1370 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140c6880 0x7efd141fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 --2- 172.21.15.123:0/2313992385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd1406c750 0x7efd14165da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 >> 172.21.15.123:0/2313992385 conn(0x7efd1406eaa0 msgr2=0x7efd141f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 shutdown_connections 2024-09-19T09:47:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:46.076+0000 7efd19518640 1 -- 172.21.15.123:0/2313992385 wait complete. 2024-09-19T09:47:49.106 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:47:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.325+0000 7fef81f28640 1 Processor -- start 2024-09-19T09:47:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.328+0000 7fef81f28640 1 -- start start 2024-09-19T09:47:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef81f28640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef81f28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef7c067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef81f28640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7c0c8530 con 0x7fef7c0c4780 2024-09-19T09:47:49.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef81f28640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c162a50 con 0x7fef7c1600d0 2024-09-19T09:47:49.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef81f28640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c0c8810 con 0x7fef7c159830 2024-09-19T09:47:49.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef7bfff640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef7c067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:49.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.329+0000 7fef7bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef7c067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:49.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.330+0000 7fef7affd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fef7c0c4780 0x7fef7c0cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:52018/0 (socket says 172.21.15.123:52018) 2024-09-19T09:47:49.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.330+0000 7fef7affd640 1 -- 172.21.15.123:0/1136870026 learned_addr learned my addr 172.21.15.123:0/1136870026 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:47:49.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.330+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.332+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.332+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.332+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.333+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.530+0000 7fef7bfff640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef7c067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.530+0000 7fef7bfff640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef7c067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:47:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.534+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.534+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.534+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.534+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.534+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:47:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.931+0000 7fef7bfff640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef7c067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.931+0000 7fef7bfff640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef7c067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:47:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.935+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.935+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.935+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.935+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:49.935+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:47:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.732+0000 7fef7bfff640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef7c067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:50.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.732+0000 7fef7bfff640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef7c067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:47:50.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.736+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:50.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.736+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:50.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.736+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:50.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.736+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:50.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:50.736+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:47:52.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 msgr2=0x7fef7c15fb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef7c15fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef7c067950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef7c067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.194:6789/0 conn(0x7fef7c0c4780 legacy=0x7fef7c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7c0c8af0 con 0x7fef68006190 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0c8810 con 0x7fef680036b0 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.329+0000 7fef7affd640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef68006190 legacy=0x7fef68008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:52.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.331+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:52.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.331+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:47:52.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.331+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:52.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.331+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:52.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.331+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:52.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.530+0000 7fef7affd640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef68006190 legacy=0x7fef68008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:52.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.532+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:52.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.532+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:47:52.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.532+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:52.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.532+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:52.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.532+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:47:52.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.931+0000 7fef7affd640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef68006190 legacy=0x7fef68008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:52.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.933+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:52.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.936+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:47:52.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.936+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:52.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.936+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:52.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:52.936+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:47:53.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:53.732+0000 7fef7affd640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef68006190 legacy=0x7fef68008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:53.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:53.737+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:53.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:53.737+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:47:53.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:53.737+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:47:53.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:53.737+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:47:53.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:53.737+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:47:55.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 msgr2=0x7fef68005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:55.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef680036b0 0x7fef68005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef68006190 legacy=0x7fef68008630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:55.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef68009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:55.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef68012b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:55.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef6800afd0 con 0x7fef6800a450 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c0c8810 con 0x7fef7c1600d0 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef797fa640 1 -- 172.21.15.123:0/1136870026 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fef6800ab70 con 0x7fef7c159830 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef7bfff640 1 -- 172.21.15.123:0/1136870026 reap_dead start 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef7bfff640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef68012b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.329+0000 7fef7bfff640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef68012b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.330+0000 7fef7affd640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef6800a450 legacy=0x7fef6800f420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.330+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.194:3300/0 conn(0x7fef7c159830 0x7fef68009ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.331+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 msgr2=0x7fef68012b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.331+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef68012b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.331+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 >> v1:172.21.15.123:6789/0 conn(0x7fef6800a450 legacy=0x7fef6800f420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.331+0000 7fef7b7fe640 1 -- 172.21.15.123:0/1136870026 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c0c8af0 con 0x7fef7c159830 2024-09-19T09:47:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.332+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7c159830 0x7fef68009ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0cb4c0 tx=0x7fef7002c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7d90d595695c435 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.332+0000 7fef7a7fc640 1 -- 172.21.15.123:0/1136870026 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70032070 con 0x7fef7c159830 2024-09-19T09:47:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.333+0000 7fef7a7fc640 1 -- 172.21.15.123:0/1136870026 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7002cbc0 con 0x7fef7c159830 2024-09-19T09:47:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 -- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7c159830 msgr2=0x7fef68009ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7c159830 0x7fef68009ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0cb4c0 tx=0x7fef7002c2c0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 -- 172.21.15.123:0/1136870026 shutdown_connections 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 --2- 172.21.15.123:0/1136870026 >> v2:172.21.15.123:3300/0 conn(0x7fef7c1600d0 0x7fef68012b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 --2- 172.21.15.123:0/1136870026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7c159830 0x7fef68009ef0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0cb4c0 tx=0x7fef7002c2c0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 -- 172.21.15.123:0/1136870026 >> 172.21.15.123:0/1136870026 conn(0x7fef7c0ca490 msgr2=0x7fef7c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 -- 172.21.15.123:0/1136870026 shutdown_connections 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.334+0000 7fef81f28640 1 -- 172.21.15.123:0/1136870026 wait complete. 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.336+0000 7fef81f28640 1 Processor -- start 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.336+0000 7fef81f28640 1 -- start start 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.337+0000 7fef81f28640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef6800a450 0x7fef7c14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.337+0000 7fef81f28640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 0x7fef7c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.337+0000 7fef81f28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef7c0c6670 0x7fef7c147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.337+0000 7fef81f28640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c15fb90 con 0x7fef7c0c6670 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.337+0000 7fef81f28640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0c90b0 con 0x7fef6800a450 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.337+0000 7fef81f28640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c15fd10 con 0x7fef7c1600d0 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.338+0000 7fef7bfff640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef7c0c6670 msgr2=0x7fef7c147900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.338+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef7c0c6670 0x7fef7c147900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.339+0000 7fef7affd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 0x7fef7c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.339+0000 7fef7affd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 0x7fef7c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36594/0 (socket says 172.21.15.123:36594) 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.339+0000 7fef7affd640 1 -- 172.21.15.123:0/1548440135 learned_addr learned my addr 172.21.15.123:0/1548440135 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef7affd640 1 -- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef6800a450 msgr2=0x7fef7c14bb00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef7affd640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef6800a450 0x7fef7c14bb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef7affd640 1 -- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef7c0c6670 msgr2=0x7fef7c147900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef7affd640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef7c0c6670 0x7fef7c147900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef7affd640 1 -- 172.21.15.123:0/1548440135 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c15cd00 con 0x7fef7c1600d0 2024-09-19T09:47:55.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef7affd640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 0x7fef7c0c6130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef74005c00 tx=0x7fef7400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:55.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.340+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74017070 con 0x7fef7c1600d0 2024-09-19T09:47:55.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.341+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c1437e0 con 0x7fef7c1600d0 2024-09-19T09:47:55.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.341+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c145810 con 0x7fef7c1600d0 2024-09-19T09:47:55.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.342+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7400abe0 con 0x7fef7c1600d0 2024-09-19T09:47:55.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.342+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74012400 con 0x7fef7c1600d0 2024-09-19T09:47:55.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.344+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef7401a070 con 0x7fef7c1600d0 2024-09-19T09:47:55.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.344+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5c005290 con 0x7fef7c1600d0 2024-09-19T09:47:55.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.345+0000 7fef63fff640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef6806d6d0 0x7fef6806fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.345+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef6806d6d0 0x7fef6806fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.346+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fef7408b070 con 0x7fef7c1600d0 2024-09-19T09:47:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.346+0000 7fef7b7fe640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef6806d6d0 0x7fef6806fb90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef70036000 tx=0x7fef70032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.354+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fef74059180 con 0x7fef7c1600d0 2024-09-19T09:47:55.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.937+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef5c005580 con 0x7fef7c1600d0 2024-09-19T09:47:55.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.938+0000 7fef63fff640 1 -- 172.21.15.123:0/1548440135 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fef7405d480 con 0x7fef7c1600d0 2024-09-19T09:47:55.940 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":28,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:47:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef6806d6d0 msgr2=0x7fef6806fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef6806d6d0 0x7fef6806fb90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef70036000 tx=0x7fef70032000 comp rx=0 tx=0).stop 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 msgr2=0x7fef7c0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 0x7fef7c0c6130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef74005c00 tx=0x7fef7400a060 comp rx=0 tx=0).stop 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 shutdown_connections 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef7c0c6670 0x7fef7c147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fef6806d6d0 0x7fef6806fb90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7c1600d0 0x7fef7c0c6130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 --2- 172.21.15.123:0/1548440135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef6800a450 0x7fef7c14bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 >> 172.21.15.123:0/1548440135 conn(0x7fef7c0ca490 msgr2=0x7fef7c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 shutdown_connections 2024-09-19T09:47:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:55.942+0000 7fef81f28640 1 -- 172.21.15.123:0/1548440135 wait complete. 2024-09-19T09:47:55.961 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:47:55.962 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-19T09:47:55.962 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:47:56.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.173+0000 7f801744c640 1 Processor -- start 2024-09-19T09:47:56.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.174+0000 7f801744c640 1 -- start start 2024-09-19T09:47:56.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.175+0000 7f801744c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8010151e90 0x7f80101588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.175+0000 7f801744c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 0x7f8010072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.175+0000 7f801744c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80100732c0 con 0x7f80100c5950 2024-09-19T09:47:56.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.175+0000 7f801744c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f80100c7c50 con 0x7f8010151e90 2024-09-19T09:47:56.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.175+0000 7f801744c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8010073070 con 0x7f80100c8f70 2024-09-19T09:47:56.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.176+0000 7f80151e8640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7f8010151e90 msgr2=0x7f80101588a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:56.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.176+0000 7f80151e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8010151e90 0x7f80101588a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:56.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.177+0000 7f80149e7640 1 -- >> v1:172.21.15.123:6789/0 conn(0x7f80100c5950 legacy=0x7f80100c8860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:47:56.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.179+0000 7f80159e9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 0x7f8010072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.179+0000 7f80159e9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 0x7f8010072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36604/0 (socket says 172.21.15.123:36604) 2024-09-19T09:47:56.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.179+0000 7f80159e9640 1 -- 172.21.15.123:0/1831739364 learned_addr learned my addr 172.21.15.123:0/1831739364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:56.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.179+0000 7f80159e9640 1 -- 172.21.15.123:0/1831739364 >> v2:172.21.15.123:3300/0 conn(0x7f8010151e90 msgr2=0x7f80101588a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:56.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.179+0000 7f80159e9640 1 --2- 172.21.15.123:0/1831739364 >> v2:172.21.15.123:3300/0 conn(0x7f8010151e90 0x7f80101588a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.179+0000 7f80159e9640 1 -- 172.21.15.123:0/1831739364 >> v1:172.21.15.123:6789/0 conn(0x7f80100c5950 legacy=0x7f80100c8860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:56.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.180+0000 7f80159e9640 1 -- 172.21.15.123:0/1831739364 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80100735a0 con 0x7f80100c8f70 2024-09-19T09:47:56.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.183+0000 7f80159e9640 1 --2- 172.21.15.123:0/1831739364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 0x7f8010072150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8000009870 tx=0x7f800002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9116ee212c7e18e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.188+0000 7f8007fff640 1 -- 172.21.15.123:0/1831739364 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000037070 con 0x7f80100c8f70 2024-09-19T09:47:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.188+0000 7f8007fff640 1 -- 172.21.15.123:0/1831739364 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8000032440 con 0x7f80100c8f70 2024-09-19T09:47:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.188+0000 7f8007fff640 1 -- 172.21.15.123:0/1831739364 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000032810 con 0x7f80100c8f70 2024-09-19T09:47:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.189+0000 7f801744c640 1 -- 172.21.15.123:0/1831739364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 msgr2=0x7f8010072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.189+0000 7f801744c640 1 --2- 172.21.15.123:0/1831739364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 0x7f8010072150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8000009870 tx=0x7f800002a230 comp rx=0 tx=0).stop 2024-09-19T09:47:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.193+0000 7f801744c640 1 -- 172.21.15.123:0/1831739364 shutdown_connections 2024-09-19T09:47:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.193+0000 7f801744c640 1 --2- 172.21.15.123:0/1831739364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c8f70 0x7f8010072150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.193+0000 7f801744c640 1 --2- 172.21.15.123:0/1831739364 >> v2:172.21.15.123:3300/0 conn(0x7f8010151e90 0x7f80101588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.193+0000 7f801744c640 1 -- 172.21.15.123:0/1831739364 >> 172.21.15.123:0/1831739364 conn(0x7f80100703e0 msgr2=0x7f80100cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:56.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.198+0000 7f801744c640 1 -- 172.21.15.123:0/1831739364 shutdown_connections 2024-09-19T09:47:56.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.200+0000 7f801744c640 1 -- 172.21.15.123:0/1831739364 wait complete. 2024-09-19T09:47:56.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.202+0000 7f801744c640 1 Processor -- start 2024-09-19T09:47:56.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.202+0000 7f801744c640 1 -- start start 2024-09-19T09:47:56.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f801744c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c5950 0x7f801014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f801744c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80100c8f70 0x7f801014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f801744c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010151e90 0x7f8010146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f80149e7640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80100c8f70 msgr2=0x7f801014ac40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:56.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f80149e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80100c8f70 0x7f801014ac40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:56.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f801744c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8010073b60 con 0x7f80100c8f70 2024-09-19T09:47:56.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f801744c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8010073ed0 con 0x7f8010151e90 2024-09-19T09:47:56.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f801744c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8010152270 con 0x7f80100c5950 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f80159e9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010151e90 0x7f8010146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f80159e9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010151e90 0x7f8010146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:47876/0 (socket says 172.21.15.123:47876) 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.204+0000 7f80159e9640 1 -- 172.21.15.123:0/4248722136 learned_addr learned my addr 172.21.15.123:0/4248722136 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.205+0000 7f80151e8640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c5950 0x7f801014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.205+0000 7f80159e9640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c5950 msgr2=0x7f801014c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.205+0000 7f80159e9640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80100c5950 0x7f801014c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.205+0000 7f80159e9640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80100c8f70 msgr2=0x7f801014ac40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.205+0000 7f80159e9640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80100c8f70 0x7f801014ac40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.205+0000 7f80159e9640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8010146ca0 con 0x7f8010151e90 2024-09-19T09:47:56.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.206+0000 7f80159e9640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010151e90 0x7f8010146000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8000009870 tx=0x7f80000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.206+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000041070 con 0x7f8010151e90 2024-09-19T09:47:56.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.206+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800003c930 con 0x7f8010151e90 2024-09-19T09:47:56.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.207+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000037040 con 0x7f8010151e90 2024-09-19T09:47:56.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.208+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8010146f80 con 0x7f8010151e90 2024-09-19T09:47:56.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.209+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80101484a0 con 0x7f8010151e90 2024-09-19T09:47:56.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.211+0000 7f801744c640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 0x7f8010144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.211+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f801006f1c0 con 0x7f80101486e0 2024-09-19T09:47:56.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.211+0000 7f80151e8640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 0x7f8010144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.214+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8000044070 con 0x7f8010151e90 2024-09-19T09:47:56.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.214+0000 7f80151e8640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80100c4550 con 0x7f80101486e0 2024-09-19T09:47:56.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.215+0000 7f8005ffb640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ff406c2b0 0x7f7ff406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.215+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f80000abec0 con 0x7f8010151e90 2024-09-19T09:47:56.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.215+0000 7f80149e7640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ff406c2b0 0x7f7ff406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.215+0000 7f80151e8640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 0x7f8010144bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f800c00d700 tx=0x7f800c00dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.216+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c005a40 con 0x7f80101486e0 2024-09-19T09:47:56.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.216+0000 7f80149e7640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ff406c2b0 0x7f7ff406e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8010145b30 tx=0x7f8008009270 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.216+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f800c005a40 con 0x7f80101486e0 2024-09-19T09:47:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.217+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 msgr2=0x7f8010144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.217+0000 7f8005ffb640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 0x7f8010144bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f800c00d700 tx=0x7f800c00dbc0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.217+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 msgr2=0x7f8010144bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.217+0000 7f8005ffb640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80101486e0 0x7f8010144bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.233+0000 7f801744c640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 0x7f8010145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.233+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8010145670 con 0x7f8010146540 2024-09-19T09:47:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.233+0000 7f80151e8640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 0x7f8010145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.235+0000 7f80151e8640 1 -- 172.21.15.123:0/4248722136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f80100c4090 con 0x7f8010146540 2024-09-19T09:47:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.236+0000 7f80151e8640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 0x7f8010145130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f800c00d700 tx=0x7f800c0059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.236+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c01bdd0 con 0x7f8010146540 2024-09-19T09:47:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.237+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5187 (secure 0 0 0) 0x7f800c005110 con 0x7f8010146540 2024-09-19T09:47:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.237+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 msgr2=0x7f8010145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.237+0000 7f8005ffb640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 0x7f8010145130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f800c00d700 tx=0x7f800c0059d0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.237+0000 7f8005ffb640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 msgr2=0x7f8010145130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.237+0000 7f8005ffb640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010146540 0x7f8010145130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 28, 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 32694, 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:56.240 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 2, 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:56.241 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:56.242 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:56.243 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:56.245 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:56.246 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.247 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.248 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:56.248 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:56.248 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:56.248 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:56.248 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:56.248 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:56.249 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:56.250 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.251 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.252 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.253 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.254 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.255 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:56.256 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.238+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ff406c2b0 msgr2=0x7f7ff406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.238+0000 7f801744c640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ff406c2b0 0x7f7ff406e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8010145b30 tx=0x7f8008009270 comp rx=0 tx=0).stop 2024-09-19T09:47:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.238+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010151e90 msgr2=0x7f8010146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.238+0000 7f801744c640 1 --2- 172.21.15.123:0/4248722136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8010151e90 0x7f8010146000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8000009870 tx=0x7f80000046c0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.239+0000 7f80159e9640 1 -- 172.21.15.123:0/4248722136 reap_dead start 2024-09-19T09:47:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.239+0000 7f80159e9640 1 -- 172.21.15.123:0/4248722136 reap_dead start 2024-09-19T09:47:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.245+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 shutdown_connections 2024-09-19T09:47:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.245+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 >> 172.21.15.123:0/4248722136 conn(0x7f80100703e0 msgr2=0x7f801006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.250+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 shutdown_connections 2024-09-19T09:47:56.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.250+0000 7f801744c640 1 -- 172.21.15.123:0/4248722136 wait complete. 2024-09-19T09:47:56.281 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:47:56.282 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:47:56.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:47:56.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.479+0000 7f23bf2b8640 1 Processor -- start 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.479+0000 7f23bf2b8640 1 -- start start 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bf2b8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f23b8151d00 0x7f23b806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bf2b8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f23b8073da0 0x7f23b8072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bf2b8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b81520e0 0x7f23b80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bf2b8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f23b80c8730 con 0x7f23b8073da0 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bf2b8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f23b806bd90 con 0x7f23b8151d00 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bf2b8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f23b806c070 con 0x7f23b81520e0 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.480+0000 7f23bdab5640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7f23b8073da0 msgr2=0x7f23b8072250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.481+0000 7f23bdab5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f23b8073da0 0x7f23b8072250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.481+0000 7f23be2b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f23b8151d00 0x7f23b806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.481+0000 7f23be2b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f23b8151d00 0x7f23b806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:47904/0 (socket says 172.21.15.123:47904) 2024-09-19T09:47:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.481+0000 7f23be2b6640 1 -- 172.21.15.123:0/1885107197 learned_addr learned my addr 172.21.15.123:0/1885107197 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.482+0000 7f23beab7640 1 --2- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b81520e0 0x7f23b80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.483+0000 7f23be2b6640 1 -- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b81520e0 msgr2=0x7f23b80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:56.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.483+0000 7f23be2b6640 1 --2- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b81520e0 0x7f23b80c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.483+0000 7f23be2b6640 1 -- 172.21.15.123:0/1885107197 >> v2:172.21.15.123:3300/0 conn(0x7f23b8073da0 msgr2=0x7f23b8072250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:47:56.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.483+0000 7f23be2b6640 1 --2- 172.21.15.123:0/1885107197 >> v2:172.21.15.123:3300/0 conn(0x7f23b8073da0 0x7f23b8072250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.483+0000 7f23be2b6640 1 -- 172.21.15.123:0/1885107197 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b806c350 con 0x7f23b8151d00 2024-09-19T09:47:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.492+0000 7f23be2b6640 1 --2- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 0x7f23b806d110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23b80ce910 tx=0x7f23b402c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a69759039a8f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.492+0000 7f23bd2b4640 1 -- 172.21.15.123:0/1885107197 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4036020 con 0x7f23b8151d00 2024-09-19T09:47:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.493+0000 7f23bd2b4640 1 -- 172.21.15.123:0/1885107197 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b402e040 con 0x7f23b8151d00 2024-09-19T09:47:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.493+0000 7f23bd2b4640 1 -- 172.21.15.123:0/1885107197 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4032ac0 con 0x7f23b8151d00 2024-09-19T09:47:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 -- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 msgr2=0x7f23b806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 --2- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 0x7f23b806d110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23b80ce910 tx=0x7f23b402c960 comp rx=0 tx=0).stop 2024-09-19T09:47:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 -- 172.21.15.123:0/1885107197 shutdown_connections 2024-09-19T09:47:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 --2- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b81520e0 0x7f23b80c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 --2- 172.21.15.123:0/1885107197 >> v2:172.21.15.123:3300/0 conn(0x7f23b8073da0 0x7f23b8072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 --2- 172.21.15.123:0/1885107197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 0x7f23b806d110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.494+0000 7f23bf2b8640 1 -- 172.21.15.123:0/1885107197 >> 172.21.15.123:0/1885107197 conn(0x7f23b80ca380 msgr2=0x7f23b80ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:56.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.496+0000 7f23bf2b8640 1 -- 172.21.15.123:0/1885107197 shutdown_connections 2024-09-19T09:47:56.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.496+0000 7f23bf2b8640 1 -- 172.21.15.123:0/1885107197 wait complete. 2024-09-19T09:47:56.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.498+0000 7f23bf2b8640 1 Processor -- start 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.499+0000 7f23bf2b8640 1 -- start start 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.501+0000 7f23bf2b8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 0x7f23b814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.501+0000 7f23bf2b8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b81520e0 0x7f23b8148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.501+0000 7f23bf2b8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 0x7f23b81f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.501+0000 7f23bf2b8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23b80c9f40 con 0x7f23b81520e0 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.501+0000 7f23bf2b8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23b806c910 con 0x7f23b8151d00 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.501+0000 7f23bf2b8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f23b80ca0c0 con 0x7f23b814bfa0 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.502+0000 7f23bdab5640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b81520e0 msgr2=0x7f23b8148c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.502+0000 7f23bdab5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b81520e0 0x7f23b8148c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.502+0000 7f23beab7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 0x7f23b81f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.502+0000 7f23beab7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 0x7f23b81f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36632/0 (socket says 172.21.15.123:36632) 2024-09-19T09:47:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.502+0000 7f23beab7640 1 -- 172.21.15.123:0/3639007700 learned_addr learned my addr 172.21.15.123:0/3639007700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:47:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23beab7640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 msgr2=0x7f23b814d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23beab7640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23b8151d00 0x7f23b814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23beab7640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b81520e0 msgr2=0x7f23b8148c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:47:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23beab7640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b81520e0 0x7f23b8148c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23beab7640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b81f8570 con 0x7f23b814bfa0 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23beab7640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 0x7f23b81f8a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23b000cc30 tx=0x7f23b000a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.503+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b000ce40 con 0x7f23b814bfa0 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.504+0000 7f23bf2b8640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b80c3510 con 0x7f23b814bfa0 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.504+0000 7f23bf2b8640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b80c3a90 con 0x7f23b814bfa0 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.505+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b0003990 con 0x7f23b814bfa0 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.505+0000 7f23acff9640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 0x7f23a0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.505+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f23a0007ec0 con 0x7f23a0002a70 2024-09-19T09:47:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.505+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0003d40 con 0x7f23b814bfa0 2024-09-19T09:47:56.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.505+0000 7f23be2b6640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 0x7f23a0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.506+0000 7f23be2b6640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23a00080c0 con 0x7f23a0002a70 2024-09-19T09:47:56.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.507+0000 7f23be2b6640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 0x7f23a0004f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c4c30 tx=0x7f23b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.507+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4031b90 con 0x7f23a0002a70 2024-09-19T09:47:56.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.508+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f23b400b710 con 0x7f23a0002a70 2024-09-19T09:47:56.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.508+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 msgr2=0x7f23a0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.508+0000 7f23aeffd640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 0x7f23a0004f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c4c30 tx=0x7f23b40046c0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.508+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 msgr2=0x7f23a0004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:56.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.508+0000 7f23aeffd640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0002a70 0x7f23a0004f30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.519+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23b0003ee0 con 0x7f23b814bfa0 2024-09-19T09:47:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.520+0000 7f23aeffd640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f23a406be20 0x7f23a406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.521+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f23b008b960 con 0x7f23b814bfa0 2024-09-19T09:47:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.523+0000 7f23be2b6640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f23a406be20 0x7f23a406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.524+0000 7f23be2b6640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f23a406be20 0x7f23a406e2e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f23b4042000 tx=0x7f23b403e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.526+0000 7f23acff9640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 0x7f23a0007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.526+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f23a000a4a0 con 0x7f23a0006ee0 2024-09-19T09:47:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.527+0000 7f23bdab5640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 0x7f23a0007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.532+0000 7f23bdab5640 1 -- 172.21.15.123:0/3639007700 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23a0007890 con 0x7f23a0006ee0 2024-09-19T09:47:56.551 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:47:56.551 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:56.551 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:56.551 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:47:56.551 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 28, 2024-09-19T09:47:56.551 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 85854, 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 2, 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:56.552 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:56.553 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:47:56.554 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:47:56.555 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:47:56.556 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.557 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.558 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:47:56.559 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:47:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.561 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.562 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:47:56.563 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:47:56.564 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.536+0000 7f23bdab5640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 0x7f23a0007350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c4040 tx=0x7f23a800b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.542+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8003dc0 con 0x7f23a0006ee0 2024-09-19T09:47:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.542+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f23a8005070 con 0x7f23a0006ee0 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.542+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 msgr2=0x7f23a0007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.542+0000 7f23aeffd640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 0x7f23a0007350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c4040 tx=0x7f23a800b830 comp rx=0 tx=0).stop 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.543+0000 7f23aeffd640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 msgr2=0x7f23a0007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.543+0000 7f23aeffd640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23a0006ee0 0x7f23a0007350 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23b80c4040 tx=0x7f23a800b830 comp rx=0 tx=0).stop 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f23a406be20 msgr2=0x7f23a406e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f23a406be20 0x7f23a406e2e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f23b4042000 tx=0x7f23b403e000 comp rx=0 tx=0).stop 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23beab7640 1 -- 172.21.15.123:0/3639007700 reap_dead start 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 msgr2=0x7f23b81f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 0x7f23b81f8a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23b000cc30 tx=0x7f23b000a5c0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 shutdown_connections 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 --2- 172.21.15.123:0/3639007700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23b814bfa0 0x7f23b81f8a20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.548+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 >> 172.21.15.123:0/3639007700 conn(0x7f23b80ca380 msgr2=0x7f23b80ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.553+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 shutdown_connections 2024-09-19T09:47:56.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:47:56.558+0000 7f23acff9640 1 -- 172.21.15.123:0/3639007700 wait complete. 2024-09-19T09:47:56.586 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:47:56.587 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:48:02.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:48:02.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:48:16.587 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-19T09:48:16.588 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-19T09:48:16.588 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T09:48:16.588 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T09:48:16.592 INFO:tasks.ceph.mon.a:Started 2024-09-19T09:48:16.592 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:48:16.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:16.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.801+0000 7f77cf59e640 1 Processor -- start 2024-09-19T09:48:16.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.801+0000 7f77cf59e640 1 -- start start 2024-09-19T09:48:16.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.803+0000 7f77cf59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d015a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:16.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.803+0000 7f77cf59e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d0073fb0 con 0x7f77d00727d0 2024-09-19T09:48:16.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.803+0000 7f77cf59e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00c30b0 con 0x7f77d0151140 2024-09-19T09:48:16.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.803+0000 7f77cf59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f77d00c3350 con 0x7f77d00ca020 2024-09-19T09:48:16.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.803+0000 7f77ced9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f77d00727d0 0x7f77d015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35564/0 (socket says 172.21.15.123:35564) 2024-09-19T09:48:16.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.803+0000 7f77ced9d640 1 -- 172.21.15.123:0/207778786 learned_addr learned my addr 172.21.15.123:0/207778786 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:48:16.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.805+0000 7f77cdd9b640 1 --2- 172.21.15.123:0/207778786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:16.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.806+0000 7f77cdd9b640 1 -- 172.21.15.123:0/207778786 >> v1:172.21.15.194:6789/0 conn(0x7f77d0151140 legacy=0x7f77d00720c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:48:16.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.806+0000 7f77cdd9b640 1 -- 172.21.15.123:0/207778786 >> v1:172.21.15.123:6789/0 conn(0x7f77d00727d0 legacy=0x7f77d015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:16.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.806+0000 7f77cdd9b640 1 -- 172.21.15.123:0/207778786 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d006c7c0 con 0x7f77d00ca020 2024-09-19T09:48:16.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.808+0000 7f77cdd9b640 1 --2- 172.21.15.123:0/207778786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d015a520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c402b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53575e8c4ca49633 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:16.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.808+0000 7f77cd59a640 1 -- 172.21.15.123:0/207778786 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4037070 con 0x7f77d00ca020 2024-09-19T09:48:16.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.808+0000 7f77cd59a640 1 -- 172.21.15.123:0/207778786 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c4030710 con 0x7f77d00ca020 2024-09-19T09:48:16.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.809+0000 7f77cf59e640 1 -- 172.21.15.123:0/207778786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 msgr2=0x7f77d015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:16.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.809+0000 7f77cf59e640 1 --2- 172.21.15.123:0/207778786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d015a520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c402b460 comp rx=0 tx=0).stop 2024-09-19T09:48:16.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.809+0000 7f77cf59e640 1 -- 172.21.15.123:0/207778786 shutdown_connections 2024-09-19T09:48:16.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.809+0000 7f77cf59e640 1 --2- 172.21.15.123:0/207778786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d015a520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:16.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.809+0000 7f77cf59e640 1 -- 172.21.15.123:0/207778786 >> 172.21.15.123:0/207778786 conn(0x7f77d00c9370 msgr2=0x7f77d00c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:16.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.810+0000 7f77cf59e640 1 -- 172.21.15.123:0/207778786 shutdown_connections 2024-09-19T09:48:16.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.810+0000 7f77cf59e640 1 -- 172.21.15.123:0/207778786 wait complete. 2024-09-19T09:48:16.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.812+0000 7f77cf59e640 1 Processor -- start 2024-09-19T09:48:16.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.813+0000 7f77cf59e640 1 -- start start 2024-09-19T09:48:16.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77cf59e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d00727d0 0x7f77d0144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:16.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77cf59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d01f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:16.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77cf59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:16.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77cf59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f77d01516a0 con 0x7f77d0151140 2024-09-19T09:48:16.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77cf59e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0151520 con 0x7f77d00727d0 2024-09-19T09:48:16.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77cf59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f77d015b170 con 0x7f77d00ca020 2024-09-19T09:48:16.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77ced9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:16.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77ced9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55944/0 (socket says 172.21.15.123:55944) 2024-09-19T09:48:16.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.814+0000 7f77ced9d640 1 -- 172.21.15.123:0/4214110999 learned_addr learned my addr 172.21.15.123:0/4214110999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:16.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.815+0000 7f77cdd9b640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d01f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:16.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.815+0000 7f77ce59c640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d00727d0 0x7f77d0144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:16.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ced9d640 1 -- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 msgr2=0x7f77d01f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-19T09:48:16.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ced9d640 1 -- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 msgr2=0x7f77d01f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:48:16.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ced9d640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:16.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ced9d640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:16.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ce59c640 1 -- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 msgr2=0x7f77d01f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:16.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ce59c640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d01f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:16.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ce59c640 1 -- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 msgr2=0x7f77d01f5bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:16.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ce59c640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:16.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.816+0000 7f77ce59c640 1 -- 172.21.15.123:0/4214110999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d0146f00 con 0x7f77d00727d0 2024-09-19T09:48:16.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.818+0000 7f77ce59c640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d00727d0 0x7f77d0144be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77c800be20 tx=0x7f77c8009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:16.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.819+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8019070 con 0x7f77d00727d0 2024-09-19T09:48:16.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.819+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c8014440 con 0x7f77d00727d0 2024-09-19T09:48:16.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.819+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8014830 con 0x7f77d00727d0 2024-09-19T09:48:16.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.819+0000 7f77cf59e640 1 -- 172.21.15.123:0/4214110999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d0146c60 con 0x7f77d00727d0 2024-09-19T09:48:16.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.819+0000 7f77cf59e640 1 -- 172.21.15.123:0/4214110999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d00c2950 con 0x7f77d00727d0 2024-09-19T09:48:16.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.822+0000 7f77cf59e640 1 -- 172.21.15.123:0/4214110999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b4005290 con 0x7f77d00727d0 2024-09-19T09:48:16.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.824+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f77c801c360 con 0x7f77d00727d0 2024-09-19T09:48:16.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.824+0000 7f77beffd640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f77b006c3b0 0x7f77b006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:16.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.825+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f77c808b330 con 0x7f77d00727d0 2024-09-19T09:48:16.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.825+0000 7f77cdd9b640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f77b006c3b0 0x7f77b006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.826+0000 7f77cdd9b640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f77b006c3b0 0x7f77b006e870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77c4034000 tx=0x7f77c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:16.834+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f77d0146f00 con 0x7f77d00727d0 2024-09-19T09:48:17.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.341+0000 7f77cf59e640 1 -- 172.21.15.123:0/4214110999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f77b4005580 con 0x7f77d00727d0 2024-09-19T09:48:17.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.342+0000 7f77beffd640 1 -- 172.21.15.123:0/4214110999 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f77c8059a00 con 0x7f77d00727d0 2024-09-19T09:48:17.344 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":28,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:17.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.349+0000 7f77bcff9640 1 -- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f77b006c3b0 msgr2=0x7f77b006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:17.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.349+0000 7f77bcff9640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f77b006c3b0 0x7f77b006e870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77c4034000 tx=0x7f77c4008030 comp rx=0 tx=0).stop 2024-09-19T09:48:17.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.349+0000 7f77bcff9640 1 -- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d00727d0 msgr2=0x7f77d0144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:17.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.349+0000 7f77bcff9640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d00727d0 0x7f77d0144be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77c800be20 tx=0x7f77c8009f70 comp rx=0 tx=0).stop 2024-09-19T09:48:17.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.349+0000 7f77bcff9640 1 -- 172.21.15.123:0/4214110999 shutdown_connections 2024-09-19T09:48:17.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.349+0000 7f77bcff9640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d0151140 0x7f77d01f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:17.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.350+0000 7f77bcff9640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f77b006c3b0 0x7f77b006e870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:17.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.350+0000 7f77bcff9640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77d00ca020 0x7f77d01f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:17.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.350+0000 7f77bcff9640 1 --2- 172.21.15.123:0/4214110999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77d00727d0 0x7f77d0144be0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:17.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.350+0000 7f77bcff9640 1 -- 172.21.15.123:0/4214110999 >> 172.21.15.123:0/4214110999 conn(0x7f77d00c9370 msgr2=0x7f77d00cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:17.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.350+0000 7f77bcff9640 1 -- 172.21.15.123:0/4214110999 shutdown_connections 2024-09-19T09:48:17.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:17.350+0000 7f77bcff9640 1 -- 172.21.15.123:0/4214110999 wait complete. 2024-09-19T09:48:20.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.595+0000 7fa5a25d3640 1 Processor -- start 2024-09-19T09:48:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.595+0000 7fa5a25d3640 1 -- start start 2024-09-19T09:48:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.597+0000 7fa5a25d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59c0c78d0 0x7fa59c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.597+0000 7fa5a25d3640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0c8110 con 0x7fa59c151230 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.597+0000 7fa5a25d3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0c83f0 con 0x7fa59c0ca400 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.597+0000 7fa5a25d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c06ccd0 con 0x7fa59c0c78d0 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.598+0000 7fa5a1dd2640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa59c0ca400 0x7fa59c06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:34222/0 (socket says 172.21.15.123:34222) 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.598+0000 7fa5a1dd2640 1 -- 172.21.15.123:0/2925891349 learned_addr learned my addr 172.21.15.123:0/2925891349 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.598+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432487748 0 0) 0x7fa59c0c83f0 con 0x7fa59c0ca400 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.598+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa588003520 con 0x7fa59c0ca400 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.598+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836475378 0 0) 0x7fa59c0c8110 con 0x7fa59c151230 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.598+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa59c0c83f0 con 0x7fa59c151230 2024-09-19T09:48:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 698810551 0 0) 0x7fa588003520 con 0x7fa59c0ca400 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59c0c78d0 msgr2=0x7fa59c0c9ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59c0c78d0 0x7fa59c0c9ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 >> v1:172.21.15.123:6789/0 conn(0x7fa59c151230 legacy=0x7fa59c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c06cfb0 con 0x7fa59c0ca400 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fa5940019f0 con 0x7fa59c0ca400 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 >> v1:172.21.15.194:6789/0 conn(0x7fa59c0ca400 legacy=0x7fa59c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa588004ba0 0x7fa588004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5880037a0 0x7fa588003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880041b0 0x7fa58800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c06ccd0 con 0x7fa5880041b0 2024-09-19T09:48:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa58800c060 con 0x7fa5880037a0 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa58800c260 con 0x7fa588004ba0 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.599+0000 7fa5a1dd2640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880041b0 0x7fa58800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.600+0000 7fa5a1dd2640 1 -- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa588004ba0 msgr2=0x7fa588004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.600+0000 7fa5a1dd2640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa588004ba0 0x7fa588004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.600+0000 7fa5a1dd2640 1 -- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5880037a0 msgr2=0x7fa588003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.600+0000 7fa5a1dd2640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5880037a0 0x7fa588003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.600+0000 7fa5a1dd2640 1 -- 172.21.15.123:0/2925891349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa588003520 con 0x7fa5880041b0 2024-09-19T09:48:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.602+0000 7fa5a1dd2640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880041b0 0x7fa58800b9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa59402c8a0 tx=0x7fa588005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ac6eb1d47dd1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.606+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59402c4f0 con 0x7fa5880041b0 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.606+0000 7fa593fff640 1 -- 172.21.15.123:0/2925891349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa594051070 con 0x7fa5880041b0 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.607+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2925891349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880041b0 msgr2=0x7fa58800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.607+0000 7fa5a25d3640 1 --2- 172.21.15.123:0/2925891349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5880041b0 0x7fa58800b9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa59402c8a0 tx=0x7fa588005830 comp rx=0 tx=0).stop 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.607+0000 7fa5a1dd2640 1 -- 172.21.15.123:0/2925891349 reap_dead start 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.607+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2925891349 shutdown_connections 2024-09-19T09:48:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.607+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2925891349 >> 172.21.15.123:0/2925891349 conn(0x7fa59c06d600 msgr2=0x7fa59c06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.608+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2925891349 shutdown_connections 2024-09-19T09:48:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.608+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2925891349 wait complete. 2024-09-19T09:48:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.610+0000 7fa5a25d3640 1 Processor -- start 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.610+0000 7fa5a25d3640 1 -- start start 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.611+0000 7fa5a25d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5880041b0 0x7fa59c073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.611+0000 7fa5a25d3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 0x7fa59c0c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 0x7fa59c0c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 0x7fa59c0c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55958/0 (socket says 172.21.15.123:55958) 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 -- 172.21.15.123:0/2956211726 learned_addr learned my addr 172.21.15.123:0/2956211726 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a25d3640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa59c154320 0x7fa59c13aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c151790 con 0x7fa59c073a80 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c151610 con 0x7fa59c154320 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c06f8d0 con 0x7fa5880041b0 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 -- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5880041b0 msgr2=0x7fa59c073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5880041b0 0x7fa59c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:20.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 -- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa59c154320 msgr2=0x7fa59c13aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:20.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.612+0000 7fa5a0dd0640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa59c154320 0x7fa59c13aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:20.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.613+0000 7fa5a0dd0640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c0c6bb0 con 0x7fa59c073a80 2024-09-19T09:48:20.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.613+0000 7fa5a0dd0640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 0x7fa59c0c42b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009fa0 tx=0x7fa58c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:20.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.614+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c01d070 con 0x7fa59c073a80 2024-09-19T09:48:20.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.614+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c00f960 con 0x7fa59c073a80 2024-09-19T09:48:20.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.614+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00fd50 con 0x7fa59c073a80 2024-09-19T09:48:20.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.614+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c0c6e90 con 0x7fa59c073a80 2024-09-19T09:48:20.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.615+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c0c5eb0 con 0x7fa59c073a80 2024-09-19T09:48:20.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.618+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa58c020070 con 0x7fa59c073a80 2024-09-19T09:48:20.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.618+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c0c9ec0 con 0x7fa59c073a80 2024-09-19T09:48:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.630+0000 7fa591ffb640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa58006c3b0 0x7fa58006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.631+0000 7fa5a15d1640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa58006c3b0 0x7fa58006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.631+0000 7fa5a15d1640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa58006c3b0 0x7fa58006e870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa598000f60 tx=0x7fa5980079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.632+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa58c08f060 con 0x7fa59c073a80 2024-09-19T09:48:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:20.632+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa58c08a460 con 0x7fa59c073a80 2024-09-19T09:48:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.147+0000 7fa5a25d3640 1 -- 172.21.15.123:0/2956211726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa59c14d5f0 con 0x7fa59c073a80 2024-09-19T09:48:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.147+0000 7fa591ffb640 1 -- 172.21.15.123:0/2956211726 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fa58c058b00 con 0x7fa59c073a80 2024-09-19T09:48:21.149 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.160+0000 7fa57f7fe640 1 -- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa58006c3b0 msgr2=0x7fa58006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.160+0000 7fa57f7fe640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa58006c3b0 0x7fa58006e870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa598000f60 tx=0x7fa5980079b0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.161+0000 7fa57f7fe640 1 -- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 msgr2=0x7fa59c0c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.161+0000 7fa57f7fe640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 0x7fa59c0c42b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009fa0 tx=0x7fa58c00c960 comp rx=0 tx=0).stop 2024-09-19T09:48:21.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 -- 172.21.15.123:0/2956211726 shutdown_connections 2024-09-19T09:48:21.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa59c154320 0x7fa59c13aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59c073a80 0x7fa59c0c42b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa58006c3b0 0x7fa58006e870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 --2- 172.21.15.123:0/2956211726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5880041b0 0x7fa59c073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 -- 172.21.15.123:0/2956211726 >> 172.21.15.123:0/2956211726 conn(0x7fa59c06d600 msgr2=0x7fa59c14e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 -- 172.21.15.123:0/2956211726 shutdown_connections 2024-09-19T09:48:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.163+0000 7fa57f7fe640 1 -- 172.21.15.123:0/2956211726 wait complete. 2024-09-19T09:48:21.193 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:48:21.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:48:21.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:48:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.559+0000 7f610998f640 1 Processor -- start 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.561+0000 7f610998f640 1 -- start start 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.562+0000 7f610998f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f610406cd10 0x7f61040c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.562+0000 7f610998f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61040c80c0 0x7f61040c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.562+0000 7f610998f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6104157860 con 0x7f6104151160 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.562+0000 7f610998f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6104157b20 con 0x7f610406cd10 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.562+0000 7f610998f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f6104157e00 con 0x7f61040c80c0 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.563+0000 7f610898d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f6104151160 0x7f6104156f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:34226/0 (socket says 172.21.15.123:34226) 2024-09-19T09:48:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.563+0000 7f610898d640 1 -- 172.21.15.123:0/1951698109 learned_addr learned my addr 172.21.15.123:0/1951698109 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:48:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.563+0000 7f6103fff640 1 --2- 172.21.15.123:0/1951698109 >> v2:172.21.15.123:3300/0 conn(0x7f610406cd10 0x7f61040c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.563+0000 7f610918e640 1 --2- 172.21.15.123:0/1951698109 >> v2:172.21.15.194:3300/0 conn(0x7f61040c80c0 0x7f61040c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.564+0000 7f6103fff640 1 -- 172.21.15.123:0/1951698109 >> v2:172.21.15.194:3300/0 conn(0x7f61040c80c0 msgr2=0x7f61040c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.564+0000 7f6103fff640 1 --2- 172.21.15.123:0/1951698109 >> v2:172.21.15.194:3300/0 conn(0x7f61040c80c0 0x7f61040c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.564+0000 7f6103fff640 1 -- 172.21.15.123:0/1951698109 >> v1:172.21.15.194:6789/0 conn(0x7f6104151160 legacy=0x7f6104156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.564+0000 7f6103fff640 1 -- 172.21.15.123:0/1951698109 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61040c70a0 con 0x7f610406cd10 2024-09-19T09:48:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.565+0000 7f6103fff640 1 --2- 172.21.15.123:0/1951698109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f610406cd10 0x7f61040c7b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f61040c9e30 tx=0x7f60fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f239110538413ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.566+0000 7f61037fe640 1 -- 172.21.15.123:0/1951698109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc007740 con 0x7f610406cd10 2024-09-19T09:48:21.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.566+0000 7f61037fe640 1 -- 172.21.15.123:0/1951698109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc0078e0 con 0x7f610406cd10 2024-09-19T09:48:21.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.567+0000 7f610998f640 1 -- 172.21.15.123:0/1951698109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f610406cd10 msgr2=0x7f61040c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.567+0000 7f610998f640 1 --2- 172.21.15.123:0/1951698109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f610406cd10 0x7f61040c7b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f61040c9e30 tx=0x7f60fc02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.574+0000 7f610998f640 1 -- 172.21.15.123:0/1951698109 shutdown_connections 2024-09-19T09:48:21.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.574+0000 7f610998f640 1 --2- 172.21.15.123:0/1951698109 >> v2:172.21.15.194:3300/0 conn(0x7f61040c80c0 0x7f61040c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.574+0000 7f610998f640 1 --2- 172.21.15.123:0/1951698109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f610406cd10 0x7f61040c7b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.574+0000 7f610998f640 1 -- 172.21.15.123:0/1951698109 >> 172.21.15.123:0/1951698109 conn(0x7f61040c9100 msgr2=0x7f61040c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:21.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.577+0000 7f610998f640 1 -- 172.21.15.123:0/1951698109 shutdown_connections 2024-09-19T09:48:21.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.580+0000 7f610998f640 1 -- 172.21.15.123:0/1951698109 wait complete. 2024-09-19T09:48:21.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.582+0000 7f610998f640 1 Processor -- start 2024-09-19T09:48:21.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.585+0000 7f610998f640 1 -- start start 2024-09-19T09:48:21.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.588+0000 7f610998f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610406cd10 0x7f6104154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.589+0000 7f610898d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610406cd10 0x7f6104154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.589+0000 7f610898d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610406cd10 0x7f6104154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53174/0 (socket says 172.21.15.123:53174) 2024-09-19T09:48:21.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.589+0000 7f610898d640 1 -- 172.21.15.123:0/406185425 learned_addr learned my addr 172.21.15.123:0/406185425 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:21.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.590+0000 7f610998f640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61040c80c0 0x7f6104152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.591+0000 7f610998f640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6104151160 0x7f6104153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.591+0000 7f6103fff640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61040c80c0 0x7f6104152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.592+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f61040c4000 con 0x7f61040c80c0 2024-09-19T09:48:21.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.592+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f61040c7660 con 0x7f6104151160 2024-09-19T09:48:21.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.592+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f61040c4180 con 0x7f610406cd10 2024-09-19T09:48:21.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.595+0000 7f6103fff640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610406cd10 msgr2=0x7f6104154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.595+0000 7f6103fff640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610406cd10 0x7f6104154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.595+0000 7f6103fff640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6104151160 msgr2=0x7f6104153360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:48:21.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.595+0000 7f6103fff640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6104151160 0x7f6104153360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.595+0000 7f6103fff640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61041efb20 con 0x7f61040c80c0 2024-09-19T09:48:21.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.595+0000 7f6103fff640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61040c80c0 0x7f6104152e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60fc031000 tx=0x7f60fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.597+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc040070 con 0x7f61040c80c0 2024-09-19T09:48:21.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.598+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61041eecc0 con 0x7f61040c80c0 2024-09-19T09:48:21.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.598+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61041ef280 con 0x7f61040c80c0 2024-09-19T09:48:21.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.598+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc045660 con 0x7f61040c80c0 2024-09-19T09:48:21.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.598+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc045a30 con 0x7f61040c80c0 2024-09-19T09:48:21.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.601+0000 7f610998f640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 0x7f60e4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.601+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f60e4007ec0 con 0x7f60e4002a70 2024-09-19T09:48:21.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.603+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f60fc039040 con 0x7f61040c80c0 2024-09-19T09:48:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.604+0000 7f61017fa640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f60f006c380 0x7f60f006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.604+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f60fc0ad230 con 0x7f61040c80c0 2024-09-19T09:48:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.605+0000 7f610898d640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 0x7f60e4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.606+0000 7f610898d640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60e40080c0 con 0x7f60e4002a70 2024-09-19T09:48:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.606+0000 7f610898d640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 0x7f60e4004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006110 tx=0x7f60f4010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.606+0000 7f610918e640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f60f006c380 0x7f60f006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.607+0000 7f610918e640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f60f006c380 0x7f60f006e840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f60f8006b10 tx=0x7f60f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.608+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4011920 con 0x7f60e4002a70 2024-09-19T09:48:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.608+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f60f4015070 con 0x7f60e4002a70 2024-09-19T09:48:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.608+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 msgr2=0x7f60e4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.608+0000 7f61017fa640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 0x7f60e4004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006110 tx=0x7f60f4010a40 comp rx=0 tx=0).stop 2024-09-19T09:48:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.608+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 msgr2=0x7f60e4004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.608+0000 7f61017fa640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4002a70 0x7f60e4004f30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.627+0000 7f610998f640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 0x7f60e40073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.628+0000 7f610898d640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 0x7f60e40073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.628+0000 7f610998f640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f60e400a4a0 con 0x7f60e4006f30 2024-09-19T09:48:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.628+0000 7f610898d640 1 -- 172.21.15.123:0/406185425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f60e4007900 con 0x7f60e4006f30 2024-09-19T09:48:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.629+0000 7f610898d640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 0x7f60e40073c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006110 tx=0x7f60f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 32, 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 4849, 2024-09-19T09:48:21.633 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 3, 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:21.634 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:21.635 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:21.636 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:21.637 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.638 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:21.639 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:21.640 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.641 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:21.642 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:21.643 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.644 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.645 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:48:21.645 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.645 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.645 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.645 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:21.645 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.630+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4020250 con 0x7f60e4006f30 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.630+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f60f4009040 con 0x7f60e4006f30 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.630+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 msgr2=0x7f60e40073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.631+0000 7f61017fa640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 0x7f60e40073c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006110 tx=0x7f60f40057f0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.631+0000 7f61017fa640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 msgr2=0x7f60e40073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.631+0000 7f61017fa640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e4006f30 0x7f60e40073c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f60f006c380 msgr2=0x7f60f006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f60f006c380 0x7f60f006e840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f60f8006b10 tx=0x7f60f8008040 comp rx=0 tx=0).stop 2024-09-19T09:48:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f610918e640 1 -- 172.21.15.123:0/406185425 reap_dead start 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 -- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61040c80c0 msgr2=0x7f6104152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61040c80c0 0x7f6104152e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60fc031000 tx=0x7f60fc004a40 comp rx=0 tx=0).stop 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 -- 172.21.15.123:0/406185425 shutdown_connections 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 --2- 172.21.15.123:0/406185425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61040c80c0 0x7f6104152e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.632+0000 7f60eaffd640 1 -- 172.21.15.123:0/406185425 >> 172.21.15.123:0/406185425 conn(0x7f61040c9100 msgr2=0x7f61040cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.638+0000 7f60eaffd640 1 -- 172.21.15.123:0/406185425 shutdown_connections 2024-09-19T09:48:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.638+0000 7f60eaffd640 1 -- 172.21.15.123:0/406185425 wait complete. 2024-09-19T09:48:21.661 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:48:21.661 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:48:21.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:48:21.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.879+0000 7fed1b59e640 1 Processor -- start 2024-09-19T09:48:21.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.882+0000 7fed1b59e640 1 -- start start 2024-09-19T09:48:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.883+0000 7fed1b59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.883+0000 7fed1b59e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fed1c155360 0x7fed1c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.883+0000 7fed1b59e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed1c06d0a0 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.883+0000 7fed1b59e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fed1c15bdc0 con 0x7fed1c155360 2024-09-19T09:48:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.883+0000 7fed1a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.884+0000 7fed1a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53188/0 (socket says 172.21.15.123:53188) 2024-09-19T09:48:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.884+0000 7fed1a59c640 1 -- 172.21.15.123:0/286781028 learned_addr learned my addr 172.21.15.123:0/286781028 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.884+0000 7fed1b59e640 1 -- 172.21.15.123:0/286781028 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c0c7110 con 0x7fed1c154f80 2024-09-19T09:48:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.884+0000 7fed1ad9d640 1 --2- 172.21.15.123:0/286781028 >> v2:172.21.15.194:3300/0 conn(0x7fed1c155360 0x7fed1c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.886+0000 7fed1a59c640 1 -- 172.21.15.123:0/286781028 >> v2:172.21.15.194:3300/0 conn(0x7fed1c155360 msgr2=0x7fed1c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.886+0000 7fed1a59c640 1 --2- 172.21.15.123:0/286781028 >> v2:172.21.15.194:3300/0 conn(0x7fed1c155360 0x7fed1c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.886+0000 7fed1a59c640 1 -- 172.21.15.123:0/286781028 >> v1:172.21.15.194:6789/0 conn(0x7fed1c0c8cf0 legacy=0x7fed1c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.886+0000 7fed1a59c640 1 -- 172.21.15.123:0/286781028 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c0c73f0 con 0x7fed1c154f80 2024-09-19T09:48:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.888+0000 7fed1a59c640 1 --2- 172.21.15.123:0/286781028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c15b880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed14009e50 tx=0x7fed1402a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f74befa55c56d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.888+0000 7fed1959a640 1 -- 172.21.15.123:0/286781028 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14036070 con 0x7fed1c154f80 2024-09-19T09:48:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.888+0000 7fed1959a640 1 -- 172.21.15.123:0/286781028 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed14031600 con 0x7fed1c154f80 2024-09-19T09:48:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.888+0000 7fed1959a640 1 -- 172.21.15.123:0/286781028 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed140319d0 con 0x7fed1c154f80 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.889+0000 7fed1b59e640 1 -- 172.21.15.123:0/286781028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 msgr2=0x7fed1c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.889+0000 7fed1b59e640 1 --2- 172.21.15.123:0/286781028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c15b880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed14009e50 tx=0x7fed1402a7a0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.890+0000 7fed1b59e640 1 -- 172.21.15.123:0/286781028 shutdown_connections 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.890+0000 7fed1b59e640 1 --2- 172.21.15.123:0/286781028 >> v2:172.21.15.194:3300/0 conn(0x7fed1c155360 0x7fed1c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.890+0000 7fed1b59e640 1 --2- 172.21.15.123:0/286781028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c15b880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.890+0000 7fed1b59e640 1 -- 172.21.15.123:0/286781028 >> 172.21.15.123:0/286781028 conn(0x7fed1c0c9100 msgr2=0x7fed1c0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.891+0000 7fed1b59e640 1 -- 172.21.15.123:0/286781028 shutdown_connections 2024-09-19T09:48:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.891+0000 7fed1b59e640 1 -- 172.21.15.123:0/286781028 wait complete. 2024-09-19T09:48:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.894+0000 7fed1b59e640 1 Processor -- start 2024-09-19T09:48:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.894+0000 7fed1b59e640 1 -- start start 2024-09-19T09:48:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.896+0000 7fed1b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 0x7fed1c06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.896+0000 7fed1b59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c1f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.896+0000 7fed1a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 0x7fed1c06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.896+0000 7fed1a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 0x7fed1c06e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56004/0 (socket says 172.21.15.123:56004) 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.896+0000 7fed1a59c640 1 -- 172.21.15.123:0/1133293511 learned_addr learned my addr 172.21.15.123:0/1133293511 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.896+0000 7fed1b59e640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed1c155360 0x7fed1c1f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c0c7c90 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c0c79b0 con 0x7fed1c155360 2024-09-19T09:48:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c159480 con 0x7fed1c154f80 2024-09-19T09:48:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed19d9b640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c1f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1a59c640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 msgr2=0x7fed1c1f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1a59c640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed1c154f80 0x7fed1c1f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1a59c640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed1c155360 msgr2=0x7fed1c1f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.897+0000 7fed1a59c640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed1c155360 0x7fed1c1f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.898+0000 7fed1a59c640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c071150 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.898+0000 7fed1a59c640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 0x7fed1c06e6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed14009e50 tx=0x7fed14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.899+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14036050 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.899+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed14042070 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.899+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c0713f0 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.899+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c071990 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.899+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14009510 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.902+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed14047460 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.904+0000 7fed1b59e640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 0x7fed00004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.904+0000 7fed0affd640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fecfc06c380 0x7fecfc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.904+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fed140ac480 con 0x7fed1c0c8cf0 2024-09-19T09:48:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.904+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fed00007ec0 con 0x7fed00002a70 2024-09-19T09:48:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.905+0000 7fed19d9b640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 0x7fed00004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.905+0000 7fed19d9b640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed000080c0 con 0x7fed00002a70 2024-09-19T09:48:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.906+0000 7fed1ad9d640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fecfc06c380 0x7fecfc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.906+0000 7fed1ad9d640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fecfc06c380 0x7fecfc06e840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed10006a90 tx=0x7fed10006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.907+0000 7fed19d9b640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 0x7fed00004f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed1c158b20 tx=0x7fed0c00f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.908+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c019070 con 0x7fed00002a70 2024-09-19T09:48:21.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.909+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fed0c005320 con 0x7fed00002a70 2024-09-19T09:48:21.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.909+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 msgr2=0x7fed00004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.909+0000 7fed0affd640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 0x7fed00004f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed1c158b20 tx=0x7fed0c00f9d0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.909+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 msgr2=0x7fed00004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:21.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.909+0000 7fed0affd640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00002a70 0x7fed00004f30 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed1c158b20 tx=0x7fed0c00f9d0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.926+0000 7fed1b59e640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 0x7fed00007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:21.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.926+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fed0000a4a0 con 0x7fed00006f00 2024-09-19T09:48:21.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.928+0000 7fed19d9b640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 0x7fed00007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.931+0000 7fed19d9b640 1 -- 172.21.15.123:0/1133293511 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fed000078d0 con 0x7fed00006f00 2024-09-19T09:48:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.931+0000 7fed19d9b640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 0x7fed00007390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0c8770 tx=0x7fed0c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.933+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c019070 con 0x7fed00006f00 2024-09-19T09:48:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.933+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5196 (secure 0 0 0) 0x7fed0c01b2d0 con 0x7fed00006f00 2024-09-19T09:48:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.933+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 msgr2=0x7fed00007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.933+0000 7fed0affd640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 0x7fed00007390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0c8770 tx=0x7fed0c000ed0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.933+0000 7fed0affd640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 msgr2=0x7fed00007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.933+0000 7fed0affd640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed00006f00 0x7fed00007390 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0c8770 tx=0x7fed0c000ed0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.937 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:21.937 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:21.937 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:21.937 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:48:21.937 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 32, 2024-09-19T09:48:21.937 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 58390, 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 3, 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:21.938 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.939 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:21.940 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:21.941 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:21.942 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.943 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.944 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:21.945 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:21.947 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:21.948 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:21.949 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:21.950 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.951 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.952 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:21.953 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:21.954 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:21.954 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.935+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fecfc06c380 msgr2=0x7fecfc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.936+0000 7fed1b59e640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fecfc06c380 0x7fecfc06e840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed10006a90 tx=0x7fed10006a20 comp rx=0 tx=0).stop 2024-09-19T09:48:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.936+0000 7fed1ad9d640 1 -- 172.21.15.123:0/1133293511 reap_dead start 2024-09-19T09:48:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.936+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 msgr2=0x7fed1c06e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.936+0000 7fed1b59e640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 0x7fed1c06e6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed14009e50 tx=0x7fed14004a40 comp rx=0 tx=0).stop 2024-09-19T09:48:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.936+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 shutdown_connections 2024-09-19T09:48:21.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.937+0000 7fed1b59e640 1 --2- 172.21.15.123:0/1133293511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed1c0c8cf0 0x7fed1c06e6d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:21.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.937+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 >> 172.21.15.123:0/1133293511 conn(0x7fed1c0c9100 msgr2=0x7fed1c154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:21.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.938+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 shutdown_connections 2024-09-19T09:48:21.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:21.940+0000 7fed1b59e640 1 -- 172.21.15.123:0/1133293511 wait complete. 2024-09-19T09:48:21.966 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:48:21.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:48:21.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:48:22.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.172+0000 7fc96759e640 1 Processor -- start 2024-09-19T09:48:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.174+0000 7fc96759e640 1 -- start start 2024-09-19T09:48:22.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.175+0000 7fc96759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc968068f50 0x7fc9681511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.175+0000 7fc96759e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc9680b2e90 0x7fc96815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.175+0000 7fc96759e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc968157df0 con 0x7fc9680c8780 2024-09-19T09:48:22.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.175+0000 7fc96759e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc9680c8370 con 0x7fc9680b2e90 2024-09-19T09:48:22.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.175+0000 7fc96759e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc9680c7aa0 con 0x7fc968068f50 2024-09-19T09:48:22.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc966d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc9680b2e90 0x7fc96815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc966d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc9680b2e90 0x7fc96815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:53928/0 (socket says 172.21.15.123:53928) 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc966d9d640 1 -- 172.21.15.123:0/2909672226 learned_addr learned my addr 172.21.15.123:0/2909672226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc96659c640 1 --2- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc968068f50 0x7fc9681511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc966d9d640 1 -- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc968068f50 msgr2=0x7fc9681511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc966d9d640 1 --2- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc968068f50 0x7fc9681511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.176+0000 7fc966d9d640 1 -- 172.21.15.123:0/2909672226 >> v1:172.21.15.123:6789/0 conn(0x7fc9680c8780 legacy=0x7fc96806bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.177+0000 7fc966d9d640 1 -- 172.21.15.123:0/2909672226 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680c7d80 con 0x7fc9680b2e90 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.178+0000 7fc966d9d640 1 --2- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc96815a8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc95802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf491937d30c574d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.180+0000 7fc96559a640 1 -- 172.21.15.123:0/2909672226 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958037070 con 0x7fc9680b2e90 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.180+0000 7fc96559a640 1 -- 172.21.15.123:0/2909672226 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc958032440 con 0x7fc9680b2e90 2024-09-19T09:48:22.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.180+0000 7fc96559a640 1 -- 172.21.15.123:0/2909672226 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9580327f0 con 0x7fc9680b2e90 2024-09-19T09:48:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.181+0000 7fc96759e640 1 -- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 msgr2=0x7fc96815a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.181+0000 7fc96759e640 1 --2- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc96815a8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc95802a230 comp rx=0 tx=0).stop 2024-09-19T09:48:22.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.198+0000 7fc96759e640 1 -- 172.21.15.123:0/2909672226 shutdown_connections 2024-09-19T09:48:22.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.198+0000 7fc96759e640 1 --2- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc96815a8a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.198+0000 7fc96759e640 1 --2- 172.21.15.123:0/2909672226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc968068f50 0x7fc9681511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.198+0000 7fc96759e640 1 -- 172.21.15.123:0/2909672226 >> 172.21.15.123:0/2909672226 conn(0x7fc9680ccb90 msgr2=0x7fc9680ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:22.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.198+0000 7fc96759e640 1 -- 172.21.15.123:0/2909672226 shutdown_connections 2024-09-19T09:48:22.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.198+0000 7fc96759e640 1 -- 172.21.15.123:0/2909672226 wait complete. 2024-09-19T09:48:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.201+0000 7fc96759e640 1 Processor -- start 2024-09-19T09:48:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.201+0000 7fc96759e640 1 -- start start 2024-09-19T09:48:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc96759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc968068f50 0x7fc968143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc96759e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc9680c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc96759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c8780 0x7fc9680c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc96759e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680c23c0 con 0x7fc968068f50 2024-09-19T09:48:22.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc96759e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680c2240 con 0x7fc9680b2e90 2024-09-19T09:48:22.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc96759e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc9680c2540 con 0x7fc9680c8780 2024-09-19T09:48:22.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc965d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc9680c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc965d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc9680c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:53940/0 (socket says 172.21.15.123:53940) 2024-09-19T09:48:22.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc965d9b640 1 -- 172.21.15.123:0/189043650 learned_addr learned my addr 172.21.15.123:0/189043650 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:22.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.202+0000 7fc966d9d640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c8780 0x7fc9680c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.203+0000 7fc965d9b640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c8780 msgr2=0x7fc9680c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.203+0000 7fc965d9b640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c8780 0x7fc9680c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.203+0000 7fc965d9b640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc968068f50 msgr2=0x7fc968143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.203+0000 7fc965d9b640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc968068f50 0x7fc968143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.203+0000 7fc965d9b640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680cb520 con 0x7fc9680b2e90 2024-09-19T09:48:22.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.206+0000 7fc965d9b640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc9680c49a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc96000ba50 tx=0x7fc96000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.206+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960019070 con 0x7fc9680b2e90 2024-09-19T09:48:22.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.206+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96000cc20 con 0x7fc9680b2e90 2024-09-19T09:48:22.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.206+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960014440 con 0x7fc9680b2e90 2024-09-19T09:48:22.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.206+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc968154c80 con 0x7fc9680b2e90 2024-09-19T09:48:22.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.207+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc968155240 con 0x7fc9680b2e90 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.209+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc9600145e0 con 0x7fc9680b2e90 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.210+0000 7fc956ffd640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc94806c2e0 0x7fc94806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.210+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc96008b230 con 0x7fc9680b2e90 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.211+0000 7fc96759e640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 0x7fc9681f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.211+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc968156df0 con 0x7fc9680c5ff0 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.211+0000 7fc96659c640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc94806c2e0 0x7fc94806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.211+0000 7fc966d9d640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 0x7fc9681f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.212+0000 7fc966d9d640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9681511f0 con 0x7fc9680c5ff0 2024-09-19T09:48:22.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.212+0000 7fc96659c640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc94806c2e0 0x7fc94806e7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006a90 tx=0x7fc95c006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.212+0000 7fc966d9d640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 0x7fc9681f88b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc96806ce10 tx=0x7fc9580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.212+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958037040 con 0x7fc9680c5ff0 2024-09-19T09:48:22.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.213+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc958004490 con 0x7fc9680c5ff0 2024-09-19T09:48:22.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.213+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 msgr2=0x7fc9681f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.213+0000 7fc956ffd640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 0x7fc9681f88b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc96806ce10 tx=0x7fc9580046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.213+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 msgr2=0x7fc9681f88b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:22.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.213+0000 7fc956ffd640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9680c5ff0 0x7fc9681f88b0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc96806ce10 tx=0x7fc9580046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.227+0000 7fc954ff9640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 0x7fc968140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.228+0000 7fc954ff9640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc9680c8560 con 0x7fc96813feb0 2024-09-19T09:48:22.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.238+0000 7fc966d9d640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 0x7fc968140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.240+0000 7fc966d9d640 1 -- 172.21.15.123:0/189043650 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc9680c56d0 con 0x7fc96813feb0 2024-09-19T09:48:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.243+0000 7fc966d9d640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 0x7fc968140290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc968156f70 tx=0x7fc958008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.243+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958037040 con 0x7fc96813feb0 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.245+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fc958052420 con 0x7fc96813feb0 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.245+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 msgr2=0x7fc968140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.245+0000 7fc956ffd640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 0x7fc968140290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc968156f70 tx=0x7fc958008030 comp rx=0 tx=0).stop 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.245+0000 7fc956ffd640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 msgr2=0x7fc968140290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.245+0000 7fc956ffd640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc96813feb0 0x7fc968140290 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc968156f70 tx=0x7fc958008030 comp rx=0 tx=0).stop 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:22.247 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 32, 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 111560, 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 4, 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:22.248 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:22.250 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:22.251 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:22.252 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:22.253 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:22.254 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:22.255 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:22.256 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:22.258 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:22.259 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:22.260 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:22.261 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:22.261 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:22.261 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:22.261 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:22.261 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.248+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc94806c2e0 msgr2=0x7fc94806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.248+0000 7fc96759e640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc94806c2e0 0x7fc94806e7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006a90 tx=0x7fc95c006a20 comp rx=0 tx=0).stop 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.248+0000 7fc966d9d640 1 -- 172.21.15.123:0/189043650 reap_dead start 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.248+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 msgr2=0x7fc9680c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.248+0000 7fc96759e640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc9680c49a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc96000ba50 tx=0x7fc96000bf10 comp rx=0 tx=0).stop 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.249+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 shutdown_connections 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.249+0000 7fc96759e640 1 --2- 172.21.15.123:0/189043650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9680b2e90 0x7fc9680c49a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.249+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 >> 172.21.15.123:0/189043650 conn(0x7fc9680ccb90 msgr2=0x7fc9680c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.249+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 shutdown_connections 2024-09-19T09:48:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.249+0000 7fc96759e640 1 -- 172.21.15.123:0/189043650 wait complete. 2024-09-19T09:48:22.274 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:48:22.274 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:48:22.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:48:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.497+0000 7f43b2a43640 1 Processor -- start 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.501+0000 7f43b2a43640 1 -- start start 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b2a43640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43ac06ce00 0x7f43ac0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b2a43640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac0c98f0 0x7f43ac151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b2a43640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43ac0ce760 con 0x7f43ac06d1e0 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b2a43640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f43ac0c8d50 con 0x7f43ac06ce00 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b2a43640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac1584a0 con 0x7f43ac0c98f0 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b1a41640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43ac06ce00 0x7f43ac0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b1a41640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43ac06ce00 0x7f43ac0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56010/0 (socket says 172.21.15.123:56010) 2024-09-19T09:48:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.503+0000 7f43b1a41640 1 -- 172.21.15.123:0/341320153 learned_addr learned my addr 172.21.15.123:0/341320153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:22.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.504+0000 7f43b1a41640 1 -- 172.21.15.123:0/341320153 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac0c98f0 msgr2=0x7f43ac151cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:22.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.504+0000 7f43b1a41640 1 --2- 172.21.15.123:0/341320153 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac0c98f0 0x7f43ac151cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.504+0000 7f43b1a41640 1 -- 172.21.15.123:0/341320153 >> v1:172.21.15.194:6789/0 conn(0x7f43ac06d1e0 legacy=0x7f43ac0c91e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.504+0000 7f43b1a41640 1 -- 172.21.15.123:0/341320153 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac158780 con 0x7f43ac06ce00 2024-09-19T09:48:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.505+0000 7f43b1a41640 1 --2- 172.21.15.123:0/341320153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06ce00 0x7f43ac0cd320 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f43a800dc90 tx=0x7f43a802e5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae9f9b9a270629 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.506+0000 7f43b0a3f640 1 -- 172.21.15.123:0/341320153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a803a070 con 0x7f43ac06ce00 2024-09-19T09:48:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.506+0000 7f43b0a3f640 1 -- 172.21.15.123:0/341320153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a800b650 con 0x7f43ac06ce00 2024-09-19T09:48:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.506+0000 7f43b0a3f640 1 -- 172.21.15.123:0/341320153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a800ba20 con 0x7f43ac06ce00 2024-09-19T09:48:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.513+0000 7f43b2a43640 1 -- 172.21.15.123:0/341320153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06ce00 msgr2=0x7f43ac0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.513+0000 7f43b2a43640 1 --2- 172.21.15.123:0/341320153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06ce00 0x7f43ac0cd320 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f43a800dc90 tx=0x7f43a802e5b0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.516+0000 7f43b2a43640 1 -- 172.21.15.123:0/341320153 shutdown_connections 2024-09-19T09:48:22.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.516+0000 7f43b2a43640 1 --2- 172.21.15.123:0/341320153 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac0c98f0 0x7f43ac151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.516+0000 7f43b2a43640 1 --2- 172.21.15.123:0/341320153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06ce00 0x7f43ac0cd320 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.516+0000 7f43b2a43640 1 -- 172.21.15.123:0/341320153 >> 172.21.15.123:0/341320153 conn(0x7f43ac06fad0 msgr2=0x7f43ac06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.517+0000 7f43b2a43640 1 -- 172.21.15.123:0/341320153 shutdown_connections 2024-09-19T09:48:22.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.521+0000 7f43b2a43640 1 -- 172.21.15.123:0/341320153 wait complete. 2024-09-19T09:48:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.523+0000 7f43b2a43640 1 Processor -- start 2024-09-19T09:48:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.523+0000 7f43b2a43640 1 -- start start 2024-09-19T09:48:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.524+0000 7f43b2a43640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac06ce00 0x7f43ac1f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.524+0000 7f43b2a43640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 0x7f43ac1f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.524+0000 7f43b1a41640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac06ce00 0x7f43ac1f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.524+0000 7f43b1a41640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac06ce00 0x7f43ac1f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53242/0 (socket says 172.21.15.123:53242) 2024-09-19T09:48:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b1240640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 0x7f43ac1f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b1240640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 0x7f43ac1f8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56018/0 (socket says 172.21.15.123:56018) 2024-09-19T09:48:22.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b1a41640 1 -- 172.21.15.123:0/1434545703 learned_addr learned my addr 172.21.15.123:0/1434545703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:22.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac0c98f0 0x7f43ac127e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0c89e0 con 0x7f43ac06d1e0 2024-09-19T09:48:22.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac158d40 con 0x7f43ac0c98f0 2024-09-19T09:48:22.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.525+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac0705f0 con 0x7f43ac06ce00 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.526+0000 7f43b1240640 1 -- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac06ce00 msgr2=0x7f43ac1f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.526+0000 7f43b1240640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac06ce00 0x7f43ac1f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.526+0000 7f43b1240640 1 -- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac0c98f0 msgr2=0x7f43ac127e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.526+0000 7f43b1240640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac0c98f0 0x7f43ac127e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.526+0000 7f43b1240640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac126aa0 con 0x7f43ac06d1e0 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.526+0000 7f43b1240640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 0x7f43ac1f8830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f439c00b780 tx=0x7f439c00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.527+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c019070 con 0x7f43ac06d1e0 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.527+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c00c720 con 0x7f43ac06d1e0 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.527+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c00caf0 con 0x7f43ac06d1e0 2024-09-19T09:48:22.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.528+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac126d80 con 0x7f43ac06d1e0 2024-09-19T09:48:22.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.530+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f439c00cc90 con 0x7f43ac06d1e0 2024-09-19T09:48:22.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.531+0000 7f43a27fc640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f439006c330 0x7f439006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:22.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.531+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1f5610 con 0x7f43ac06d1e0 2024-09-19T09:48:22.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.532+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f439c056740 con 0x7f43ac06d1e0 2024-09-19T09:48:22.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.533+0000 7f43b1a41640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f439006c330 0x7f439006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:22.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.534+0000 7f43b1a41640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f439006c330 0x7f439006e7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f43a802e5f0 tx=0x7f43a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:22.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.534+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac157ef0 con 0x7f43ac06d1e0 2024-09-19T09:48:22.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:22.544+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f439c0586a0 con 0x7f43ac06d1e0 2024-09-19T09:48:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.091+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f43ac0c5870 con 0x7f43ac06d1e0 2024-09-19T09:48:23.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.094+0000 7f43a27fc640 1 -- 172.21.15.123:0/1434545703 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f439c05c9a0 con 0x7f43ac06d1e0 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.105+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f439006c330 msgr2=0x7f439006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.105+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f439006c330 0x7f439006e7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f43a802e5f0 tx=0x7f43a8008040 comp rx=0 tx=0).stop 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 msgr2=0x7f43ac1f8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 0x7f43ac1f8830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f439c00b780 tx=0x7f439c00bc40 comp rx=0 tx=0).stop 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 shutdown_connections 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43ac0c98f0 0x7f43ac127e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac06d1e0 0x7f43ac1f8830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f439006c330 0x7f439006e7f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 --2- 172.21.15.123:0/1434545703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43ac06ce00 0x7f43ac1f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 >> 172.21.15.123:0/1434545703 conn(0x7f43ac06fad0 msgr2=0x7f43ac0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 shutdown_connections 2024-09-19T09:48:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:23.106+0000 7f43b2a43640 1 -- 172.21.15.123:0/1434545703 wait complete. 2024-09-19T09:48:23.129 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:48:32.674 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:48:32.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:48:33.130 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:48:33.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.301+0000 7f7fdaeaf640 1 Processor -- start 2024-09-19T09:48:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.301+0000 7f7fdaeaf640 1 -- start start 2024-09-19T09:48:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.314+0000 7f7fdaeaf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fd40c7c10 0x7f7fd40c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.314+0000 7f7fdaeaf640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7fd40c9820 0x7f7fd415f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.314+0000 7f7fdaeaf640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd4162b00 con 0x7f7fd4159770 2024-09-19T09:48:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.314+0000 7f7fdaeaf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd4162de0 con 0x7f7fd40c7c10 2024-09-19T09:48:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.314+0000 7f7fdaeaf640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd41630c0 con 0x7f7fd40c9820 2024-09-19T09:48:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fd40c7c10 0x7f7fd40c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fd40c7c10 0x7f7fd40c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45624/0 (socket says 172.21.15.123:45624) 2024-09-19T09:48:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 -- 172.21.15.123:0/3687191720 learned_addr learned my addr 172.21.15.123:0/3687191720 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:33.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd944c640 1 --2- 172.21.15.123:0/3687191720 >> v2:172.21.15.194:3300/0 conn(0x7f7fd40c9820 0x7f7fd415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 -- 172.21.15.123:0/3687191720 >> v2:172.21.15.194:3300/0 conn(0x7f7fd40c9820 msgr2=0x7f7fd415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 --2- 172.21.15.123:0/3687191720 >> v2:172.21.15.194:3300/0 conn(0x7f7fd40c9820 0x7f7fd415f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 -- 172.21.15.123:0/3687191720 >> v1:172.21.15.194:6789/0 conn(0x7f7fd4159770 legacy=0x7f7fd40c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd3fff640 1 -- 172.21.15.123:0/3687191720 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd41633a0 con 0x7f7fd40c7c10 2024-09-19T09:48:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.315+0000 7f7fd944c640 1 --2- 172.21.15.123:0/3687191720 >> v2:172.21.15.194:3300/0 conn(0x7f7fd40c9820 0x7f7fd415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:48:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.317+0000 7f7fd3fff640 1 --2- 172.21.15.123:0/3687191720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd40c7c10 0x7f7fd40c92e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4163960 tx=0x7f7fc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e202d47acaface server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.318+0000 7f7fd37fe640 1 -- 172.21.15.123:0/3687191720 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8037070 con 0x7f7fd40c7c10 2024-09-19T09:48:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.318+0000 7f7fd37fe640 1 -- 172.21.15.123:0/3687191720 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8032440 con 0x7f7fd40c7c10 2024-09-19T09:48:33.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.319+0000 7f7fd37fe640 1 -- 172.21.15.123:0/3687191720 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8032810 con 0x7f7fd40c7c10 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.319+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/3687191720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd40c7c10 msgr2=0x7f7fd40c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.319+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/3687191720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd40c7c10 0x7f7fd40c92e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4163960 tx=0x7f7fc802a270 comp rx=0 tx=0).stop 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.319+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/3687191720 shutdown_connections 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.320+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/3687191720 >> v2:172.21.15.194:3300/0 conn(0x7f7fd40c9820 0x7f7fd415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.320+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/3687191720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd40c7c10 0x7f7fd40c92e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.320+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/3687191720 >> 172.21.15.123:0/3687191720 conn(0x7f7fd406eaa0 msgr2=0x7f7fd406ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:33.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.320+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/3687191720 shutdown_connections 2024-09-19T09:48:33.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.320+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/3687191720 wait complete. 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.322+0000 7f7fdaeaf640 1 Processor -- start 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.337+0000 7f7fdaeaf640 1 -- start start 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fdaeaf640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fd40c7c10 0x7f7fd4162230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fdaeaf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 0x7f7fd40c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fdaeaf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4159770 0x7f7fd40c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fdaeaf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4071300 con 0x7f7fd4159770 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fdaeaf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4071180 con 0x7f7fd40c9820 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fdaeaf640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd4159b50 con 0x7f7fd40c7c10 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 0x7f7fd40c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 0x7f7fd40c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40502/0 (socket says 172.21.15.123:40502) 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.338+0000 7f7fd3fff640 1 -- 172.21.15.123:0/2460484128 learned_addr learned my addr 172.21.15.123:0/2460484128 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:33.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.339+0000 7f7fd944c640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4159770 0x7f7fd40c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.339+0000 7f7fd3fff640 1 -- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fd40c7c10 msgr2=0x7f7fd4162230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.339+0000 7f7fd3fff640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fd40c7c10 0x7f7fd4162230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.339+0000 7f7fd3fff640 1 -- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4159770 msgr2=0x7f7fd40c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.339+0000 7f7fd3fff640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4159770 0x7f7fd40c1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.339+0000 7f7fd3fff640 1 -- 172.21.15.123:0/2460484128 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd40cc290 con 0x7f7fd40c9820 2024-09-19T09:48:33.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.340+0000 7f7fd3fff640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 0x7f7fd40c1740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8000c00 tx=0x7f7fc80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:33.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.340+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8037040 con 0x7f7fd40c9820 2024-09-19T09:48:33.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.340+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd40c06a0 con 0x7f7fd40c9820 2024-09-19T09:48:33.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.340+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd40c0c60 con 0x7f7fd40c9820 2024-09-19T09:48:33.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.342+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8042070 con 0x7f7fd40c9820 2024-09-19T09:48:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.343+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8030860 con 0x7f7fd40c9820 2024-09-19T09:48:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.345+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7fc8030a00 con 0x7f7fd40c9820 2024-09-19T09:48:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.346+0000 7f7fd17fa640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7fc006c2e0 0x7f7fc006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:33.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.346+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7fc80abd40 con 0x7f7fd40c9820 2024-09-19T09:48:33.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.346+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb4005290 con 0x7f7fd40c9820 2024-09-19T09:48:33.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.349+0000 7f7fd8c4b640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7fc006c2e0 0x7f7fc006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:33.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.350+0000 7f7fd8c4b640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7fc006c2e0 0x7f7fc006e7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f60 tx=0x7f7fc40079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:33.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.360+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7fc807a300 con 0x7f7fd40c9820 2024-09-19T09:48:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.935+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7fb4005580 con 0x7f7fd40c9820 2024-09-19T09:48:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.937+0000 7f7fd17fa640 1 -- 172.21.15.123:0/2460484128 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f7fc8079c00 con 0x7f7fd40c9820 2024-09-19T09:48:33.941 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:33.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.945+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7fc006c2e0 msgr2=0x7f7fc006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:33.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.945+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7fc006c2e0 0x7f7fc006e7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f60 tx=0x7f7fc40079b0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 msgr2=0x7f7fd40c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:33.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 0x7f7fd40c1740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8000c00 tx=0x7f7fc80046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 shutdown_connections 2024-09-19T09:48:33.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd4159770 0x7f7fd40c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fd40c9820 0x7f7fd40c1740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7fc006c2e0 0x7f7fc006e7a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 --2- 172.21.15.123:0/2460484128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fd40c7c10 0x7f7fd4162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:33.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 >> 172.21.15.123:0/2460484128 conn(0x7f7fd406eaa0 msgr2=0x7f7fd40cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:33.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 shutdown_connections 2024-09-19T09:48:33.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:33.946+0000 7f7fdaeaf640 1 -- 172.21.15.123:0/2460484128 wait complete. 2024-09-19T09:48:33.968 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:48:33.968 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:48:33.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:48:33.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:48:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.195+0000 7f8a65f78640 1 Processor -- start 2024-09-19T09:48:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.196+0000 7f8a65f78640 1 -- start start 2024-09-19T09:48:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a65f78640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8a5804aa40 0x7f8a58005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a65f78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a580ff830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a65f78640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a580453a0 con 0x7f8a58044b30 2024-09-19T09:48:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a65f78640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f8a58045660 con 0x7f8a5804aa40 2024-09-19T09:48:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a65f78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8a58045f00 con 0x7f8a58044f10 2024-09-19T09:48:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a580ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.197+0000 7f8a5effd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8a5804aa40 0x7f8a58005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.198+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a580ff830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41452/0 (socket says 172.21.15.123:41452) 2024-09-19T09:48:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.198+0000 7f8a5ffff640 1 -- 172.21.15.123:0/874833845 learned_addr learned my addr 172.21.15.123:0/874833845 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.198+0000 7f8a5ffff640 1 -- 172.21.15.123:0/874833845 >> v2:172.21.15.194:3300/0 conn(0x7f8a5804aa40 msgr2=0x7f8a58005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.198+0000 7f8a5ffff640 1 --2- 172.21.15.123:0/874833845 >> v2:172.21.15.194:3300/0 conn(0x7f8a5804aa40 0x7f8a58005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.198+0000 7f8a5ffff640 1 -- 172.21.15.123:0/874833845 >> v1:172.21.15.123:6789/0 conn(0x7f8a58044b30 legacy=0x7f8a58046390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.198+0000 7f8a5ffff640 1 -- 172.21.15.123:0/874833845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a581002e0 con 0x7f8a58044f10 2024-09-19T09:48:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.200+0000 7f8a5ffff640 1 --2- 172.21.15.123:0/874833845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a580ff830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a6006a090 tx=0x7f8a600965b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35085bb49b903f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.202+0000 7f8a5e7fc640 1 -- 172.21.15.123:0/874833845 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a600a4070 con 0x7f8a58044f10 2024-09-19T09:48:34.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.202+0000 7f8a5e7fc640 1 -- 172.21.15.123:0/874833845 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6009c540 con 0x7f8a58044f10 2024-09-19T09:48:34.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a65f78640 1 -- 172.21.15.123:0/874833845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 msgr2=0x7f8a580ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a5e7fc640 1 -- 172.21.15.123:0/874833845 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a600a4070 con 0x7f8a58044f10 2024-09-19T09:48:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a65f78640 1 --2- 172.21.15.123:0/874833845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a580ff830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a6006a090 tx=0x7f8a600965b0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a65f78640 1 -- 172.21.15.123:0/874833845 shutdown_connections 2024-09-19T09:48:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a65f78640 1 --2- 172.21.15.123:0/874833845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a580ff830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a65f78640 1 --2- 172.21.15.123:0/874833845 >> v2:172.21.15.194:3300/0 conn(0x7f8a5804aa40 0x7f8a58005a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.203+0000 7f8a65f78640 1 -- 172.21.15.123:0/874833845 >> 172.21.15.123:0/874833845 conn(0x7f8a5804fc50 msgr2=0x7f8a58050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:34.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.213+0000 7f8a65f78640 1 -- 172.21.15.123:0/874833845 shutdown_connections 2024-09-19T09:48:34.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.214+0000 7f8a65f78640 1 -- 172.21.15.123:0/874833845 wait complete. 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.216+0000 7f8a65f78640 1 Processor -- start 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.217+0000 7f8a65f78640 1 -- start start 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.218+0000 7f8a65f78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a58044b30 0x7f8a58049250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.218+0000 7f8a65f78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a58047bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.218+0000 7f8a65f78640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a5804aa40 0x7f8a580f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.218+0000 7f8a65f78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580458b0 con 0x7f8a58044b30 2024-09-19T09:48:34.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.218+0000 7f8a65f78640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580f6a70 con 0x7f8a5804aa40 2024-09-19T09:48:34.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.218+0000 7f8a65f78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8a58045b90 con 0x7f8a58044f10 2024-09-19T09:48:34.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.219+0000 7f8a5effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a58047bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.219+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a5804aa40 0x7f8a580f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.219+0000 7f8a5effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a58047bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41462/0 (socket says 172.21.15.123:41462) 2024-09-19T09:48:34.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.219+0000 7f8a5effd640 1 -- 172.21.15.123:0/3784492259 learned_addr learned my addr 172.21.15.123:0/3784492259 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:34.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.220+0000 7f8a5effd640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a5804aa40 msgr2=0x7f8a580f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.220+0000 7f8a5effd640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a5804aa40 0x7f8a580f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.220+0000 7f8a5effd640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a58044b30 msgr2=0x7f8a58049250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.220+0000 7f8a5effd640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a58044b30 0x7f8a58049250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.220+0000 7f8a5effd640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a580f7b00 con 0x7f8a58044f10 2024-09-19T09:48:34.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.221+0000 7f8a5effd640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a58047bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400ca10 tx=0x7f8a5400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.225+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400ab20 con 0x7f8a58044f10 2024-09-19T09:48:34.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.225+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5400acc0 con 0x7f8a58044f10 2024-09-19T09:48:34.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.225+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400d630 con 0x7f8a58044f10 2024-09-19T09:48:34.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.226+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a581a3fa0 con 0x7f8a58044f10 2024-09-19T09:48:34.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.226+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a581a4280 con 0x7f8a58044f10 2024-09-19T09:48:34.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.227+0000 7f8a65f78640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 0x7f8a580f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.227+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5804a7d0 con 0x7f8a580f97a0 2024-09-19T09:48:34.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.230+0000 7f8a5f7fe640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 0x7f8a580f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.230+0000 7f8a5f7fe640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a5804af20 con 0x7f8a580f97a0 2024-09-19T09:48:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.231+0000 7f8a5f7fe640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 0x7f8a580f2fc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00b340 tx=0x7f8a4c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.231+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a5400d7d0 con 0x7f8a58044f10 2024-09-19T09:48:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.232+0000 7f8a4bfff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8a4406c300 0x7f8a4406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.232+0000 7f8a5ffff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8a4406c300 0x7f8a4406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.233+0000 7f8a5ffff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8a4406c300 0x7f8a4406e7c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a580457e0 tx=0x7f8a6009d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.233+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f8a5408be70 con 0x7f8a58044f10 2024-09-19T09:48:34.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.237+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c015020 con 0x7f8a580f97a0 2024-09-19T09:48:34.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.237+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8a4c011830 con 0x7f8a580f97a0 2024-09-19T09:48:34.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.237+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 msgr2=0x7f8a580f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.237+0000 7f8a4bfff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 0x7f8a580f2fc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00b340 tx=0x7f8a4c009f90 comp rx=0 tx=0).stop 2024-09-19T09:48:34.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.237+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 msgr2=0x7f8a580f2fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:34.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.237+0000 7f8a4bfff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580f97a0 0x7f8a580f2fc0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00b340 tx=0x7f8a4c009f90 comp rx=0 tx=0).stop 2024-09-19T09:48:34.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.255+0000 7f8a65f78640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 0x7f8a580f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.255+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580f3a40 con 0x7f8a580473f0 2024-09-19T09:48:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.256+0000 7f8a5f7fe640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 0x7f8a580f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.256+0000 7f8a5f7fe640 1 -- 172.21.15.123:0/3784492259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a580ff170 con 0x7f8a580473f0 2024-09-19T09:48:34.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.257+0000 7f8a5f7fe640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 0x7f8a580f3500 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00b340 tx=0x7f8a4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.258+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c015040 con 0x7f8a580473f0 2024-09-19T09:48:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.258+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f8a4c026640 con 0x7f8a580473f0 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.258+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 msgr2=0x7f8a580f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.258+0000 7f8a4bfff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 0x7f8a580f3500 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00b340 tx=0x7f8a4c004770 comp rx=0 tx=0).stop 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.258+0000 7f8a4bfff640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 msgr2=0x7f8a580f3500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.259+0000 7f8a4bfff640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a580473f0 0x7f8a580f3500 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00b340 tx=0x7f8a4c004770 comp rx=0 tx=0).stop 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:34.261 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 32, 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 17477, 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:34.262 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.263 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.264 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:34.265 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.266 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:34.267 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:34.268 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.269 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:34.270 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.271 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.272 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.273 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.274 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.274 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.274 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.274 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:34.274 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:34.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.260+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8a4406c300 msgr2=0x7f8a4406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.260+0000 7f8a65f78640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8a4406c300 0x7f8a4406e7c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a580457e0 tx=0x7f8a6009d000 comp rx=0 tx=0).stop 2024-09-19T09:48:34.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.260+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 msgr2=0x7f8a58047bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.260+0000 7f8a65f78640 1 --2- 172.21.15.123:0/3784492259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a58044f10 0x7f8a58047bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400ca10 tx=0x7f8a5400ced0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.260+0000 7f8a5ffff640 1 -- 172.21.15.123:0/3784492259 reap_dead start 2024-09-19T09:48:34.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.260+0000 7f8a5ffff640 1 -- 172.21.15.123:0/3784492259 reap_dead start 2024-09-19T09:48:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.261+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 shutdown_connections 2024-09-19T09:48:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.261+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 >> 172.21.15.123:0/3784492259 conn(0x7f8a5804fc50 msgr2=0x7f8a580f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.262+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 shutdown_connections 2024-09-19T09:48:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.262+0000 7f8a65f78640 1 -- 172.21.15.123:0/3784492259 wait complete. 2024-09-19T09:48:34.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:48:34.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:48:34.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:48:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.494+0000 7f31bd366640 1 Processor -- start 2024-09-19T09:48:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.496+0000 7f31bd366640 1 -- start start 2024-09-19T09:48:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.499+0000 7f31bd366640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f31b8159720 0x7f31b80c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.499+0000 7f31bd366640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b80c2870 0x7f31b80c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.500+0000 7f31bd366640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b80c7c00 con 0x7f31b80c34c0 2024-09-19T09:48:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.500+0000 7f31bd366640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f31b8162b70 con 0x7f31b8159720 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.500+0000 7f31bd366640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f31b8162e50 con 0x7f31b80c2870 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.500+0000 7f31b77fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b80c2870 0x7f31b80c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.500+0000 7f31b77fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b80c2870 0x7f31b80c2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41470/0 (socket says 172.21.15.123:41470) 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.500+0000 7f31b77fe640 1 -- 172.21.15.123:0/1885996755 learned_addr learned my addr 172.21.15.123:0/1885996755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.501+0000 7f31b6ffd640 1 --2- 172.21.15.123:0/1885996755 >> v2:172.21.15.194:3300/0 conn(0x7f31b8159720 0x7f31b80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.501+0000 7f31b6ffd640 1 -- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b80c2870 msgr2=0x7f31b80c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.501+0000 7f31b6ffd640 1 --2- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b80c2870 0x7f31b80c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.501+0000 7f31b6ffd640 1 -- 172.21.15.123:0/1885996755 >> v1:172.21.15.194:6789/0 conn(0x7f31b80c34c0 legacy=0x7f31b815ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.501+0000 7f31b6ffd640 1 -- 172.21.15.123:0/1885996755 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b8163130 con 0x7f31b8159720 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.502+0000 7f31b6ffd640 1 --2- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b8159720 0x7f31b80c7590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0097a0 tx=0x7f31ac02a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494f2f54b61d3db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.503+0000 7f31b5ffb640 1 -- 172.21.15.123:0/1885996755 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac037070 con 0x7f31b8159720 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.503+0000 7f31b5ffb640 1 -- 172.21.15.123:0/1885996755 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac032440 con 0x7f31b8159720 2024-09-19T09:48:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.503+0000 7f31b5ffb640 1 -- 172.21.15.123:0/1885996755 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac02ae60 con 0x7f31b8159720 2024-09-19T09:48:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.504+0000 7f31bd366640 1 -- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b8159720 msgr2=0x7f31b80c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.504+0000 7f31bd366640 1 --2- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b8159720 0x7f31b80c7590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0097a0 tx=0x7f31ac02a150 comp rx=0 tx=0).stop 2024-09-19T09:48:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.505+0000 7f31bd366640 1 -- 172.21.15.123:0/1885996755 shutdown_connections 2024-09-19T09:48:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.505+0000 7f31bd366640 1 --2- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b80c2870 0x7f31b80c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.505+0000 7f31bd366640 1 --2- 172.21.15.123:0/1885996755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b8159720 0x7f31b80c7590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.505+0000 7f31bd366640 1 -- 172.21.15.123:0/1885996755 >> 172.21.15.123:0/1885996755 conn(0x7f31b806f110 msgr2=0x7f31b806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.507+0000 7f31bd366640 1 -- 172.21.15.123:0/1885996755 shutdown_connections 2024-09-19T09:48:34.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.507+0000 7f31bd366640 1 -- 172.21.15.123:0/1885996755 wait complete. 2024-09-19T09:48:34.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.509+0000 7f31bd366640 1 Processor -- start 2024-09-19T09:48:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.510+0000 7f31bd366640 1 -- start start 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.511+0000 7f31bd366640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b80c2870 0x7f31b81f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.511+0000 7f31bd366640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 0x7f31b8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.511+0000 7f31b67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 0x7f31b8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.511+0000 7f31b67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 0x7f31b8157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45666/0 (socket says 172.21.15.123:45666) 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31b67fc640 1 -- 172.21.15.123:0/449578930 learned_addr learned my addr 172.21.15.123:0/449578930 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31bd366640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b8159720 0x7f31b8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80c8280 con 0x7f31b80c34c0 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8159b00 con 0x7f31b80c2870 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80c8400 con 0x7f31b8159720 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31b67fc640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b8159720 msgr2=0x7f31b8158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31b67fc640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31b8159720 0x7f31b8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31b67fc640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b80c2870 msgr2=0x7f31b81f9000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.512+0000 7f31b67fc640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b80c2870 0x7f31b81f9000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.513+0000 7f31b67fc640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b81520f0 con 0x7f31b80c34c0 2024-09-19T09:48:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.513+0000 7f31b67fc640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 0x7f31b8157cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b700 tx=0x7f31a800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.514+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8019070 con 0x7f31b80c34c0 2024-09-19T09:48:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.514+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a800c800 con 0x7f31b80c34c0 2024-09-19T09:48:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.514+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b81f9c80 con 0x7f31b80c34c0 2024-09-19T09:48:34.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.517+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b8155480 con 0x7f31b80c34c0 2024-09-19T09:48:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.517+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a800cbf0 con 0x7f31b80c34c0 2024-09-19T09:48:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.518+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f31a801c360 con 0x7f31b80c34c0 2024-09-19T09:48:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.518+0000 7f319f7fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f31a406c3e0 0x7f31a406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.518+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f31a808a6f0 con 0x7f31b80c34c0 2024-09-19T09:48:34.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.518+0000 7f31bd366640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 0x7f3198004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.519+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3198007ec0 con 0x7f3198002a70 2024-09-19T09:48:34.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.519+0000 7f31b77fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 0x7f3198004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.519+0000 7f31b6ffd640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f31a406c3e0 0x7f31a406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.520+0000 7f31b6ffd640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f31a406c3e0 0x7f31a406e8a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f31ac034000 tx=0x7f31ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.521+0000 7f31b77fe640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31980080c0 con 0x7f3198002a70 2024-09-19T09:48:34.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.521+0000 7f31b77fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 0x7f3198004f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31b000efb0 tx=0x7f31b000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.522+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b000cd10 con 0x7f3198002a70 2024-09-19T09:48:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.522+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f31b000cd10 con 0x7f3198002a70 2024-09-19T09:48:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.522+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 msgr2=0x7f3198004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.522+0000 7f319f7fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 0x7f3198004f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31b000efb0 tx=0x7f31b000c490 comp rx=0 tx=0).stop 2024-09-19T09:48:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.522+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 msgr2=0x7f3198004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.523+0000 7f319f7fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198002a70 0x7f3198004f30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.559+0000 7f31bd366640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 0x7f3198007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.559+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f319800a4a0 con 0x7f3198006ee0 2024-09-19T09:48:34.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.560+0000 7f31b77fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 0x7f3198007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.562+0000 7f31b77fe640 1 -- 172.21.15.123:0/449578930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f31980078b0 con 0x7f3198006ee0 2024-09-19T09:48:34.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.562+0000 7f31b77fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 0x7f3198007370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31b0017000 tx=0x7f31b0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.563+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0004030 con 0x7f3198006ee0 2024-09-19T09:48:34.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.563+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7f31b0004030 con 0x7f3198006ee0 2024-09-19T09:48:34.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.563+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 msgr2=0x7f3198007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.563+0000 7f319f7fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 0x7f3198007370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31b0017000 tx=0x7f31b0004a40 comp rx=0 tx=0).stop 2024-09-19T09:48:34.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.563+0000 7f319f7fe640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 msgr2=0x7f3198007370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:34.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.563+0000 7f319f7fe640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3198006ee0 0x7f3198007370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 32, 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 71021, 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:48:34.567 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.568 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:34.570 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.571 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:34.572 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.573 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.574 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.575 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.576 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.577 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:48:34.578 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:34.580 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:34.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f31a406c3e0 msgr2=0x7f31a406e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f31a406c3e0 0x7f31a406e8a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f31ac034000 tx=0x7f31ac02e000 comp rx=0 tx=0).stop 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31b77fe640 1 -- 172.21.15.123:0/449578930 reap_dead start 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 msgr2=0x7f31b8157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 0x7f31b8157cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b700 tx=0x7f31a800bbc0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 shutdown_connections 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 --2- 172.21.15.123:0/449578930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31b80c34c0 0x7f31b8157cc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.575+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 >> 172.21.15.123:0/449578930 conn(0x7f31b806f110 msgr2=0x7f31b80c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.578+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 shutdown_connections 2024-09-19T09:48:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.578+0000 7f31bd366640 1 -- 172.21.15.123:0/449578930 wait complete. 2024-09-19T09:48:34.602 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:48:34.602 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:48:34.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:48:34.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.791+0000 7fcb5225e640 1 Processor -- start 2024-09-19T09:48:34.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.791+0000 7fcb5225e640 1 -- start start 2024-09-19T09:48:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.792+0000 7fcb5225e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.792+0000 7fcb5225e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb4c0ccec0 0x7fcb4c15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.794+0000 7fcb4bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb4c0ccec0 0x7fcb4c15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.794+0000 7fcb4bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb4c0ccec0 0x7fcb4c15b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45682/0 (socket says 172.21.15.123:45682) 2024-09-19T09:48:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.794+0000 7fcb42ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb4c0c7610 0x7fcb4c15b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42608/0 (socket says 172.21.15.123:42608) 2024-09-19T09:48:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.795+0000 7fcb4b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.795+0000 7fcb4bfff640 1 -- 172.21.15.123:0/3850310369 learned_addr learned my addr 172.21.15.123:0/3850310369 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.795+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4c072770 con 0x7fcb4c0c7610 2024-09-19T09:48:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.796+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4c0cc0e0 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.796+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c155950 con 0x7fcb4c155570 2024-09-19T09:48:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.796+0000 7fcb4affd640 1 -- 172.21.15.123:0/3850310369 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121629127 0 0) 0x7fcb4c072770 con 0x7fcb4c0c7610 2024-09-19T09:48:34.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.796+0000 7fcb4affd640 1 -- 172.21.15.123:0/3850310369 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb2c003520 con 0x7fcb4c0c7610 2024-09-19T09:48:34.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.797+0000 7fcb4bfff640 1 -- 172.21.15.123:0/3850310369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 msgr2=0x7fcb4c072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:34.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.797+0000 7fcb4bfff640 1 --2- 172.21.15.123:0/3850310369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.797+0000 7fcb4bfff640 1 -- 172.21.15.123:0/3850310369 >> v1:172.21.15.123:6789/0 conn(0x7fcb4c0c7610 legacy=0x7fcb4c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.797+0000 7fcb4bfff640 1 -- 172.21.15.123:0/3850310369 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c0cbe00 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.798+0000 7fcb4bfff640 1 --2- 172.21.15.123:0/3850310369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c15b8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b1a0 tx=0x7fcb4402a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4556912cd7510a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.800+0000 7fcb4affd640 1 -- 172.21.15.123:0/3850310369 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44037070 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.800+0000 7fcb4affd640 1 -- 172.21.15.123:0/3850310369 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44032460 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.800+0000 7fcb4affd640 1 -- 172.21.15.123:0/3850310369 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44032810 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.801+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 msgr2=0x7fcb4c15b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.801+0000 7fcb5225e640 1 --2- 172.21.15.123:0/3850310369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c15b8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b1a0 tx=0x7fcb4402a8b0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.801+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 shutdown_connections 2024-09-19T09:48:34.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.802+0000 7fcb5225e640 1 --2- 172.21.15.123:0/3850310369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c15b8b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.802+0000 7fcb5225e640 1 --2- 172.21.15.123:0/3850310369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.802+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 >> 172.21.15.123:0/3850310369 conn(0x7fcb4c06d2b0 msgr2=0x7fcb4c0d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:34.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.804+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 shutdown_connections 2024-09-19T09:48:34.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.805+0000 7fcb5225e640 1 -- 172.21.15.123:0/3850310369 wait complete. 2024-09-19T09:48:34.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.806+0000 7fcb5225e640 1 Processor -- start 2024-09-19T09:48:34.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.807+0000 7fcb5225e640 1 -- start start 2024-09-19T09:48:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.808+0000 7fcb5225e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb4c0c7610 0x7fcb4c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.808+0000 7fcb5225e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.808+0000 7fcb5225e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.808+0000 7fcb5225e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0c6e10 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.808+0000 7fcb5225e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0c6b30 con 0x7fcb4c0c7610 2024-09-19T09:48:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.808+0000 7fcb5225e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c0cc3a0 con 0x7fcb4c155570 2024-09-19T09:48:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.809+0000 7fcb4bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.809+0000 7fcb4bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c14b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41488/0 (socket says 172.21.15.123:41488) 2024-09-19T09:48:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.809+0000 7fcb42ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.809+0000 7fcb4bfff640 1 -- 172.21.15.123:0/4024985012 learned_addr learned my addr 172.21.15.123:0/4024985012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.809+0000 7fcb4b7fe640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb4c0c7610 0x7fcb4c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.810+0000 7fcb42ffd640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 msgr2=0x7fcb4c14b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.810+0000 7fcb42ffd640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb4c155570 0x7fcb4c14b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.810+0000 7fcb42ffd640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb4c0c7610 msgr2=0x7fcb4c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.810+0000 7fcb42ffd640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb4c0c7610 0x7fcb4c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.810+0000 7fcb42ffd640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c15aba0 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.810+0000 7fcb42ffd640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c14b3f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb34001eb0 tx=0x7fcb3400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.812+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340074e0 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.812+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb340047e0 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.812+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34004bd0 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.812+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c15b740 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.812+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c15bd00 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.813+0000 7fcb5225e640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 0x7fcb24004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.814+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcb24007ec0 con 0x7fcb24002a70 2024-09-19T09:48:34.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.815+0000 7fcb4b7fe640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 0x7fcb24004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.816+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcb34011070 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.817+0000 7fcb4b7fe640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb240080c0 con 0x7fcb24002a70 2024-09-19T09:48:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.817+0000 7fcb48ff9640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcb3006c380 0x7fcb3006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.818+0000 7fcb4b7fe640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 0x7fcb24004f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00f810 tx=0x7fcb3c00fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.818+0000 7fcb4bfff640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcb3006c380 0x7fcb3006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.819+0000 7fcb4bfff640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcb3006c380 0x7fcb3006e840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009c90 tx=0x7fcb44009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.819+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fcb3408aeb0 con 0x7fcb4c0ccec0 2024-09-19T09:48:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.819+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00dc20 con 0x7fcb24002a70 2024-09-19T09:48:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.820+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcb3c00ddc0 con 0x7fcb24002a70 2024-09-19T09:48:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.820+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 msgr2=0x7fcb24004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.820+0000 7fcb48ff9640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 0x7fcb24004f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00f810 tx=0x7fcb3c00fcd0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.820+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 msgr2=0x7fcb24004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.820+0000 7fcb48ff9640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24002a70 0x7fcb24004f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.833+0000 7fcb5225e640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 0x7fcb240073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:34.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.833+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2400a4a0 con 0x7fcb24006f30 2024-09-19T09:48:34.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.834+0000 7fcb4b7fe640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 0x7fcb240073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.836+0000 7fcb4b7fe640 1 -- 172.21.15.123:0/4024985012 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcb24007900 con 0x7fcb24006f30 2024-09-19T09:48:34.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.836+0000 7fcb4b7fe640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 0x7fcb240073c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00f810 tx=0x7fcb3c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:34.840 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:34.840 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:34.840 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:34.840 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 32, 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 124153, 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.841 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.842 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:34.843 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:34.844 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:34.845 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.846 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:34.847 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:34.848 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.849 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:34.850 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.851 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.852 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:34.853 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00dc20 con 0x7fcb24006f30 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fcb3c003aa0 con 0x7fcb24006f30 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 msgr2=0x7fcb240073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb48ff9640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 0x7fcb240073c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00f810 tx=0x7fcb3c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb48ff9640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 msgr2=0x7fcb240073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb48ff9640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb24006f30 0x7fcb240073c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcb3006c380 msgr2=0x7fcb3006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.838+0000 7fcb5225e640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcb3006c380 0x7fcb3006e840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009c90 tx=0x7fcb44009000 comp rx=0 tx=0).stop 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.839+0000 7fcb4bfff640 1 -- 172.21.15.123:0/4024985012 reap_dead start 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.839+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 msgr2=0x7fcb4c14b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.839+0000 7fcb5225e640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c14b3f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb34001eb0 tx=0x7fcb3400c870 comp rx=0 tx=0).stop 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.839+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 shutdown_connections 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.839+0000 7fcb5225e640 1 --2- 172.21.15.123:0/4024985012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0ccec0 0x7fcb4c14b3f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.839+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 >> 172.21.15.123:0/4024985012 conn(0x7fcb4c06d2b0 msgr2=0x7fcb4c0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.840+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 shutdown_connections 2024-09-19T09:48:34.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:34.840+0000 7fcb5225e640 1 -- 172.21.15.123:0/4024985012 wait complete. 2024-09-19T09:48:34.865 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:48:34.866 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-19T09:48:34.866 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:48:34.866 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-19T09:48:34.866 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:48:34.866 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:48:34.866 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:48:34.888 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:48:34.888 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:48:34.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:35.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.065+0000 7f1cda54b640 1 Processor -- start 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.065+0000 7f1cda54b640 1 -- start start 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cda54b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1cd40c3920 0x7f1cd4163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cda54b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 0x7f1cd40c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cda54b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cd40c6e30 con 0x7f1cd40c95f0 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cda54b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f1cd40c9140 con 0x7f1cd40c3920 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cda54b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd4071f50 con 0x7f1cd406c560 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cd37fe640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f1cd40c3920 msgr2=0x7f1cd4163390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cd37fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1cd40c3920 0x7f1cd4163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cd8ae8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 0x7f1cd40c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cd8ae8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 0x7f1cd40c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41578/0 (socket says 172.21.15.123:41578) 2024-09-19T09:48:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.067+0000 7f1cd8ae8640 1 -- 172.21.15.123:0/1396778947 learned_addr learned my addr 172.21.15.123:0/1396778947 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.068+0000 7f1cd8ae8640 1 -- 172.21.15.123:0/1396778947 >> v2:172.21.15.194:3300/0 conn(0x7f1cd40c3920 msgr2=0x7f1cd4163390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.068+0000 7f1cd8ae8640 1 --2- 172.21.15.123:0/1396778947 >> v2:172.21.15.194:3300/0 conn(0x7f1cd40c3920 0x7f1cd4163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.068+0000 7f1cd8ae8640 1 -- 172.21.15.123:0/1396778947 >> v1:172.21.15.194:6789/0 conn(0x7f1cd40c95f0 legacy=0x7f1cd406be50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:48:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.068+0000 7f1cd8ae8640 1 -- 172.21.15.123:0/1396778947 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd4072230 con 0x7f1cd406c560 2024-09-19T09:48:35.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.069+0000 7f1cd8ae8640 1 --2- 172.21.15.123:0/1396778947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 0x7f1cd40c99d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009870 tx=0x7f1cc802a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfaa47f4ca11b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:35.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.070+0000 7f1cd2ffd640 1 -- 172.21.15.123:0/1396778947 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8037070 con 0x7f1cd406c560 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.070+0000 7f1cd2ffd640 1 -- 172.21.15.123:0/1396778947 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc8032440 con 0x7f1cd406c560 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.071+0000 7f1cda54b640 1 -- 172.21.15.123:0/1396778947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 msgr2=0x7f1cd40c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.071+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1396778947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 0x7f1cd40c99d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009870 tx=0x7f1cc802a2c0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.071+0000 7f1cda54b640 1 -- 172.21.15.123:0/1396778947 shutdown_connections 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.071+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1396778947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd406c560 0x7f1cd40c99d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.071+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1396778947 >> v2:172.21.15.194:3300/0 conn(0x7f1cd40c3920 0x7f1cd4163390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.071+0000 7f1cda54b640 1 -- 172.21.15.123:0/1396778947 >> 172.21.15.123:0/1396778947 conn(0x7f1cd406ec90 msgr2=0x7f1cd406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:35.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.074+0000 7f1cda54b640 1 -- 172.21.15.123:0/1396778947 shutdown_connections 2024-09-19T09:48:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.074+0000 7f1cda54b640 1 -- 172.21.15.123:0/1396778947 wait complete. 2024-09-19T09:48:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.076+0000 7f1cda54b640 1 Processor -- start 2024-09-19T09:48:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.076+0000 7f1cda54b640 1 -- start start 2024-09-19T09:48:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.077+0000 7f1cda54b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cd40c95f0 0x7f1cd412e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.077+0000 7f1cda54b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 0x7f1cd40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.077+0000 7f1cda54b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cd41449f0 0x7f1cd40cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.077+0000 7f1cda54b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4072ad0 con 0x7f1cd40c95f0 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cda54b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd40727f0 con 0x7f1cd41449f0 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cda54b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd4071c50 con 0x7f1cd412f550 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cd8ae8640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cd41449f0 msgr2=0x7f1cd40cb030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cd8ae8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cd41449f0 0x7f1cd40cb030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cd37fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 0x7f1cd40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cd37fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 0x7f1cd40caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41594/0 (socket says 172.21.15.123:41594) 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.078+0000 7f1cd37fe640 1 -- 172.21.15.123:0/1609629859 learned_addr learned my addr 172.21.15.123:0/1609629859 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.079+0000 7f1cd37fe640 1 -- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cd41449f0 msgr2=0x7f1cd40cb030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.079+0000 7f1cd37fe640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cd41449f0 0x7f1cd40cb030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.079+0000 7f1cd37fe640 1 -- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cd40c95f0 msgr2=0x7f1cd412e7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.079+0000 7f1cd37fe640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cd40c95f0 0x7f1cd412e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.079+0000 7f1cd37fe640 1 -- 172.21.15.123:0/1609629859 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd414b1d0 con 0x7f1cd412f550 2024-09-19T09:48:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.079+0000 7f1cd37fe640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 0x7f1cd40caaf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00ba40 tx=0x7f1ccc00bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.080+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00cc00 con 0x7f1cd412f550 2024-09-19T09:48:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.080+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd414b470 con 0x7f1cd412f550 2024-09-19T09:48:35.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.080+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd414ba30 con 0x7f1cd412f550 2024-09-19T09:48:35.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.084+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc010070 con 0x7f1cd412f550 2024-09-19T09:48:35.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.084+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc015470 con 0x7f1cd412f550 2024-09-19T09:48:35.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.085+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4005290 con 0x7f1cd412f550 2024-09-19T09:48:35.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.087+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ccc015610 con 0x7f1cd412f550 2024-09-19T09:48:35.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.088+0000 7f1cd0ff9640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1cc006c380 0x7f1cc006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:35.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.088+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1ccc08bd80 con 0x7f1cd412f550 2024-09-19T09:48:35.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.089+0000 7f1cd3fff640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1cc006c380 0x7f1cc006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:35.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.090+0000 7f1cd3fff640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1cc006c380 0x7f1cc006e840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4000f40 tx=0x7f1cc4006b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:35.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.098+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1ccc05a450 con 0x7f1cd412f550 2024-09-19T09:48:35.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.653+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1cb4005580 con 0x7f1cd412f550 2024-09-19T09:48:35.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.654+0000 7f1cd0ff9640 1 -- 172.21.15.123:0/1609629859 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f1ccc059d50 con 0x7f1cd412f550 2024-09-19T09:48:35.657 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:35.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.662+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1cc006c380 msgr2=0x7f1cc006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:35.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.662+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1cc006c380 0x7f1cc006e840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4000f40 tx=0x7f1cc4006b80 comp rx=0 tx=0).stop 2024-09-19T09:48:35.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.662+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 msgr2=0x7f1cd40caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:35.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.663+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 0x7f1cd40caaf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00ba40 tx=0x7f1ccc00bf00 comp rx=0 tx=0).stop 2024-09-19T09:48:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 shutdown_connections 2024-09-19T09:48:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cd41449f0 0x7f1cd40cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1cc006c380 0x7f1cc006e840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cd412f550 0x7f1cd40caaf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 --2- 172.21.15.123:0/1609629859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cd40c95f0 0x7f1cd412e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 >> 172.21.15.123:0/1609629859 conn(0x7f1cd406ec90 msgr2=0x7f1cd4161410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:35.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.664+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 shutdown_connections 2024-09-19T09:48:35.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:35.665+0000 7f1cda54b640 1 -- 172.21.15.123:0/1609629859 wait complete. 2024-09-19T09:48:38.704 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.873+0000 7f4dc924c640 1 Processor -- start 2024-09-19T09:48:38.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.873+0000 7f4dc924c640 1 -- start start 2024-09-19T09:48:38.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.875+0000 7f4dc924c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4dc40736a0 0x7f4dc415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:38.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.875+0000 7f4dc924c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4dc4159320 0x7f4dc4159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.875+0000 7f4dbbfff640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7f4dc4073a80 legacy=0x7f4dc40b4a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc2d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4dc40736a0 0x7f4dc415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc924c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc4159c70 con 0x7f4dc4073a80 2024-09-19T09:48:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc924c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc40709e0 con 0x7f4dc40736a0 2024-09-19T09:48:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc359e640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f4dc4159320 msgr2=0x7f4dc4159730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc924c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc4070c60 con 0x7f4dc4159320 2024-09-19T09:48:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc2d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4dc40736a0 0x7f4dc415ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45766/0 (socket says 172.21.15.123:45766) 2024-09-19T09:48:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc2d9d640 1 -- 172.21.15.123:0/3128872572 learned_addr learned my addr 172.21.15.123:0/3128872572 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.876+0000 7f4dc359e640 1 --2- 172.21.15.123:0/3128872572 >> v2:172.21.15.194:3300/0 conn(0x7f4dc4159320 0x7f4dc4159730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.877+0000 7f4dc2d9d640 1 -- 172.21.15.123:0/3128872572 >> v2:172.21.15.194:3300/0 conn(0x7f4dc4159320 msgr2=0x7f4dc4159730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.877+0000 7f4dc2d9d640 1 --2- 172.21.15.123:0/3128872572 >> v2:172.21.15.194:3300/0 conn(0x7f4dc4159320 0x7f4dc4159730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.877+0000 7f4dc2d9d640 1 -- 172.21.15.123:0/3128872572 >> v1:172.21.15.194:6789/0 conn(0x7f4dc4073a80 legacy=0x7f4dc40b4a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.877+0000 7f4dc2d9d640 1 -- 172.21.15.123:0/3128872572 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc4070f40 con 0x7f4dc40736a0 2024-09-19T09:48:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.879+0000 7f4dc2d9d640 1 --2- 172.21.15.123:0/3128872572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40736a0 0x7f4dc415ffd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40b47a0 tx=0x7f4db402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23be669a438b1e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.879+0000 7f4dc259c640 1 -- 172.21.15.123:0/3128872572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4037070 con 0x7f4dc40736a0 2024-09-19T09:48:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.879+0000 7f4dc259c640 1 -- 172.21.15.123:0/3128872572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db4032440 con 0x7f4dc40736a0 2024-09-19T09:48:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.880+0000 7f4dc924c640 1 -- 172.21.15.123:0/3128872572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40736a0 msgr2=0x7f4dc415ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.881+0000 7f4dc259c640 1 -- 172.21.15.123:0/3128872572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4037070 con 0x7f4dc40736a0 2024-09-19T09:48:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.881+0000 7f4dc924c640 1 --2- 172.21.15.123:0/3128872572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40736a0 0x7f4dc415ffd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40b47a0 tx=0x7f4db402a250 comp rx=0 tx=0).stop 2024-09-19T09:48:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.881+0000 7f4dc924c640 1 -- 172.21.15.123:0/3128872572 shutdown_connections 2024-09-19T09:48:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.881+0000 7f4dc924c640 1 --2- 172.21.15.123:0/3128872572 >> v2:172.21.15.194:3300/0 conn(0x7f4dc4159320 0x7f4dc4159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.881+0000 7f4dc924c640 1 --2- 172.21.15.123:0/3128872572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc40736a0 0x7f4dc415ffd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.881+0000 7f4dc924c640 1 -- 172.21.15.123:0/3128872572 >> 172.21.15.123:0/3128872572 conn(0x7f4dc40ced20 msgr2=0x7f4dc40cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.882+0000 7f4dc924c640 1 -- 172.21.15.123:0/3128872572 shutdown_connections 2024-09-19T09:48:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.882+0000 7f4dc924c640 1 -- 172.21.15.123:0/3128872572 wait complete. 2024-09-19T09:48:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.884+0000 7f4dc924c640 1 Processor -- start 2024-09-19T09:48:38.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.884+0000 7f4dc924c640 1 -- start start 2024-09-19T09:48:38.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.885+0000 7f4dc924c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc40736a0 0x7f4dc41f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.886+0000 7f4dc924c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4073a80 0x7f4dc4154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.886+0000 7f4dc2d9d640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc40736a0 msgr2=0x7f4dc41f80c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.886+0000 7f4dc2d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc40736a0 0x7f4dc41f80c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.886+0000 7f4dc924c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 0x7f4dc41eafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.886+0000 7f4dc924c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc40ca120 con 0x7f4dc4073a80 2024-09-19T09:48:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.887+0000 7f4dc359e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 0x7f4dc41eafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.887+0000 7f4dc359e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 0x7f4dc41eafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41598/0 (socket says 172.21.15.123:41598) 2024-09-19T09:48:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.888+0000 7f4dc359e640 1 -- 172.21.15.123:0/1156868611 learned_addr learned my addr 172.21.15.123:0/1156868611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.886+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4073a80 0x7f4dc4154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.888+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4071500 con 0x7f4dc40736a0 2024-09-19T09:48:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.888+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc40ca2a0 con 0x7f4dc4159320 2024-09-19T09:48:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dc359e640 1 -- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc40736a0 msgr2=0x7f4dc41f80c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dc359e640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc40736a0 0x7f4dc41f80c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dc359e640 1 -- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4073a80 msgr2=0x7f4dc4154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dc359e640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4073a80 0x7f4dc4154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dc359e640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc41f94d0 con 0x7f4dc4159320 2024-09-19T09:48:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dc359e640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 0x7f4dc41eafd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00be50 tx=0x7f4dbc00be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.889+0000 7f4dbbfff640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4073a80 0x7f4dc4154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:48:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.890+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc016430 con 0x7f4dc4159320 2024-09-19T09:48:38.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.890+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc41f7300 con 0x7f4dc4159320 2024-09-19T09:48:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.891+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc41f78c0 con 0x7f4dc4159320 2024-09-19T09:48:38.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.901+0000 7f4db97fa640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c005290 con 0x7f4dc4159320 2024-09-19T09:48:38.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.901+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc010030 con 0x7f4dc4159320 2024-09-19T09:48:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.904+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0167f0 con 0x7f4dc4159320 2024-09-19T09:48:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.904+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4dbc0153e0 con 0x7f4dc4159320 2024-09-19T09:48:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.904+0000 7f4dbb7fe640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4da806c3b0 0x7f4da806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.905+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f4dbc08b9f0 con 0x7f4dc4159320 2024-09-19T09:48:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.905+0000 7f4dc2d9d640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4da806c3b0 0x7f4da806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.906+0000 7f4dc2d9d640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4da806c3b0 0x7f4da806e870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4db4034000 tx=0x7f4db402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:38.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:38.911+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4dbc059b00 con 0x7f4dc4159320 2024-09-19T09:48:39.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.462+0000 7f4db97fa640 1 -- 172.21.15.123:0/1156868611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4d9c005580 con 0x7f4dc4159320 2024-09-19T09:48:39.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.463+0000 7f4dbb7fe640 1 -- 172.21.15.123:0/1156868611 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f4dbc05de00 con 0x7f4dc4159320 2024-09-19T09:48:39.465 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4da806c3b0 msgr2=0x7f4da806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4da806c3b0 0x7f4da806e870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4db4034000 tx=0x7f4db402e000 comp rx=0 tx=0).stop 2024-09-19T09:48:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 msgr2=0x7f4dc41eafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 0x7f4dc41eafd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00be50 tx=0x7f4dbc00be80 comp rx=0 tx=0).stop 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 shutdown_connections 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4da806c3b0 0x7f4da806e870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dc4159320 0x7f4dc41eafd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4dc4073a80 0x7f4dc4154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 --2- 172.21.15.123:0/1156868611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc40736a0 0x7f4dc41f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 >> 172.21.15.123:0/1156868611 conn(0x7f4dc40ced20 msgr2=0x7f4dc40c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 shutdown_connections 2024-09-19T09:48:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:39.469+0000 7f4dc924c640 1 -- 172.21.15.123:0/1156868611 wait complete. 2024-09-19T09:48:42.491 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.724+0000 7f975744c640 1 Processor -- start 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.725+0000 7f975744c640 1 -- start start 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.726+0000 7f975744c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9748005db0 0x7f9748007a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.726+0000 7f975744c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97480e2fc0 0x7f97480e3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.726+0000 7f975744c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97480e3970 con 0x7f97480076a0 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.726+0000 7f975744c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f97480e2ac0 con 0x7f9748005db0 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.726+0000 7f975744c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9748046070 con 0x7f97480e2fc0 2024-09-19T09:48:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.727+0000 7f97549e7640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f9748005db0 msgr2=0x7f9748007a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:42.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.727+0000 7f97549e7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9748005db0 0x7f9748007a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:42.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.727+0000 7f97551e8640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f97480076a0 0x7f9748006b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42616/0 (socket says 172.21.15.123:42616) 2024-09-19T09:48:42.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.728+0000 7f97551e8640 1 -- 172.21.15.123:0/1501215971 learned_addr learned my addr 172.21.15.123:0/1501215971 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:48:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.730+0000 7f97559e9640 1 --2- 172.21.15.123:0/1501215971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97480e2fc0 0x7f97480e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.732+0000 7f97559e9640 1 -- 172.21.15.123:0/1501215971 >> v2:172.21.15.194:3300/0 conn(0x7f9748005db0 msgr2=0x7f9748007a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.732+0000 7f97559e9640 1 --2- 172.21.15.123:0/1501215971 >> v2:172.21.15.194:3300/0 conn(0x7f9748005db0 0x7f9748007a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.732+0000 7f97559e9640 1 -- 172.21.15.123:0/1501215971 >> v1:172.21.15.123:6789/0 conn(0x7f97480076a0 legacy=0x7f9748006b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.732+0000 7f97559e9640 1 -- 172.21.15.123:0/1501215971 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748046350 con 0x7f97480e2fc0 2024-09-19T09:48:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.733+0000 7f97559e9640 1 --2- 172.21.15.123:0/1501215971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97480e2fc0 0x7f97480e3430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f975006af60 tx=0x7f97500a7340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54c10125438e401 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:42.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.737+0000 7f9747fff640 1 -- 172.21.15.123:0/1501215971 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500b4070 con 0x7f97480e2fc0 2024-09-19T09:48:42.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.737+0000 7f9747fff640 1 -- 172.21.15.123:0/1501215971 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97500af680 con 0x7f97480e2fc0 2024-09-19T09:48:42.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.737+0000 7f9747fff640 1 -- 172.21.15.123:0/1501215971 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500afaf0 con 0x7f97480e2fc0 2024-09-19T09:48:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 -- 172.21.15.123:0/1501215971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97480e2fc0 msgr2=0x7f97480e3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 --2- 172.21.15.123:0/1501215971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97480e2fc0 0x7f97480e3430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f975006af60 tx=0x7f97500a7340 comp rx=0 tx=0).stop 2024-09-19T09:48:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 -- 172.21.15.123:0/1501215971 shutdown_connections 2024-09-19T09:48:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 --2- 172.21.15.123:0/1501215971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97480e2fc0 0x7f97480e3430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 --2- 172.21.15.123:0/1501215971 >> v2:172.21.15.194:3300/0 conn(0x7f9748005db0 0x7f9748007a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 -- 172.21.15.123:0/1501215971 >> 172.21.15.123:0/1501215971 conn(0x7f9748050580 msgr2=0x7f9748050960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 -- 172.21.15.123:0/1501215971 shutdown_connections 2024-09-19T09:48:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.738+0000 7f975744c640 1 -- 172.21.15.123:0/1501215971 wait complete. 2024-09-19T09:48:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.740+0000 7f975744c640 1 Processor -- start 2024-09-19T09:48:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.740+0000 7f975744c640 1 -- start start 2024-09-19T09:48:42.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.742+0000 7f975744c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9748005db0 0x7f9748034590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:42.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.742+0000 7f975744c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 0x7f97481815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.742+0000 7f97549e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 0x7f97481815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.742+0000 7f97549e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 0x7f97481815b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45772/0 (socket says 172.21.15.123:45772) 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.742+0000 7f97549e7640 1 -- 172.21.15.123:0/4071052272 learned_addr learned my addr 172.21.15.123:0/4071052272 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f975744c640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97480e2fc0 0x7f974816c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f975744c640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9748049d10 con 0x7f97480076a0 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f975744c640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9748046910 con 0x7f97480e2fc0 2024-09-19T09:48:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f975744c640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9748049e90 con 0x7f9748005db0 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f97549e7640 1 -- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9748005db0 msgr2=0x7f9748034590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f97549e7640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9748005db0 0x7f9748034590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f97549e7640 1 -- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97480e2fc0 msgr2=0x7f974816c320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f97549e7640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97480e2fc0 0x7f974816c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.743+0000 7f97549e7640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748034dc0 con 0x7f97480076a0 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.744+0000 7f97549e7640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 0x7f97481815b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f974000b7b0 tx=0x7f974000bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.745+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740003bb0 con 0x7f97480076a0 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.745+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9740010070 con 0x7f97480076a0 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.745+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740005070 con 0x7f97480076a0 2024-09-19T09:48:42.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.745+0000 7f975744c640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9748035030 con 0x7f97480076a0 2024-09-19T09:48:42.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.747+0000 7f975744c640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97480355f0 con 0x7f97480076a0 2024-09-19T09:48:42.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.749+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9740005210 con 0x7f97480076a0 2024-09-19T09:48:42.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.749+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97480479a0 con 0x7f97480076a0 2024-09-19T09:48:42.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.752+0000 7f9745ffb640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f973406c3b0 0x7f973406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:42.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.752+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f974008a180 con 0x7f97480076a0 2024-09-19T09:48:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.758+0000 7f97551e8640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f973406c3b0 0x7f973406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.759+0000 7f97551e8640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f973406c3b0 0x7f973406e870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f974c001580 tx=0x7f974c007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:42.759+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f97400588f0 con 0x7f97480076a0 2024-09-19T09:48:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.341+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f974804cad0 con 0x7f97480076a0 2024-09-19T09:48:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.342+0000 7f9745ffb640 1 -- 172.21.15.123:0/4071052272 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f97400581f0 con 0x7f97480076a0 2024-09-19T09:48:43.344 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:43.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f973406c3b0 msgr2=0x7f973406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:43.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f973406c3b0 0x7f973406e870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f974c001580 tx=0x7f974c007a40 comp rx=0 tx=0).stop 2024-09-19T09:48:43.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 msgr2=0x7f97481815b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:43.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 0x7f97481815b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f974000b7b0 tx=0x7f974000bc70 comp rx=0 tx=0).stop 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 shutdown_connections 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97480e2fc0 0x7f974816c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97480076a0 0x7f97481815b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.345+0000 7f97337fe640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f973406c3b0 0x7f973406e870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.346+0000 7f97337fe640 1 --2- 172.21.15.123:0/4071052272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9748005db0 0x7f9748034590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.346+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 >> 172.21.15.123:0/4071052272 conn(0x7f9748050580 msgr2=0x7f974804ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.346+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 shutdown_connections 2024-09-19T09:48:43.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:43.350+0000 7f97337fe640 1 -- 172.21.15.123:0/4071052272 wait complete. 2024-09-19T09:48:46.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.575+0000 7f36958d0640 1 Processor -- start 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.575+0000 7f36958d0640 1 -- start start 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f36958d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f36958d0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f36958d0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36880e3560 con 0x7f36880e29e0 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f36958d0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3688045970 con 0x7f368804a6a0 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f36958d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f36880dd190 con 0x7f36880dcdb0 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f368e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f368e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39924/0 (socket says 172.21.15.123:39924) 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.576+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 learned_addr learned my addr 172.21.15.123:0/3046890280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.577+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.577+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.577+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.577+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.577+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:46.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.577+0000 7f368f7fe640 1 -- 172.21.15.123:0/3046890280 >> v1:172.21.15.194:6789/0 conn(0x7f36880e29e0 legacy=0x7f36880e2e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:46.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.579+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:48:46.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.579+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:46.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.579+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:46.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.579+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.778+0000 7f368f7fe640 1 -- 172.21.15.123:0/3046890280 >> v1:172.21.15.194:6789/0 conn(0x7f36880e29e0 legacy=0x7f36880e2e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.778+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.778+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:48:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.778+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.778+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:46.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.778+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:48:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.780+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.780+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:48:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.780+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.780+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:46.780+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:48:47.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.179+0000 7f368f7fe640 1 -- 172.21.15.123:0/3046890280 >> v1:172.21.15.194:6789/0 conn(0x7f36880e29e0 legacy=0x7f36880e2e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:47.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.179+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:47.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.179+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:48:47.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.179+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:47.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.179+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:47.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.179+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:48:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.185+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.185+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:48:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.185+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.185+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:47.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.185+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:48:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.980+0000 7f368f7fe640 1 -- 172.21.15.123:0/3046890280 >> v1:172.21.15.194:6789/0 conn(0x7f36880e29e0 legacy=0x7f36880e2e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.980+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.980+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:48:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.980+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.980+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:47.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.980+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:48:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.986+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.988+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:48:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.988+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:48:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.988+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:48:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:47.988+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:48:49.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 msgr2=0x7f3688045e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880dcdb0 0x7f3688045e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 msgr2=0x7f368804aaa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.123:3300/0 conn(0x7f368804a6a0 0x7f368804aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 -- 172.21.15.123:0/3046890280 >> v1:172.21.15.194:6789/0 conn(0x7f36880e29e0 legacy=0x7f36880e2e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.194:3300/0 conn(0x7f367c007400 0x7f367c0098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 -- 172.21.15.123:0/3046890280 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36880e3810 con 0x7f367c0036c0 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368cff9640 1 -- 172.21.15.123:0/3046890280 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f36880dd190 con 0x7f367c007400 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.194:3300/0 conn(0x7f367c007400 msgr2=0x7f367c0098c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:49.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.576+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.194:3300/0 conn(0x7f367c007400 0x7f367c0098c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:49.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.577+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463370825 0 0) 0x7f36880e3810 con 0x7f367c0036c0 2024-09-19T09:48:49.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.577+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3678003520 con 0x7f367c0036c0 2024-09-19T09:48:49.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3286812259 0 0) 0x7f3678003520 con 0x7f367c0036c0 2024-09-19T09:48:49.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 >> v2:172.21.15.194:3300/0 conn(0x7f367c007400 msgr2=0x7f367c0098c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:49.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 --2- 172.21.15.123:0/3046890280 >> v2:172.21.15.194:3300/0 conn(0x7f367c007400 0x7f367c0098c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36880e3560 con 0x7f367c0036c0 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f368000d580 con 0x7f367c0036c0 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 >> v1:172.21.15.123:6789/0 conn(0x7f367c0036c0 legacy=0x7f367c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368f7fe640 1 -- 172.21.15.123:0/3046890280 reap_dead start 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f3678003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3678004800 0x7f3678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f367800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368effd640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 msgr2=0x7f3678003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368effd640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f3678003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f36880dd190 con 0x7f36780052e0 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f367800c230 con 0x7f36780039b0 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.578+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f367800c430 con 0x7f3678004800 2024-09-19T09:48:49.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3678004800 0x7f3678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368f7fe640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f367800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 msgr2=0x7f3678003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f3678003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 msgr2=0x7f367800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f367800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.579+0000 7f368e7fc640 1 -- 172.21.15.123:0/3046890280 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3678003520 con 0x7f3678004800 2024-09-19T09:48:49.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.581+0000 7f368e7fc640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3678004800 0x7f3678004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3690051500 tx=0x7f3678005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38faef7361120fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:49.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.581+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690076250 con 0x7f3678004800 2024-09-19T09:48:49.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.581+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36900ae450 con 0x7f3678004800 2024-09-19T09:48:49.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.581+0000 7f368dffb640 1 -- 172.21.15.123:0/3046890280 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900ae800 con 0x7f3678004800 2024-09-19T09:48:49.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 -- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3678004800 msgr2=0x7f3678004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3678004800 0x7f3678004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3690051500 tx=0x7f3678005830 comp rx=0 tx=0).stop 2024-09-19T09:48:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 -- 172.21.15.123:0/3046890280 shutdown_connections 2024-09-19T09:48:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f367800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3678004800 0x7f3678004c80 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3690051500 tx=0x7f3678005830 comp rx=0 tx=0).stop 2024-09-19T09:48:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 --2- 172.21.15.123:0/3046890280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f3678003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 -- 172.21.15.123:0/3046890280 >> 172.21.15.123:0/3046890280 conn(0x7f368804fc70 msgr2=0x7f3688050080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 -- 172.21.15.123:0/3046890280 shutdown_connections 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.583+0000 7f36958d0640 1 -- 172.21.15.123:0/3046890280 wait complete. 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.585+0000 7f36958d0640 1 Processor -- start 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.585+0000 7f36958d0640 1 -- start start 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f36958d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f36880340e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f36958d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f36880e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f36958d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880e0a70 0x7f36881a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f36958d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3688045320 con 0x7f36780052e0 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f36958d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3688045040 con 0x7f36780039b0 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f36958d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3688045600 con 0x7f36880e0a70 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.586+0000 7f368effd640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 msgr2=0x7f36880340e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.587+0000 7f368effd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f36880340e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:49.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.587+0000 7f368f7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880e0a70 0x7f36881a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.587+0000 7f368e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f36880e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.587+0000 7f368e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f36880e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39974/0 (socket says 172.21.15.123:39974) 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.587+0000 7f368e7fc640 1 -- 172.21.15.123:0/1235423808 learned_addr learned my addr 172.21.15.123:0/1235423808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.588+0000 7f368e7fc640 1 -- 172.21.15.123:0/1235423808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880e0a70 msgr2=0x7f36881a3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.588+0000 7f368e7fc640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880e0a70 0x7f36881a3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.588+0000 7f368e7fc640 1 -- 172.21.15.123:0/1235423808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 msgr2=0x7f36880340e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.588+0000 7f368e7fc640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f36880340e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.588+0000 7f368e7fc640 1 -- 172.21.15.123:0/1235423808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36880cb0b0 con 0x7f36780052e0 2024-09-19T09:48:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.589+0000 7f368e7fc640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f36880e0530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3690074e70 tx=0x7f36900749f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.589+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690086430 con 0x7f36780052e0 2024-09-19T09:48:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.589+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36880df770 con 0x7f36780052e0 2024-09-19T09:48:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.589+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36880dfd30 con 0x7f36780052e0 2024-09-19T09:48:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.590+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36900865d0 con 0x7f36780052e0 2024-09-19T09:48:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.590+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690086780 con 0x7f36780052e0 2024-09-19T09:48:49.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.593+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36900b6020 con 0x7f36780052e0 2024-09-19T09:48:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.594+0000 7f3677fff640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f367c06c9d0 0x7f367c06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.594+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f369008b070 con 0x7f36780052e0 2024-09-19T09:48:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.595+0000 7f368effd640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f367c06c9d0 0x7f367c06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.595+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3670005290 con 0x7f36780052e0 2024-09-19T09:48:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.595+0000 7f368effd640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f367c06c9d0 0x7f367c06ee90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f368000d6f0 tx=0x7f3680008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:49.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:49.605+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f36900e5c80 con 0x7f36780052e0 2024-09-19T09:48:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.093+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3670005580 con 0x7f36780052e0 2024-09-19T09:48:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.094+0000 7f3677fff640 1 -- 172.21.15.123:0/1235423808 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f36900e5580 con 0x7f36780052e0 2024-09-19T09:48:50.098 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":36,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.103+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f367c06c9d0 msgr2=0x7f367c06ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.103+0000 7f36958d0640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f367c06c9d0 0x7f367c06ee90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f368000d6f0 tx=0x7f3680008040 comp rx=0 tx=0).stop 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.103+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 msgr2=0x7f36880e0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.103+0000 7f36958d0640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f36880e0530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3690074e70 tx=0x7f36900749f0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.104+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 shutdown_connections 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.104+0000 7f36958d0640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f367c06c9d0 0x7f367c06ee90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.104+0000 7f36958d0640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36880e0a70 0x7f36881a3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.104+0000 7f36958d0640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36780052e0 0x7f36880e0530 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.104+0000 7f36958d0640 1 --2- 172.21.15.123:0/1235423808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36780039b0 0x7f36880340e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.104+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 >> 172.21.15.123:0/1235423808 conn(0x7f368804fc70 msgr2=0x7f3688005190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:50.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.107+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 shutdown_connections 2024-09-19T09:48:50.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.107+0000 7f36958d0640 1 -- 172.21.15.123:0/1235423808 wait complete. 2024-09-19T09:48:50.135 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:48:50.135 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:48:50.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:48:50.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.329+0000 7f1626318640 1 Processor -- start 2024-09-19T09:48:50.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.332+0000 7f1626318640 1 -- start start 2024-09-19T09:48:50.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f1626318640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 0x7f162006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f1626318640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f162006eb30 0x7f162006c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f1626318640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162006f040 con 0x7f1620157070 2024-09-19T09:48:50.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f1626318640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f162006f2e0 con 0x7f162006eb30 2024-09-19T09:48:50.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f1626318640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f162006f5c0 con 0x7f162014d930 2024-09-19T09:48:50.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f16248b5640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f162006eb30 msgr2=0x7f162006c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:50.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f161ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 0x7f162006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.333+0000 7f16248b5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f162006eb30 0x7f162006c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:50.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.334+0000 7f161f7fe640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7f1620157070 legacy=0x7f162006e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:50.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.334+0000 7f161ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 0x7f162006bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36598/0 (socket says 172.21.15.123:36598) 2024-09-19T09:48:50.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.334+0000 7f161ffff640 1 -- 172.21.15.123:0/775690364 learned_addr learned my addr 172.21.15.123:0/775690364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:50.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.335+0000 7f161ffff640 1 -- 172.21.15.123:0/775690364 >> v2:172.21.15.194:3300/0 conn(0x7f162006eb30 msgr2=0x7f162006c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:50.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.335+0000 7f161ffff640 1 --2- 172.21.15.123:0/775690364 >> v2:172.21.15.194:3300/0 conn(0x7f162006eb30 0x7f162006c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.335+0000 7f161ffff640 1 -- 172.21.15.123:0/775690364 >> v1:172.21.15.194:6789/0 conn(0x7f1620157070 legacy=0x7f162006e420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:50.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.335+0000 7f161ffff640 1 -- 172.21.15.123:0/775690364 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16200c7910 con 0x7f162014d930 2024-09-19T09:48:50.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.337+0000 7f161ffff640 1 --2- 172.21.15.123:0/775690364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 0x7f162006bf10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16140078a0 tx=0x7f161402aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae826b572eb6466 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.339+0000 7f161effd640 1 -- 172.21.15.123:0/775690364 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614004230 con 0x7f162014d930 2024-09-19T09:48:50.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.339+0000 7f161effd640 1 -- 172.21.15.123:0/775690364 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16140043d0 con 0x7f162014d930 2024-09-19T09:48:50.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.339+0000 7f161effd640 1 -- 172.21.15.123:0/775690364 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161402e860 con 0x7f162014d930 2024-09-19T09:48:50.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.343+0000 7f1626318640 1 -- 172.21.15.123:0/775690364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 msgr2=0x7f162006bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.343+0000 7f1626318640 1 --2- 172.21.15.123:0/775690364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 0x7f162006bf10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16140078a0 tx=0x7f161402aac0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.343+0000 7f1626318640 1 -- 172.21.15.123:0/775690364 shutdown_connections 2024-09-19T09:48:50.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.343+0000 7f1626318640 1 --2- 172.21.15.123:0/775690364 >> v2:172.21.15.194:3300/0 conn(0x7f162006eb30 0x7f162006c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.343+0000 7f1626318640 1 --2- 172.21.15.123:0/775690364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f162014d930 0x7f162006bf10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.343+0000 7f1626318640 1 -- 172.21.15.123:0/775690364 >> 172.21.15.123:0/775690364 conn(0x7f16200cc670 msgr2=0x7f16200cca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:50.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.346+0000 7f1626318640 1 -- 172.21.15.123:0/775690364 shutdown_connections 2024-09-19T09:48:50.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.347+0000 7f1626318640 1 -- 172.21.15.123:0/775690364 wait complete. 2024-09-19T09:48:50.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.349+0000 7f1626318640 1 Processor -- start 2024-09-19T09:48:50.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.349+0000 7f1626318640 1 -- start start 2024-09-19T09:48:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f1626318640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f162006eb30 0x7f1620156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f1626318640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162014d930 0x7f162015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f1626318640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1620157070 0x7f1620160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f1626318640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f162014dd10 con 0x7f162006eb30 2024-09-19T09:48:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f1626318640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f16200c7ed0 con 0x7f162014d930 2024-09-19T09:48:50.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f1626318640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f162014de90 con 0x7f1620157070 2024-09-19T09:48:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.350+0000 7f161ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f162006eb30 0x7f1620156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f162006eb30 0x7f1620156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39980/0 (socket says 172.21.15.123:39980) 2024-09-19T09:48:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 -- 172.21.15.123:0/1269019846 learned_addr learned my addr 172.21.15.123:0/1269019846 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f16248b5640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1620157070 0x7f1620160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161f7fe640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162014d930 msgr2=0x7f162015fac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:50.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161f7fe640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162014d930 0x7f162015fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1620157070 msgr2=0x7f1620160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1620157070 0x7f1620160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162014d930 msgr2=0x7f162015fac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162014d930 0x7f162015fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.351+0000 7f161ffff640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1620162ca0 con 0x7f162006eb30 2024-09-19T09:48:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.352+0000 7f161ffff640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f162006eb30 0x7f1620156380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f161402b0b0 tx=0x7f16140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.353+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614046070 con 0x7f162006eb30 2024-09-19T09:48:50.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.353+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1614003a40 con 0x7f162006eb30 2024-09-19T09:48:50.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.353+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614003e30 con 0x7f162006eb30 2024-09-19T09:48:50.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.354+0000 7f1626318640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16200c45e0 con 0x7f162006eb30 2024-09-19T09:48:50.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.354+0000 7f1626318640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1620162f40 con 0x7f162006eb30 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.359+0000 7f1626318640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 0x7f1620163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.359+0000 7f1626318640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16200c5d20 con 0x7f16200c5fe0 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.359+0000 7f161f7fe640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 0x7f1620163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.360+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1614049070 con 0x7f162006eb30 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.360+0000 7f161f7fe640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16200714b0 con 0x7f16200c5fe0 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.360+0000 7f161f7fe640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 0x7f1620163180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f162015b480 tx=0x7f161000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.361+0000 7f161cff9640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f160c06c2b0 0x7f160c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.361+0000 7f16248b5640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f160c06c2b0 0x7f160c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.362+0000 7f16248b5640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f160c06c2b0 0x7f160c06e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16201508b0 tx=0x7f1618009590 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.362+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f16140ac6b0 con 0x7f162006eb30 2024-09-19T09:48:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.362+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610016070 con 0x7f16200c5fe0 2024-09-19T09:48:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.363+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1610003d30 con 0x7f16200c5fe0 2024-09-19T09:48:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.363+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 msgr2=0x7f1620163180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.363+0000 7f161cff9640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 0x7f1620163180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f162015b480 tx=0x7f161000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.363+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 msgr2=0x7f1620163180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.363+0000 7f161cff9640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c5fe0 0x7f1620163180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.392+0000 7f16067fc640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 0x7f16201f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.393+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16200cd160 con 0x7f16200c4030 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.395+0000 7f161f7fe640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 0x7f16201f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.396+0000 7f161f7fe640 1 -- 172.21.15.123:0/1269019846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16201636c0 con 0x7f16200c4030 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.396+0000 7f161f7fe640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 0x7f16201f41a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1620069600 tx=0x7f1610005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.396+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610016030 con 0x7f16200c4030 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.397+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7f1610011400 con 0x7f16200c4030 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.397+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 msgr2=0x7f16201f41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.397+0000 7f161cff9640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 0x7f16201f41a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1620069600 tx=0x7f1610005980 comp rx=0 tx=0).stop 2024-09-19T09:48:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.397+0000 7f161cff9640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 msgr2=0x7f16201f41a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.397+0000 7f161cff9640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200c4030 0x7f16201f41a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 36, 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 33617, 2024-09-19T09:48:50.402 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:50.403 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:50.404 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:50.406 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:50.407 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:50.408 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:50.409 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.411 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:50.412 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:50.413 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.414 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.415 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:50.416 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.399+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f160c06c2b0 msgr2=0x7f160c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.399+0000 7f16067fc640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f160c06c2b0 0x7f160c06e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16201508b0 tx=0x7f1618009590 comp rx=0 tx=0).stop 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.399+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f162006eb30 msgr2=0x7f1620156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.399+0000 7f16067fc640 1 --2- 172.21.15.123:0/1269019846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f162006eb30 0x7f1620156380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f161402b0b0 tx=0x7f16140046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.400+0000 7f16248b5640 1 -- 172.21.15.123:0/1269019846 reap_dead start 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.400+0000 7f16248b5640 1 -- 172.21.15.123:0/1269019846 reap_dead start 2024-09-19T09:48:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.404+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 shutdown_connections 2024-09-19T09:48:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.404+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 >> 172.21.15.123:0/1269019846 conn(0x7f16200cc670 msgr2=0x7f16200c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.411+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 shutdown_connections 2024-09-19T09:48:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.412+0000 7f16067fc640 1 -- 172.21.15.123:0/1269019846 wait complete. 2024-09-19T09:48:50.455 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:48:50.455 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:48:50.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:48:50.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.638+0000 7f2b2fa77640 1 Processor -- start 2024-09-19T09:48:50.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.638+0000 7f2b2fa77640 1 -- start start 2024-09-19T09:48:50.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.640+0000 7f2b2fa77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b28151520 0x7f2b281571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.640+0000 7f2b2d813640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b28151520 0x7f2b281571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.640+0000 7f2b2d813640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b28151520 0x7f2b281571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40018/0 (socket says 172.21.15.123:40018) 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.640+0000 7f2b2d813640 1 -- 172.21.15.123:0/199695895 learned_addr learned my addr 172.21.15.123:0/199695895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.641+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b28072580 0x7f2b28072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.641+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b28158120 con 0x7f2b2815a760 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.641+0000 7f2b2d012640 1 -- 172.21.15.123:0/199695895 >> v1:172.21.15.194:6789/0 conn(0x7f2b2815a760 legacy=0x7f2b280c9200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.641+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2b280c75e0 con 0x7f2b28151520 2024-09-19T09:48:50.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.641+0000 7f2b2e014640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b28072580 0x7f2b28072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.641+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2b280720f0 con 0x7f2b28072580 2024-09-19T09:48:50.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.644+0000 7f2b2d813640 1 -- 172.21.15.123:0/199695895 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b28072580 msgr2=0x7f2b28072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:48:50.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.644+0000 7f2b2d813640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b28072580 0x7f2b28072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.644+0000 7f2b2d813640 1 -- 172.21.15.123:0/199695895 >> v1:172.21.15.194:6789/0 conn(0x7f2b2815a760 legacy=0x7f2b280c9200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:48:50.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.644+0000 7f2b2d813640 1 -- 172.21.15.123:0/199695895 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b28157880 con 0x7f2b28151520 2024-09-19T09:48:50.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.645+0000 7f2b2d813640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281571f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009870 tx=0x7f2b1802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3b934ed19bc776 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.646+0000 7f2b2c811640 1 -- 172.21.15.123:0/199695895 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18037070 con 0x7f2b28151520 2024-09-19T09:48:50.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.646+0000 7f2b2c811640 1 -- 172.21.15.123:0/199695895 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b18032440 con 0x7f2b28151520 2024-09-19T09:48:50.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.646+0000 7f2b2c811640 1 -- 172.21.15.123:0/199695895 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18032850 con 0x7f2b28151520 2024-09-19T09:48:50.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.648+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 msgr2=0x7f2b281571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.648+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281571f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009870 tx=0x7f2b1802a2c0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.650+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 shutdown_connections 2024-09-19T09:48:50.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.650+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b28072580 0x7f2b28072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.650+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/199695895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281571f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.650+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 >> 172.21.15.123:0/199695895 conn(0x7f2b2806ed00 msgr2=0x7f2b2806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:50.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.654+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 shutdown_connections 2024-09-19T09:48:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.654+0000 7f2b2fa77640 1 -- 172.21.15.123:0/199695895 wait complete. 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.656+0000 7f2b2fa77640 1 Processor -- start 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.656+0000 7f2b2fa77640 1 -- start start 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.657+0000 7f2b2fa77640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b28072580 0x7f2b28154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.657+0000 7f2b2fa77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281e2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2d813640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b28072580 msgr2=0x7f2b28154e50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2d813640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b28072580 0x7f2b28154e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2d012640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2fa77640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b2815a760 0x7f2b28200e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2fa77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2b28071d80 con 0x7f2b28151520 2024-09-19T09:48:50.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2fa77640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2b28157e40 con 0x7f2b28072580 2024-09-19T09:48:50.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2fa77640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2b280c6c10 con 0x7f2b2815a760 2024-09-19T09:48:50.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2d012640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281e2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40022/0 (socket says 172.21.15.123:40022) 2024-09-19T09:48:50.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.658+0000 7f2b2d012640 1 -- 172.21.15.123:0/2849485751 learned_addr learned my addr 172.21.15.123:0/2849485751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:48:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.659+0000 7f2b2d012640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b2815a760 msgr2=0x7f2b28200e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:48:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.659+0000 7f2b2d012640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b2815a760 0x7f2b28200e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.659+0000 7f2b2d012640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b28072580 msgr2=0x7f2b28154e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:48:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.659+0000 7f2b2d012640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b28072580 0x7f2b28154e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.659+0000 7f2b2d012640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b281549e0 con 0x7f2b28151520 2024-09-19T09:48:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.659+0000 7f2b2d012640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281e2890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400b550 tx=0x7f2b2400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.663+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24013020 con 0x7f2b28151520 2024-09-19T09:48:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.663+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b24003dc0 con 0x7f2b28151520 2024-09-19T09:48:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.663+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b240052b0 con 0x7f2b28151520 2024-09-19T09:48:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.663+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b28153e60 con 0x7f2b28151520 2024-09-19T09:48:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.663+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b28154420 con 0x7f2b28151520 2024-09-19T09:48:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.665+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 0x7f2b282013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.665+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2b28200b90 con 0x7f2b281525e0 2024-09-19T09:48:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.668+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b24016020 con 0x7f2b28151520 2024-09-19T09:48:50.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.669+0000 7f2b1e7fc640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2b0c06c2b0 0x7f2b0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.669+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f2b2408b120 con 0x7f2b28151520 2024-09-19T09:48:50.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.670+0000 7f2b2e014640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2b0c06c2b0 0x7f2b0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.671+0000 7f2b2e014640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2b0c06c2b0 0x7f2b0c06e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b281eba20 tx=0x7f2b2000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.672+0000 7f2b2d813640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 0x7f2b282013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.673+0000 7f2b2d813640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b28151900 con 0x7f2b281525e0 2024-09-19T09:48:50.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.674+0000 7f2b2d813640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 0x7f2b282013b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b280c3b40 tx=0x7f2b180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.674+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18042070 con 0x7f2b281525e0 2024-09-19T09:48:50.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.678+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2b18009470 con 0x7f2b281525e0 2024-09-19T09:48:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.679+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 msgr2=0x7f2b282013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.679+0000 7f2b1e7fc640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 0x7f2b282013b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b280c3b40 tx=0x7f2b180046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.679+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 msgr2=0x7f2b282013b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:50.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.679+0000 7f2b1e7fc640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281525e0 0x7f2b282013b0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b280c3b40 tx=0x7f2b180046c0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.690+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 0x7f2b2814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:50.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.691+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2b281e3270 con 0x7f2b281545f0 2024-09-19T09:48:50.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.691+0000 7f2b2d813640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 0x7f2b2814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:50.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.692+0000 7f2b2d813640 1 -- 172.21.15.123:0/2849485751 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2b28071360 con 0x7f2b281545f0 2024-09-19T09:48:50.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.693+0000 7f2b2d813640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 0x7f2b2814d760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b18000c00 tx=0x7f2b18009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:50.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.693+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18037040 con 0x7f2b281545f0 2024-09-19T09:48:50.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.695+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5186 (secure 0 0 0) 0x7f2b18003df0 con 0x7f2b281545f0 2024-09-19T09:48:50.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.695+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 msgr2=0x7f2b2814d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.695+0000 7f2b1e7fc640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 0x7f2b2814d760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b18000c00 tx=0x7f2b18009240 comp rx=0 tx=0).stop 2024-09-19T09:48:50.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.695+0000 7f2b1e7fc640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 msgr2=0x7f2b2814d760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:48:50.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.695+0000 7f2b1e7fc640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b281545f0 0x7f2b2814d760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 36, 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 140011, 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:48:50.698 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:50.699 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:50.700 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:48:50.701 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:48:50.702 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.703 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.704 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:50.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.706 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.707 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:48:50.708 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:48:50.709 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:50.710 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:50.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:48:50.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:48:50.713 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:48:50.713 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:48:50.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.700+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2b0c06c2b0 msgr2=0x7f2b0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.700+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2b0c06c2b0 0x7f2b0c06e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b281eba20 tx=0x7f2b2000b040 comp rx=0 tx=0).stop 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.700+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 msgr2=0x7f2b281e2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.700+0000 7f2b2fa77640 1 --2- 172.21.15.123:0/2849485751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b28151520 0x7f2b281e2890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400b550 tx=0x7f2b2400ba10 comp rx=0 tx=0).stop 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.700+0000 7f2b2e014640 1 -- 172.21.15.123:0/2849485751 reap_dead start 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.700+0000 7f2b2e014640 1 -- 172.21.15.123:0/2849485751 reap_dead start 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.701+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 shutdown_connections 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.701+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 >> 172.21.15.123:0/2849485751 conn(0x7f2b2806ed00 msgr2=0x7f2b28072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.701+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 shutdown_connections 2024-09-19T09:48:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:48:50.701+0000 7f2b2fa77640 1 -- 172.21.15.123:0/2849485751 wait complete. 2024-09-19T09:48:50.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:48:50.742 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:49:02.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:49:02.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:49:10.742 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:49:10.743 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-19T09:49:10.743 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:49:10.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:49:10.750 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:49:10.750 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:49:10.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:49:10.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.924+0000 7f0b9ea7b640 1 Processor -- start 2024-09-19T09:49:10.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.924+0000 7f0b9ea7b640 1 -- start start 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9ea7b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b98151880 0x7f0b980c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9ea7b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b98073d20 0x7f0b980c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9ea7b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b980c9950 con 0x7f0b981514a0 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9ea7b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980c8c00 con 0x7f0b98151880 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9ea7b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980c7be0 con 0x7f0b98073d20 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9d278640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b98151880 0x7f0b980c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9d278640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b98151880 0x7f0b980c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49370/0 (socket says 172.21.15.123:49370) 2024-09-19T09:49:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.926+0000 7f0b9d278640 1 -- 172.21.15.123:0/381273320 learned_addr learned my addr 172.21.15.123:0/381273320 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.927+0000 7f0b9d278640 1 -- 172.21.15.123:0/381273320 >> v2:172.21.15.194:3300/0 conn(0x7f0b98073d20 msgr2=0x7f0b980c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.927+0000 7f0b9d278640 1 --2- 172.21.15.123:0/381273320 >> v2:172.21.15.194:3300/0 conn(0x7f0b98073d20 0x7f0b980c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.927+0000 7f0b9d278640 1 -- 172.21.15.123:0/381273320 >> v1:172.21.15.194:6789/0 conn(0x7f0b981514a0 legacy=0x7f0b9806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:10.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.927+0000 7f0b9d278640 1 -- 172.21.15.123:0/381273320 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b980c8e30 con 0x7f0b98151880 2024-09-19T09:49:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.928+0000 7f0b9d278640 1 --2- 172.21.15.123:0/381273320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98151880 0x7f0b980c7db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b9806df60 tx=0x7f0b8802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affb875114f6521e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.928+0000 7f0b9ca77640 1 -- 172.21.15.123:0/381273320 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88037070 con 0x7f0b98151880 2024-09-19T09:49:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.928+0000 7f0b9ca77640 1 -- 172.21.15.123:0/381273320 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b88032440 con 0x7f0b98151880 2024-09-19T09:49:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.928+0000 7f0b9ca77640 1 -- 172.21.15.123:0/381273320 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88037070 con 0x7f0b98151880 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.929+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/381273320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98151880 msgr2=0x7f0b980c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.929+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/381273320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98151880 0x7f0b980c7db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b9806df60 tx=0x7f0b8802a2c0 comp rx=0 tx=0).stop 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.929+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/381273320 shutdown_connections 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.930+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/381273320 >> v2:172.21.15.194:3300/0 conn(0x7f0b98073d20 0x7f0b980c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.930+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/381273320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98151880 0x7f0b980c7db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.930+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/381273320 >> 172.21.15.123:0/381273320 conn(0x7f0b9806f680 msgr2=0x7f0b9806fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:10.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.930+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/381273320 shutdown_connections 2024-09-19T09:49:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.930+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/381273320 wait complete. 2024-09-19T09:49:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.932+0000 7f0b9ea7b640 1 Processor -- start 2024-09-19T09:49:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.932+0000 7f0b9ea7b640 1 -- start start 2024-09-19T09:49:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.934+0000 7f0b9ea7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 0x7f0b981566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.934+0000 7f0b9ea7b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b981514a0 0x7f0b980cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.934+0000 7f0b9ea7b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b98151880 0x7f0b98145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.934+0000 7f0b9ea7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980c9670 con 0x7f0b98073d20 2024-09-19T09:49:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.934+0000 7f0b9ea7b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980c9390 con 0x7f0b981514a0 2024-09-19T09:49:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.934+0000 7f0b9ea7b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0b98157490 con 0x7f0b98151880 2024-09-19T09:49:10.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.935+0000 7f0b9da79640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 0x7f0b981566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:10.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.935+0000 7f0b9da79640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 0x7f0b981566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49384/0 (socket says 172.21.15.123:49384) 2024-09-19T09:49:10.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.935+0000 7f0b9da79640 1 -- 172.21.15.123:0/578399122 learned_addr learned my addr 172.21.15.123:0/578399122 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:10.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.935+0000 7f0b9e27a640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b98151880 0x7f0b98145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9da79640 1 -- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b98151880 msgr2=0x7f0b98145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9da79640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b98151880 0x7f0b98145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:10.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9da79640 1 -- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b981514a0 msgr2=0x7f0b980cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:10.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9da79640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b981514a0 0x7f0b980cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9da79640 1 -- 172.21.15.123:0/578399122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9814ecc0 con 0x7f0b98073d20 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9da79640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 0x7f0b981566a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b3e0 tx=0x7f0b9400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94015020 con 0x7f0b98073d20 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b94011850 con 0x7f0b98073d20 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94011c40 con 0x7f0b98073d20 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.936+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9814ef60 con 0x7f0b98073d20 2024-09-19T09:49:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.939+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9814f510 con 0x7f0b98073d20 2024-09-19T09:49:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.941+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0b94018020 con 0x7f0b98073d20 2024-09-19T09:49:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.941+0000 7f0b8e7fc640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b7c06c300 0x7f0b7c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.943+0000 7f0b9d278640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b7c06c300 0x7f0b7c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.944+0000 7f0b9d278640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b7c06c300 0x7f0b7c06e7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b88034000 tx=0x7f0b8802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.944+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9806e560 con 0x7f0b98073d20 2024-09-19T09:49:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.955+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f0b9408f060 con 0x7f0b98073d20 2024-09-19T09:49:10.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:10.964+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0b94058e00 con 0x7f0b98073d20 2024-09-19T09:49:11.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.483+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0b9814b740 con 0x7f0b98073d20 2024-09-19T09:49:11.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.484+0000 7f0b8e7fc640 1 -- 172.21.15.123:0/578399122 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f0b94058700 con 0x7f0b98073d20 2024-09-19T09:49:11.487 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":36,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:49:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.488+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b7c06c300 msgr2=0x7f0b7c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.488+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b7c06c300 0x7f0b7c06e7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b88034000 tx=0x7f0b8802c000 comp rx=0 tx=0).stop 2024-09-19T09:49:11.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.488+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 msgr2=0x7f0b981566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.488+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 0x7f0b981566a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b3e0 tx=0x7f0b9400b8a0 comp rx=0 tx=0).stop 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.489+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 shutdown_connections 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.489+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f0b7c06c300 0x7f0b7c06e7c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.489+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b98151880 0x7f0b98145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.489+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b981514a0 0x7f0b980cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.489+0000 7f0b9ea7b640 1 --2- 172.21.15.123:0/578399122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b98073d20 0x7f0b981566a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.489+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 >> 172.21.15.123:0/578399122 conn(0x7f0b9806f680 msgr2=0x7f0b9806fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:11.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.490+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 shutdown_connections 2024-09-19T09:49:11.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:11.491+0000 7f0b9ea7b640 1 -- 172.21.15.123:0/578399122 wait complete. 2024-09-19T09:49:14.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:49:14.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.713+0000 7f925b59e640 1 Processor -- start 2024-09-19T09:49:14.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.713+0000 7f925b59e640 1 -- start start 2024-09-19T09:49:14.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925b59e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92540dcd90 0x7f9254045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:14.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925b59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92540e6640 0x7f925404aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925b59e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92540e6a70 con 0x7f925404a680 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925b59e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9254044d40 con 0x7f92540e6640 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925b59e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f92540dd170 con 0x7f92540dcd90 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92540e6640 0x7f925404aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92540e6640 0x7f925404aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48984/0 (socket says 172.21.15.123:48984) 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.715+0000 7f925ad9d640 1 -- 172.21.15.123:0/3623596073 learned_addr learned my addr 172.21.15.123:0/3623596073 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.716+0000 7f925a59c640 1 --2- 172.21.15.123:0/3623596073 >> v2:172.21.15.194:3300/0 conn(0x7f92540dcd90 0x7f9254045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.716+0000 7f925ad9d640 1 -- 172.21.15.123:0/3623596073 >> v2:172.21.15.194:3300/0 conn(0x7f92540dcd90 msgr2=0x7f9254045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.716+0000 7f925ad9d640 1 --2- 172.21.15.123:0/3623596073 >> v2:172.21.15.194:3300/0 conn(0x7f92540dcd90 0x7f9254045d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.716+0000 7f925ad9d640 1 -- 172.21.15.123:0/3623596073 >> v1:172.21.15.194:6789/0 conn(0x7f925404a680 legacy=0x7f92540e5f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:14.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.716+0000 7f925ad9d640 1 -- 172.21.15.123:0/3623596073 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92540e6d30 con 0x7f92540e6640 2024-09-19T09:49:14.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.718+0000 7f925ad9d640 1 --2- 172.21.15.123:0/3623596073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540e6640 0x7f925404aab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9254044ec0 tx=0x7f925002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb4e5971dc8ac75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:14.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.718+0000 7f925959a640 1 -- 172.21.15.123:0/3623596073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250037070 con 0x7f92540e6640 2024-09-19T09:49:14.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.718+0000 7f925959a640 1 -- 172.21.15.123:0/3623596073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9250032440 con 0x7f92540e6640 2024-09-19T09:49:14.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.719+0000 7f925959a640 1 -- 172.21.15.123:0/3623596073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250032810 con 0x7f92540e6640 2024-09-19T09:49:14.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 -- 172.21.15.123:0/3623596073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540e6640 msgr2=0x7f925404aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:14.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 --2- 172.21.15.123:0/3623596073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540e6640 0x7f925404aab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9254044ec0 tx=0x7f925002a2c0 comp rx=0 tx=0).stop 2024-09-19T09:49:14.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 -- 172.21.15.123:0/3623596073 shutdown_connections 2024-09-19T09:49:14.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 --2- 172.21.15.123:0/3623596073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540e6640 0x7f925404aab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:14.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 --2- 172.21.15.123:0/3623596073 >> v2:172.21.15.194:3300/0 conn(0x7f92540dcd90 0x7f9254045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:14.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 -- 172.21.15.123:0/3623596073 >> 172.21.15.123:0/3623596073 conn(0x7f925404fc50 msgr2=0x7f9254050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:14.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.720+0000 7f925b59e640 1 -- 172.21.15.123:0/3623596073 shutdown_connections 2024-09-19T09:49:14.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.721+0000 7f925b59e640 1 -- 172.21.15.123:0/3623596073 wait complete. 2024-09-19T09:49:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.723+0000 7f925b59e640 1 Processor -- start 2024-09-19T09:49:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.723+0000 7f925b59e640 1 -- start start 2024-09-19T09:49:14.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.725+0000 7f925b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 0x7f92540dd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:14.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.725+0000 7f925a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 0x7f92540dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:14.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 0x7f92540dd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48990/0 (socket says 172.21.15.123:48990) 2024-09-19T09:49:14.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925b59e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92540dcd90 0x7f9254179020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:14.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925b59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540e6640 0x7f925416c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:14.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925b59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9254045550 con 0x7f925404a680 2024-09-19T09:49:14.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925b59e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9254045270 con 0x7f92540dcd90 2024-09-19T09:49:14.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925b59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9254045830 con 0x7f92540e6640 2024-09-19T09:49:14.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.726+0000 7f925a59c640 1 -- 172.21.15.123:0/1527920358 learned_addr learned my addr 172.21.15.123:0/1527920358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:14.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.729+0000 7f925a59c640 1 -- 172.21.15.123:0/1527920358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540e6640 msgr2=0x7f925416c800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:49:14.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.729+0000 7f925a59c640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540e6640 0x7f925416c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:14.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.729+0000 7f925a59c640 1 -- 172.21.15.123:0/1527920358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92540dcd90 msgr2=0x7f9254179020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:49:14.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.729+0000 7f925a59c640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92540dcd90 0x7f9254179020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:14.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.729+0000 7f925a59c640 1 -- 172.21.15.123:0/1527920358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925416d670 con 0x7f925404a680 2024-09-19T09:49:14.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.734+0000 7f925a59c640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 0x7f92540dd540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f925c074e70 tx=0x7f925c069a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:14.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.735+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c096470 con 0x7f925404a680 2024-09-19T09:49:14.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.735+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c091070 con 0x7f925404a680 2024-09-19T09:49:14.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.735+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c096810 con 0x7f925404a680 2024-09-19T09:49:14.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.735+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925416d910 con 0x7f925404a680 2024-09-19T09:49:14.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.738+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925416ded0 con 0x7f925404a680 2024-09-19T09:49:14.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.738+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f925c0953d0 con 0x7f925404a680 2024-09-19T09:49:14.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.739+0000 7f924affd640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f923c06c300 0x7f923c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:14.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.739+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f925c109da0 con 0x7f925404a680 2024-09-19T09:49:14.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.742+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925400b750 con 0x7f925404a680 2024-09-19T09:49:14.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.750+0000 7f9259d9b640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f923c06c300 0x7f923c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:14.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.751+0000 7f9259d9b640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f923c06c300 0x7f923c06e7c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f92540e2860 tx=0x7f924c006bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:14.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:14.757+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f925400b750 con 0x7f925404a680 2024-09-19T09:49:15.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.283+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f92540e2be0 con 0x7f925404a680 2024-09-19T09:49:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.284+0000 7f924affd640 1 -- 172.21.15.123:0/1527920358 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f925c0d6200 con 0x7f925404a680 2024-09-19T09:49:15.289 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":36,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:49:15.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.290+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f923c06c300 msgr2=0x7f923c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:15.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.290+0000 7f925b59e640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f923c06c300 0x7f923c06e7c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f92540e2860 tx=0x7f924c006bd0 comp rx=0 tx=0).stop 2024-09-19T09:49:15.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.290+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 msgr2=0x7f92540dd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:15.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.290+0000 7f925b59e640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 0x7f92540dd540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f925c074e70 tx=0x7f925c069a30 comp rx=0 tx=0).stop 2024-09-19T09:49:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 shutdown_connections 2024-09-19T09:49:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f923c06c300 0x7f923c06e7c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540e6640 0x7f925416c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92540dcd90 0x7f9254179020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 --2- 172.21.15.123:0/1527920358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f925404a680 0x7f92540dd540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 >> 172.21.15.123:0/1527920358 conn(0x7f925404fc50 msgr2=0x7f9254005200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:15.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 shutdown_connections 2024-09-19T09:49:15.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:15.293+0000 7f925b59e640 1 -- 172.21.15.123:0/1527920358 wait complete. 2024-09-19T09:49:18.325 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:49:18.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.501+0000 7f669cdc1640 1 Processor -- start 2024-09-19T09:49:18.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.501+0000 7f669cdc1640 1 -- start start 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.502+0000 7f669cdc1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6698072830 0x7f6698070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.502+0000 7f669cdc1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66980733d0 0x7f6698073840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.502+0000 7f669cdc1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6698073d80 con 0x7f66980c4680 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.502+0000 7f669cdc1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6698158c20 con 0x7f66980733d0 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.502+0000 7f669cdc1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f66980721f0 con 0x7f6698072830 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.503+0000 7f668effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66980c4680 0x7f669806cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50350/0 (socket says 172.21.15.123:50350) 2024-09-19T09:49:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.503+0000 7f668effd640 1 -- 172.21.15.123:0/2009348911 learned_addr learned my addr 172.21.15.123:0/2009348911 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:49:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.503+0000 7f66977fe640 1 --2- 172.21.15.123:0/2009348911 >> v2:172.21.15.194:3300/0 conn(0x7f6698072830 0x7f6698070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.503+0000 7f6697fff640 1 --2- 172.21.15.123:0/2009348911 >> v2:172.21.15.123:3300/0 conn(0x7f66980733d0 0x7f6698073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.504+0000 7f6697fff640 1 -- 172.21.15.123:0/2009348911 >> v2:172.21.15.194:3300/0 conn(0x7f6698072830 msgr2=0x7f6698070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.504+0000 7f6697fff640 1 --2- 172.21.15.123:0/2009348911 >> v2:172.21.15.194:3300/0 conn(0x7f6698072830 0x7f6698070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.504+0000 7f6696ffd640 1 -- 172.21.15.123:0/2009348911 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262972015 0 0) 0x7f6698073d80 con 0x7f66980c4680 2024-09-19T09:49:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.504+0000 7f6697fff640 1 -- 172.21.15.123:0/2009348911 >> v1:172.21.15.123:6789/0 conn(0x7f66980c4680 legacy=0x7f669806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.504+0000 7f6697fff640 1 -- 172.21.15.123:0/2009348911 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981586a0 con 0x7f66980733d0 2024-09-19T09:49:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.506+0000 7f6697fff640 1 --2- 172.21.15.123:0/2009348911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66980733d0 0x7f6698073840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6698074b70 tx=0x7f669002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d184b8f57b067ede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.507+0000 7f6696ffd640 1 -- 172.21.15.123:0/2009348911 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690037070 con 0x7f66980733d0 2024-09-19T09:49:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.507+0000 7f6696ffd640 1 -- 172.21.15.123:0/2009348911 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6690032440 con 0x7f66980733d0 2024-09-19T09:49:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.508+0000 7f669cdc1640 1 -- 172.21.15.123:0/2009348911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66980733d0 msgr2=0x7f6698073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.508+0000 7f669cdc1640 1 --2- 172.21.15.123:0/2009348911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66980733d0 0x7f6698073840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6698074b70 tx=0x7f669002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:49:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.511+0000 7f669cdc1640 1 -- 172.21.15.123:0/2009348911 shutdown_connections 2024-09-19T09:49:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.511+0000 7f669cdc1640 1 --2- 172.21.15.123:0/2009348911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66980733d0 0x7f6698073840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.511+0000 7f669cdc1640 1 --2- 172.21.15.123:0/2009348911 >> v2:172.21.15.194:3300/0 conn(0x7f6698072830 0x7f6698070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.511+0000 7f669cdc1640 1 -- 172.21.15.123:0/2009348911 >> 172.21.15.123:0/2009348911 conn(0x7f669806fa40 msgr2=0x7f669806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.512+0000 7f669cdc1640 1 -- 172.21.15.123:0/2009348911 shutdown_connections 2024-09-19T09:49:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.512+0000 7f669cdc1640 1 -- 172.21.15.123:0/2009348911 wait complete. 2024-09-19T09:49:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.514+0000 7f669cdc1640 1 Processor -- start 2024-09-19T09:49:18.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.517+0000 7f669cdc1640 1 -- start start 2024-09-19T09:49:18.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.519+0000 7f669cdc1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 0x7f66981f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:18.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.520+0000 7f669cdc1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66980733d0 0x7f66981f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:18.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.520+0000 7f669cdc1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980c4680 0x7f66981f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:18.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f669cdc1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6698072eb0 con 0x7f6698072830 2024-09-19T09:49:18.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f669cdc1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6698158940 con 0x7f66980c4680 2024-09-19T09:49:18.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f66977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 0x7f66981f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:18.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f66977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 0x7f66981f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49008/0 (socket says 172.21.15.123:49008) 2024-09-19T09:49:18.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f66977fe640 1 -- 172.21.15.123:0/4218332874 learned_addr learned my addr 172.21.15.123:0/4218332874 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:18.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f668effd640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66980733d0 0x7f66981f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:18.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.521+0000 7f669cdc1640 1 -- 172.21.15.123:0/4218332874 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f6698152270 con 0x7f66980733d0 2024-09-19T09:49:18.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.522+0000 7f6697fff640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980c4680 0x7f66981f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:18.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.522+0000 7f66977fe640 1 -- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66980733d0 msgr2=0x7f66981f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.522+0000 7f66977fe640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66980733d0 0x7f66981f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.522+0000 7f66977fe640 1 -- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980c4680 msgr2=0x7f66981f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.523+0000 7f66977fe640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980c4680 0x7f66981f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.523+0000 7f66977fe640 1 -- 172.21.15.123:0/4218332874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669815bed0 con 0x7f6698072830 2024-09-19T09:49:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.523+0000 7f6697fff640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980c4680 0x7f66981f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.523+0000 7f66977fe640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 0x7f66981f65d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f668000d5f0 tx=0x7f668000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:18.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.524+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800125f0 con 0x7f6698072830 2024-09-19T09:49:18.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.524+0000 7f669cdc1640 1 -- 172.21.15.123:0/4218332874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669815ac10 con 0x7f6698072830 2024-09-19T09:49:18.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.524+0000 7f669cdc1640 1 -- 172.21.15.123:0/4218332874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669815b1d0 con 0x7f6698072830 2024-09-19T09:49:18.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.527+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66980c5750 con 0x7f6698072830 2024-09-19T09:49:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.528+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680019070 con 0x7f6698072830 2024-09-19T09:49:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.528+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800129d0 con 0x7f6698072830 2024-09-19T09:49:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.528+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6680012b70 con 0x7f6698072830 2024-09-19T09:49:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.529+0000 7f6694ff9640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f667806c3b0 0x7f667806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.529+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f668008b860 con 0x7f6698072830 2024-09-19T09:49:18.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.537+0000 7f668effd640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f667806c3b0 0x7f667806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:18.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.538+0000 7f668effd640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f667806c3b0 0x7f667806e870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6688001920 tx=0x7f66880018b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:18.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:18.538+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f66980c5750 con 0x7f6698072830 2024-09-19T09:49:19.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.058+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6698070560 con 0x7f6698072830 2024-09-19T09:49:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.060+0000 7f6694ff9640 1 -- 172.21.15.123:0/4218332874 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f668005a020 con 0x7f6698072830 2024-09-19T09:49:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:49:19.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f667806c3b0 msgr2=0x7f667806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f667806c3b0 0x7f667806e870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6688001920 tx=0x7f66880018b0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 msgr2=0x7f66981f65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 0x7f66981f65d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f668000d5f0 tx=0x7f668000dab0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 shutdown_connections 2024-09-19T09:49:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66980c4680 0x7f66981f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f667806c3b0 0x7f667806e870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66980733d0 0x7f66981f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 --2- 172.21.15.123:0/4218332874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6698072830 0x7f66981f65d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.065+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 >> 172.21.15.123:0/4218332874 conn(0x7f669806fa40 msgr2=0x7f66980cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.067+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 shutdown_connections 2024-09-19T09:49:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.067+0000 7f668dffb640 1 -- 172.21.15.123:0/4218332874 wait complete. 2024-09-19T09:49:19.091 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:49:19.091 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:49:19.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:49:19.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.293+0000 7fc3e5131640 1 Processor -- start 2024-09-19T09:49:19.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.294+0000 7fc3e5131640 1 -- start start 2024-09-19T09:49:19.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3e5131640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3e0151520 0x7fc3e01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3e5131640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc3e015a760 0x7fc3e00c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3e5131640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e0158120 con 0x7fc3e00c9740 2024-09-19T09:49:19.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3e5131640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e00c75e0 con 0x7fc3e0151520 2024-09-19T09:49:19.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3e5131640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e00720f0 con 0x7fc3e015a760 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3df59e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc3e00c9740 0x7fc3e0072580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50352/0 (socket says 172.21.15.123:50352) 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3df59e640 1 -- 172.21.15.123:0/3986274645 learned_addr learned my addr 172.21.15.123:0/3986274645 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.295+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3986274645 >> v2:172.21.15.194:3300/0 conn(0x7fc3e015a760 0x7fc3e00c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.296+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3986274645 >> v2:172.21.15.123:3300/0 conn(0x7fc3e0151520 0x7fc3e01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.296+0000 7fc3de59c640 1 -- 172.21.15.123:0/3986274645 >> v2:172.21.15.123:3300/0 conn(0x7fc3e0151520 msgr2=0x7fc3e01571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.296+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3986274645 >> v2:172.21.15.123:3300/0 conn(0x7fc3e0151520 0x7fc3e01571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.296+0000 7fc3de59c640 1 -- 172.21.15.123:0/3986274645 >> v1:172.21.15.123:6789/0 conn(0x7fc3e00c9740 legacy=0x7fc3e0072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.296+0000 7fc3de59c640 1 -- 172.21.15.123:0/3986274645 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e0157880 con 0x7fc3e015a760 2024-09-19T09:49:19.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.297+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3986274645 >> v2:172.21.15.123:3300/0 conn(0x7fc3e0151520 0x7fc3e01571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:19.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.297+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3986274645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e015a760 0x7fc3e00c9200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00c3b40 tx=0x7fc3d002e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b333cf87d02f5a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.299+0000 7fc3ddd9b640 1 -- 172.21.15.123:0/3986274645 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00357d0 con 0x7fc3e015a760 2024-09-19T09:49:19.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.299+0000 7fc3ddd9b640 1 -- 172.21.15.123:0/3986274645 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d003b070 con 0x7fc3e015a760 2024-09-19T09:49:19.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.299+0000 7fc3ddd9b640 1 -- 172.21.15.123:0/3986274645 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00357d0 con 0x7fc3e015a760 2024-09-19T09:49:19.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.300+0000 7fc3e5131640 1 -- 172.21.15.123:0/3986274645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e015a760 msgr2=0x7fc3e00c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.300+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3986274645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e015a760 0x7fc3e00c9200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00c3b40 tx=0x7fc3d002e960 comp rx=0 tx=0).stop 2024-09-19T09:49:19.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.303+0000 7fc3e5131640 1 -- 172.21.15.123:0/3986274645 shutdown_connections 2024-09-19T09:49:19.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.303+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3986274645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e015a760 0x7fc3e00c9200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.303+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3986274645 >> v2:172.21.15.123:3300/0 conn(0x7fc3e0151520 0x7fc3e01571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.303+0000 7fc3e5131640 1 -- 172.21.15.123:0/3986274645 >> 172.21.15.123:0/3986274645 conn(0x7fc3e006ed00 msgr2=0x7fc3e006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:19.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.304+0000 7fc3e5131640 1 -- 172.21.15.123:0/3986274645 shutdown_connections 2024-09-19T09:49:19.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.304+0000 7fc3e5131640 1 -- 172.21.15.123:0/3986274645 wait complete. 2024-09-19T09:49:19.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.307+0000 7fc3e5131640 1 Processor -- start 2024-09-19T09:49:19.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.307+0000 7fc3e5131640 1 -- start start 2024-09-19T09:49:19.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.308+0000 7fc3e5131640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e00c9740 0x7fc3e0125910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.308+0000 7fc3e5131640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3e0151520 0x7fc3e00c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.308+0000 7fc3e5131640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3e015a760 0x7fc3e00cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.308+0000 7fc3e5131640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0071d80 con 0x7fc3e015a760 2024-09-19T09:49:19.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.308+0000 7fc3e5131640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0157e40 con 0x7fc3e00c9740 2024-09-19T09:49:19.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.308+0000 7fc3e5131640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e00c6c10 con 0x7fc3e0151520 2024-09-19T09:49:19.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.309+0000 7fc3df59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3e015a760 0x7fc3e00cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.309+0000 7fc3df59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3e015a760 0x7fc3e00cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49030/0 (socket says 172.21.15.123:49030) 2024-09-19T09:49:19.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.309+0000 7fc3df59e640 1 -- 172.21.15.123:0/3121270676 learned_addr learned my addr 172.21.15.123:0/3121270676 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:19.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.309+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3e0151520 0x7fc3e00c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.309+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e00c9740 0x7fc3e0125910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.310+0000 7fc3de59c640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e00c9740 msgr2=0x7fc3e0125910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.310+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3e00c9740 0x7fc3e0125910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.310+0000 7fc3de59c640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3e015a760 msgr2=0x7fc3e00cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.310+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3e015a760 0x7fc3e00cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.310+0000 7fc3de59c640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e00cafc0 con 0x7fc3e0151520 2024-09-19T09:49:19.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.310+0000 7fc3de59c640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3e0151520 0x7fc3e00c2970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0037000 tx=0x7fc3d0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.312+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00357d0 con 0x7fc3e0151520 2024-09-19T09:49:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.312+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e01f5e50 con 0x7fc3e0151520 2024-09-19T09:49:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.313+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01f6130 con 0x7fc3e0151520 2024-09-19T09:49:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.316+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d0030040 con 0x7fc3e0151520 2024-09-19T09:49:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.316+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0036b90 con 0x7fc3e0151520 2024-09-19T09:49:19.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.319+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 0x7fc3c0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.319+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c0007ec0 con 0x7fc3c0002a70 2024-09-19T09:49:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.321+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc3d0048030 con 0x7fc3e0151520 2024-09-19T09:49:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.322+0000 7fc3c77fe640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc3cc06c380 0x7fc3cc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.322+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc3d00ac040 con 0x7fc3e0151520 2024-09-19T09:49:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.322+0000 7fc3df59e640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc3cc06c380 0x7fc3cc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.323+0000 7fc3df59e640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc3cc06c380 0x7fc3cc06e840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00cce50 tx=0x7fc3d4007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.323+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 0x7fc3c0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.324+0000 7fc3ded9d640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3c00080c0 con 0x7fc3c0002a70 2024-09-19T09:49:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.324+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 0x7fc3c0004f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8004960 tx=0x7fc3d8004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.325+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8015680 con 0x7fc3c0002a70 2024-09-19T09:49:19.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.325+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc3d801a070 con 0x7fc3c0002a70 2024-09-19T09:49:19.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.325+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 msgr2=0x7fc3c0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.325+0000 7fc3c77fe640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 0x7fc3c0004f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8004960 tx=0x7fc3d8004990 comp rx=0 tx=0).stop 2024-09-19T09:49:19.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.325+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 msgr2=0x7fc3c0004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:19.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.326+0000 7fc3c77fe640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0002a70 0x7fc3c0004f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.349+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 0x7fc3c0007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.349+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c000a4a0 con 0x7fc3c0006ee0 2024-09-19T09:49:19.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.352+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 0x7fc3c0007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.353+0000 7fc3ded9d640 1 -- 172.21.15.123:0/3121270676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3c00078b0 con 0x7fc3c0006ee0 2024-09-19T09:49:19.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.353+0000 7fc3ded9d640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 0x7fc3c0007370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8004960 tx=0x7fc3d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.356+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d801e620 con 0x7fc3c0006ee0 2024-09-19T09:49:19.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.356+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fc3d801e7c0 con 0x7fc3c0006ee0 2024-09-19T09:49:19.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.356+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 msgr2=0x7fc3c0007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.356+0000 7fc3c77fe640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 0x7fc3c0007370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8004960 tx=0x7fc3d8004a40 comp rx=0 tx=0).stop 2024-09-19T09:49:19.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.356+0000 7fc3c77fe640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 msgr2=0x7fc3c0007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:19.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.356+0000 7fc3c77fe640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3c0006ee0 0x7fc3c0007370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.359 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:19.359 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:19.359 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:19.359 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:49:19.359 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 38, 2024-09-19T09:49:19.359 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 62573, 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 3, 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:19.360 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.361 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:19.363 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:19.364 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.365 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:19.366 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:19.367 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:19.368 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.370 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:19.371 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:49:19.372 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:49:19.373 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:49:19.374 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:19.375 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:19.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.357+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc3cc06c380 msgr2=0x7fc3cc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.357+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc3cc06c380 0x7fc3cc06e840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00cce50 tx=0x7fc3d4007e90 comp rx=0 tx=0).stop 2024-09-19T09:49:19.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.357+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3e0151520 msgr2=0x7fc3e00c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.357+0000 7fc3e5131640 1 --2- 172.21.15.123:0/3121270676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3e0151520 0x7fc3e00c2970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0037000 tx=0x7fc3d0004730 comp rx=0 tx=0).stop 2024-09-19T09:49:19.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.357+0000 7fc3df59e640 1 -- 172.21.15.123:0/3121270676 reap_dead start 2024-09-19T09:49:19.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.357+0000 7fc3df59e640 1 -- 172.21.15.123:0/3121270676 reap_dead start 2024-09-19T09:49:19.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.360+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 shutdown_connections 2024-09-19T09:49:19.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.360+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 >> 172.21.15.123:0/3121270676 conn(0x7fc3e006ed00 msgr2=0x7fc3e00c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:19.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.362+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 shutdown_connections 2024-09-19T09:49:19.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.362+0000 7fc3e5131640 1 -- 172.21.15.123:0/3121270676 wait complete. 2024-09-19T09:49:19.388 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:49:19.388 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:49:19.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:49:19.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.589+0000 7f672ed0a640 1 Processor -- start 2024-09-19T09:49:19.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.590+0000 7f672ed0a640 1 -- start start 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.591+0000 7f672ed0a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f6728072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.591+0000 7f672ed0a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6728155840 con 0x7f6728155460 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.591+0000 7f672ed0a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672815b5b0 con 0x7f672815b100 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.591+0000 7f672ed0a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f672815b890 con 0x7f67280c8a50 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.592+0000 7f672caa6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6728155460 0x7f672815ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50364/0 (socket says 172.21.15.123:50364) 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.592+0000 7f672caa6640 1 -- 172.21.15.123:0/3743631231 learned_addr learned my addr 172.21.15.123:0/3743631231 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:49:19.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.592+0000 7f672d2a7640 1 --2- 172.21.15.123:0/3743631231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f6728072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.593+0000 7f67277fe640 1 -- 172.21.15.123:0/3743631231 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223397710 0 0) 0x7f6728155840 con 0x7f6728155460 2024-09-19T09:49:19.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.593+0000 7f67277fe640 1 -- 172.21.15.123:0/3743631231 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6714003520 con 0x7f6728155460 2024-09-19T09:49:19.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.593+0000 7f67277fe640 1 -- 172.21.15.123:0/3743631231 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574144265 0 0) 0x7f672815b5b0 con 0x7f672815b100 2024-09-19T09:49:19.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.593+0000 7f67277fe640 1 -- 172.21.15.123:0/3743631231 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6728155840 con 0x7f672815b100 2024-09-19T09:49:19.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.594+0000 7f672d2a7640 1 -- 172.21.15.123:0/3743631231 >> v1:172.21.15.194:6789/0 conn(0x7f672815b100 legacy=0x7f67280c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.594+0000 7f672d2a7640 1 -- 172.21.15.123:0/3743631231 >> v1:172.21.15.123:6789/0 conn(0x7f6728155460 legacy=0x7f672815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.594+0000 7f672d2a7640 1 -- 172.21.15.123:0/3743631231 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672815bb70 con 0x7f67280c8a50 2024-09-19T09:49:19.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.596+0000 7f672d2a7640 1 --2- 172.21.15.123:0/3743631231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f6728072530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6718009dc0 tx=0x7f671802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31107b149dbfc70d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.596+0000 7f67277fe640 1 -- 172.21.15.123:0/3743631231 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718007740 con 0x7f67280c8a50 2024-09-19T09:49:19.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.596+0000 7f67277fe640 1 -- 172.21.15.123:0/3743631231 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67180078e0 con 0x7f67280c8a50 2024-09-19T09:49:19.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.597+0000 7f672ed0a640 1 -- 172.21.15.123:0/3743631231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 msgr2=0x7f6728072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.597+0000 7f672ed0a640 1 --2- 172.21.15.123:0/3743631231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f6728072530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6718009dc0 tx=0x7f671802a6d0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.597+0000 7f672ed0a640 1 -- 172.21.15.123:0/3743631231 shutdown_connections 2024-09-19T09:49:19.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.597+0000 7f672ed0a640 1 --2- 172.21.15.123:0/3743631231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f6728072530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.597+0000 7f672ed0a640 1 -- 172.21.15.123:0/3743631231 >> 172.21.15.123:0/3743631231 conn(0x7f672806ed00 msgr2=0x7f672806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:19.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.597+0000 7f672ed0a640 1 -- 172.21.15.123:0/3743631231 shutdown_connections 2024-09-19T09:49:19.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.598+0000 7f672ed0a640 1 -- 172.21.15.123:0/3743631231 wait complete. 2024-09-19T09:49:19.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.600+0000 7f672ed0a640 1 Processor -- start 2024-09-19T09:49:19.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.600+0000 7f672ed0a640 1 -- start start 2024-09-19T09:49:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.601+0000 7f672ed0a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f67281492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.601+0000 7f672ed0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6728155460 0x7f67280c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.601+0000 7f672ed0a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f672815b100 0x7f67281f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.601+0000 7f672ed0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f672815f460 con 0x7f6728155460 2024-09-19T09:49:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.601+0000 7f672ed0a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f672815e830 con 0x7f672815b100 2024-09-19T09:49:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.601+0000 7f672ed0a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f672815f5e0 con 0x7f67280c8a50 2024-09-19T09:49:19.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.602+0000 7f6727fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6728155460 0x7f67280c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.602+0000 7f6727fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6728155460 0x7f67280c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49062/0 (socket says 172.21.15.123:49062) 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.602+0000 7f6727fff640 1 -- 172.21.15.123:0/2555304991 learned_addr learned my addr 172.21.15.123:0/2555304991 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.602+0000 7f672d2a7640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f672815b100 0x7f67281f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.602+0000 7f672caa6640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f67281492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.603+0000 7f6727fff640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 msgr2=0x7f67281492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.603+0000 7f6727fff640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67280c8a50 0x7f67281492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.603+0000 7f6727fff640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f672815b100 msgr2=0x7f67281f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.603+0000 7f6727fff640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f672815b100 0x7f67281f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.603+0000 7f6727fff640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280c43a0 con 0x7f6728155460 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.603+0000 7f6727fff640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6728155460 0x7f67280c58d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f671000c460 tx=0x7f671000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.604+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710017070 con 0x7f6728155460 2024-09-19T09:49:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.604+0000 7f672ed0a640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67281e5cf0 con 0x7f6728155460 2024-09-19T09:49:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.604+0000 7f672ed0a640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67280cc2d0 con 0x7f6728155460 2024-09-19T09:49:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.606+0000 7f672ed0a640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 0x7f67280cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.606+0000 7f672ed0a640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67280c40e0 con 0x7f67280c3d00 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.607+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6710005310 con 0x7f6728155460 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.607+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710012870 con 0x7f6728155460 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.607+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f671001a070 con 0x7f6728155460 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.608+0000 7f67257fa640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f670806c3b0 0x7f670806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.608+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f671008a7e0 con 0x7f6728155460 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.608+0000 7f672d2a7640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f670806c3b0 0x7f670806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.608+0000 7f672caa6640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 0x7f67280cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.609+0000 7f672d2a7640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f670806c3b0 0x7f670806e870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6718034000 tx=0x7f671802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.614+0000 7f672caa6640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67280c5210 con 0x7f67280c3d00 2024-09-19T09:49:19.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.616+0000 7f672caa6640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 0x7f67280cb740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6720001110 tx=0x7f672000e890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.616+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720005ac0 con 0x7f67280c3d00 2024-09-19T09:49:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.618+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6720018070 con 0x7f67280c3d00 2024-09-19T09:49:19.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.618+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 msgr2=0x7f67280cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.618+0000 7f67257fa640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 0x7f67280cb740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6720001110 tx=0x7f672000e890 comp rx=0 tx=0).stop 2024-09-19T09:49:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.619+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 msgr2=0x7f67280cb740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:19.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.619+0000 7f67257fa640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67280c3d00 0x7f67280cb740 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.633+0000 7f672ed0a640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 0x7f67281f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.634+0000 7f672ed0a640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67280c6190 con 0x7f67281f8f00 2024-09-19T09:49:19.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.640+0000 7f672caa6640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 0x7f67281f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.641+0000 7f672caa6640 1 -- 172.21.15.123:0/2555304991 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6728072530 con 0x7f67281f8f00 2024-09-19T09:49:19.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.642+0000 7f672caa6640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 0x7f67281f9310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6720001110 tx=0x7f67200057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.643+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672001dbd0 con 0x7f67281f8f00 2024-09-19T09:49:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.643+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f672001dd70 con 0x7f67281f8f00 2024-09-19T09:49:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.643+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 msgr2=0x7f67281f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.643+0000 7f67257fa640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 0x7f67281f9310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6720001110 tx=0x7f67200057f0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.643+0000 7f67257fa640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 msgr2=0x7f67281f9310 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.643+0000 7f67257fa640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67281f8f00 0x7f67281f9310 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6720001110 tx=0x7f67200057f0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.648 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 38, 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 8750, 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.649 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 3, 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:19.650 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:19.651 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:19.652 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:19.653 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:19.654 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:19.655 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.656 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.657 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:19.658 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:19.659 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:19.660 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.645+0000 7f671effd640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f670806c3b0 msgr2=0x7f670806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.645+0000 7f671effd640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f670806c3b0 0x7f670806e870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6718034000 tx=0x7f671802f000 comp rx=0 tx=0).stop 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.645+0000 7f671effd640 1 -- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6728155460 msgr2=0x7f67280c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.645+0000 7f671effd640 1 --2- 172.21.15.123:0/2555304991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6728155460 0x7f67280c58d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f671000c460 tx=0x7f671000c920 comp rx=0 tx=0).stop 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.648+0000 7f672d2a7640 1 -- 172.21.15.123:0/2555304991 reap_dead start 2024-09-19T09:49:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.648+0000 7f672d2a7640 1 -- 172.21.15.123:0/2555304991 reap_dead start 2024-09-19T09:49:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.648+0000 7f671effd640 1 -- 172.21.15.123:0/2555304991 shutdown_connections 2024-09-19T09:49:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.648+0000 7f671effd640 1 -- 172.21.15.123:0/2555304991 >> 172.21.15.123:0/2555304991 conn(0x7f672806ed00 msgr2=0x7f67281543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.650+0000 7f671effd640 1 -- 172.21.15.123:0/2555304991 shutdown_connections 2024-09-19T09:49:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.650+0000 7f671effd640 1 -- 172.21.15.123:0/2555304991 wait complete. 2024-09-19T09:49:19.679 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:49:19.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:49:19.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:49:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.950+0000 7fa55204d640 1 Processor -- start 2024-09-19T09:49:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.951+0000 7fa55204d640 1 -- start start 2024-09-19T09:49:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.952+0000 7fa55204d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 0x7fa54404aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.952+0000 7fa55204d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5440e5f30 0x7fa5440e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.952+0000 7fa55204d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5440e6d30 con 0x7fa5440dcd90 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.952+0000 7fa55204d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa544044d40 con 0x7fa5440e5f30 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.952+0000 7fa55204d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa5440dd170 con 0x7fa54404a680 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.952+0000 7fa55084a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 0x7fa54404aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.953+0000 7fa55084a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 0x7fa54404aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:35474/0 (socket says 172.21.15.123:35474) 2024-09-19T09:49:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.953+0000 7fa55084a640 1 -- 172.21.15.123:0/275671036 learned_addr learned my addr 172.21.15.123:0/275671036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.954+0000 7fa55184c640 1 --2- 172.21.15.123:0/275671036 >> v2:172.21.15.123:3300/0 conn(0x7fa5440e5f30 0x7fa5440e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.954+0000 7fa55084a640 1 -- 172.21.15.123:0/275671036 >> v2:172.21.15.123:3300/0 conn(0x7fa5440e5f30 msgr2=0x7fa5440e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.954+0000 7fa55084a640 1 --2- 172.21.15.123:0/275671036 >> v2:172.21.15.123:3300/0 conn(0x7fa5440e5f30 0x7fa5440e63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.954+0000 7fa55084a640 1 -- 172.21.15.123:0/275671036 >> v1:172.21.15.194:6789/0 conn(0x7fa5440dcd90 legacy=0x7fa544045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.954+0000 7fa55084a640 1 -- 172.21.15.123:0/275671036 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544044f90 con 0x7fa54404a680 2024-09-19T09:49:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.956+0000 7fa55084a640 1 --2- 172.21.15.123:0/275671036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 0x7fa54404aa80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009870 tx=0x7fa53c02a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b7290c40f7114b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.956+0000 7fa543fff640 1 -- 172.21.15.123:0/275671036 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c037070 con 0x7fa54404a680 2024-09-19T09:49:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.956+0000 7fa543fff640 1 -- 172.21.15.123:0/275671036 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c02adf0 con 0x7fa54404a680 2024-09-19T09:49:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.956+0000 7fa543fff640 1 -- 172.21.15.123:0/275671036 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c032660 con 0x7fa54404a680 2024-09-19T09:49:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.957+0000 7fa55204d640 1 -- 172.21.15.123:0/275671036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 msgr2=0x7fa54404aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.957+0000 7fa55204d640 1 --2- 172.21.15.123:0/275671036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 0x7fa54404aa80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009870 tx=0x7fa53c02a160 comp rx=0 tx=0).stop 2024-09-19T09:49:19.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.959+0000 7fa55204d640 1 -- 172.21.15.123:0/275671036 shutdown_connections 2024-09-19T09:49:19.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.959+0000 7fa55204d640 1 --2- 172.21.15.123:0/275671036 >> v2:172.21.15.123:3300/0 conn(0x7fa5440e5f30 0x7fa5440e63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.959+0000 7fa55204d640 1 --2- 172.21.15.123:0/275671036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404a680 0x7fa54404aa80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.959+0000 7fa55204d640 1 -- 172.21.15.123:0/275671036 >> 172.21.15.123:0/275671036 conn(0x7fa54404fc50 msgr2=0x7fa544050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.961+0000 7fa55204d640 1 -- 172.21.15.123:0/275671036 shutdown_connections 2024-09-19T09:49:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.962+0000 7fa55204d640 1 -- 172.21.15.123:0/275671036 wait complete. 2024-09-19T09:49:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.964+0000 7fa55204d640 1 Processor -- start 2024-09-19T09:49:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.964+0000 7fa55204d640 1 -- start start 2024-09-19T09:49:19.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.965+0000 7fa55204d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54404a680 0x7fa5440d6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.966+0000 7fa55104b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54404a680 0x7fa5440d6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55104b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54404a680 0x7fa5440d6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49078/0 (socket says 172.21.15.123:49078) 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55104b640 1 -- 172.21.15.123:0/3002491580 learned_addr learned my addr 172.21.15.123:0/3002491580 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55204d640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5440dcd90 0x7fa54404ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55204d640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5440e5f30 0x7fa54416c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55204d640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa544045830 con 0x7fa54404a680 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55204d640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa544045550 con 0x7fa5440e5f30 2024-09-19T09:49:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.967+0000 7fa55204d640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa5440e2be0 con 0x7fa5440dcd90 2024-09-19T09:49:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.969+0000 7fa55084a640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5440dcd90 0x7fa54404ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.970+0000 7fa55184c640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5440e5f30 0x7fa54416c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.970+0000 7fa55104b640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5440dcd90 msgr2=0x7fa54404ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.970+0000 7fa55104b640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5440dcd90 0x7fa54404ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.970+0000 7fa55104b640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5440e5f30 msgr2=0x7fa54416c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.970+0000 7fa55104b640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5440e5f30 0x7fa54416c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.970+0000 7fa55104b640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5440e5040 con 0x7fa54404a680 2024-09-19T09:49:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.971+0000 7fa55104b640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54404a680 0x7fa5440d6b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa54c06a090 tx=0x7fa54c0506b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.972+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c091070 con 0x7fa54404a680 2024-09-19T09:49:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.972+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c0955d0 con 0x7fa54404a680 2024-09-19T09:49:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.972+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c095a80 con 0x7fa54404a680 2024-09-19T09:49:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.973+0000 7fa55204d640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5440e58e0 con 0x7fa54404a680 2024-09-19T09:49:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.975+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa54c094070 con 0x7fa54404a680 2024-09-19T09:49:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.976+0000 7fa55204d640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5440d70d0 con 0x7fa54404a680 2024-09-19T09:49:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.976+0000 7fa55084a640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5440dcd90 0x7fa54404ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:49:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.976+0000 7fa541ffb640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa53006c300 0x7fa53006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.976+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa54c0d33a0 con 0x7fa54404a680 2024-09-19T09:49:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.978+0000 7fa55084a640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa53006c300 0x7fa53006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.978+0000 7fa52f7fe640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 0x7fa54416c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.978+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa54416bd20 con 0x7fa54404af80 2024-09-19T09:49:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.978+0000 7fa55184c640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 0x7fa54416c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.978+0000 7fa55184c640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa544005a00 con 0x7fa54404af80 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.978+0000 7fa55084a640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa53006c300 0x7fa53006e7c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa53c034000 tx=0x7fa53c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.979+0000 7fa55184c640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 0x7fa54416c900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5480114c0 tx=0x7fa548011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.979+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548015870 con 0x7fa54404af80 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.980+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa548015870 con 0x7fa54404af80 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.980+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 msgr2=0x7fa54416c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.980+0000 7fa541ffb640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 0x7fa54416c900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5480114c0 tx=0x7fa548011980 comp rx=0 tx=0).stop 2024-09-19T09:49:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.980+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 msgr2=0x7fa54416c900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:19.980+0000 7fa541ffb640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54404af80 0x7fa54416c900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.010+0000 7fa52f7fe640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 0x7fa54417c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.010+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa5440dbb20 con 0x7fa54416e1e0 2024-09-19T09:49:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.013+0000 7fa55184c640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 0x7fa54417c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.014+0000 7fa55184c640 1 -- 172.21.15.123:0/3002491580 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5440db840 con 0x7fa54416e1e0 2024-09-19T09:49:20.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.015+0000 7fa55184c640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 0x7fa54417c520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5480114c0 tx=0x7fa5480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:20.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.016+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480065c0 con 0x7fa54416e1e0 2024-09-19T09:49:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.017+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7fa5480065c0 con 0x7fa54416e1e0 2024-09-19T09:49:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.017+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 msgr2=0x7fa54417c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.017+0000 7fa541ffb640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 0x7fa54417c520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5480114c0 tx=0x7fa5480046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.017+0000 7fa541ffb640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 msgr2=0x7fa54417c520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:20.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.017+0000 7fa541ffb640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa54416e1e0 0x7fa54417c520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.020 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:20.020 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:20.020 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:20.020 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 38, 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 169333, 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 4, 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:20.021 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:20.022 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:20.023 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:20.024 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:20.025 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:20.026 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:20.027 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.028 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:20.029 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:20.030 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:20.031 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:20.032 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.033 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:20.034 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.020+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa53006c300 msgr2=0x7fa53006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.020+0000 7fa52f7fe640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa53006c300 0x7fa53006e7c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa53c034000 tx=0x7fa53c02e000 comp rx=0 tx=0).stop 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.020+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54404a680 msgr2=0x7fa5440d6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.020+0000 7fa52f7fe640 1 --2- 172.21.15.123:0/3002491580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa54404a680 0x7fa5440d6b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa54c06a090 tx=0x7fa54c0506b0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.020+0000 7fa55184c640 1 -- 172.21.15.123:0/3002491580 reap_dead start 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.022+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 shutdown_connections 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.022+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 >> 172.21.15.123:0/3002491580 conn(0x7fa54404fc50 msgr2=0x7fa5440dc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.024+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 shutdown_connections 2024-09-19T09:49:20.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.024+0000 7fa52f7fe640 1 -- 172.21.15.123:0/3002491580 wait complete. 2024-09-19T09:49:20.053 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:49:20.053 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:49:20.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:49:20.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.269+0000 7fb9e039f640 1 Processor -- start 2024-09-19T09:49:20.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.272+0000 7fb9e039f640 1 -- start start 2024-09-19T09:49:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.281+0000 7fb9e039f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb9d815b350 0x7fb9d81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.281+0000 7fb9e039f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d80c9eb0 con 0x7fb9d8068f50 2024-09-19T09:49:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.281+0000 7fb9e039f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d80c7b30 con 0x7fb9d80c8710 2024-09-19T09:49:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.281+0000 7fb9e039f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d80c7e10 con 0x7fb9d815b350 2024-09-19T09:49:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.282+0000 7fb9de13b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9d8068f50 0x7fb9d80c23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50380/0 (socket says 172.21.15.123:50380) 2024-09-19T09:49:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.282+0000 7fb9de13b640 1 -- 172.21.15.123:0/904753215 learned_addr learned my addr 172.21.15.123:0/904753215 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:49:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.282+0000 7fb9dd93a640 1 --2- 172.21.15.123:0/904753215 >> v2:172.21.15.194:3300/0 conn(0x7fb9d815b350 0x7fb9d81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:20.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.283+0000 7fb9dd93a640 1 -- 172.21.15.123:0/904753215 >> v1:172.21.15.194:6789/0 conn(0x7fb9d80c8710 legacy=0x7fb9d81619f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:20.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.283+0000 7fb9dd93a640 1 -- 172.21.15.123:0/904753215 >> v1:172.21.15.123:6789/0 conn(0x7fb9d8068f50 legacy=0x7fb9d80c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.284+0000 7fb9dd93a640 1 -- 172.21.15.123:0/904753215 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d815a870 con 0x7fb9d815b350 2024-09-19T09:49:20.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.285+0000 7fb9dd93a640 1 --2- 172.21.15.123:0/904753215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d815b350 0x7fb9d81514a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40097a0 tx=0x7fb9d402b380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab556f973ecf4395 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.287+0000 7fb9dd139640 1 -- 172.21.15.123:0/904753215 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4038070 con 0x7fb9d815b350 2024-09-19T09:49:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.287+0000 7fb9dd139640 1 -- 172.21.15.123:0/904753215 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d4033640 con 0x7fb9d815b350 2024-09-19T09:49:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.287+0000 7fb9dd139640 1 -- 172.21.15.123:0/904753215 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4033a10 con 0x7fb9d815b350 2024-09-19T09:49:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 -- 172.21.15.123:0/904753215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d815b350 msgr2=0x7fb9d81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 --2- 172.21.15.123:0/904753215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d815b350 0x7fb9d81514a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40097a0 tx=0x7fb9d402b380 comp rx=0 tx=0).stop 2024-09-19T09:49:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 -- 172.21.15.123:0/904753215 shutdown_connections 2024-09-19T09:49:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 --2- 172.21.15.123:0/904753215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d815b350 0x7fb9d81514a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 -- 172.21.15.123:0/904753215 >> 172.21.15.123:0/904753215 conn(0x7fb9d806f110 msgr2=0x7fb9d806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 -- 172.21.15.123:0/904753215 shutdown_connections 2024-09-19T09:49:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.290+0000 7fb9e039f640 1 -- 172.21.15.123:0/904753215 wait complete. 2024-09-19T09:49:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.292+0000 7fb9e039f640 1 Processor -- start 2024-09-19T09:49:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.292+0000 7fb9e039f640 1 -- start start 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.293+0000 7fb9e039f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 0x7fb9d8149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.293+0000 7fb9de13b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 0x7fb9d8149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 0x7fb9d8149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49086/0 (socket says 172.21.15.123:49086) 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 -- 172.21.15.123:0/1448280626 learned_addr learned my addr 172.21.15.123:0/1448280626 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9e039f640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d80c8710 0x7fb9d8145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9e039f640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9d815b350 0x7fb9d81464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d80c9250 con 0x7fb9d8068f50 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d815ae30 con 0x7fb9d80c8710 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d80c93d0 con 0x7fb9d815b350 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 -- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9d815b350 msgr2=0x7fb9d81464c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9d815b350 0x7fb9d81464c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 -- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d80c8710 msgr2=0x7fb9d8145f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d80c8710 0x7fb9d8145f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d8147a70 con 0x7fb9d8068f50 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.294+0000 7fb9de13b640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 0x7fb9d8149270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000cb60 tx=0x7fb9d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.295+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0018070 con 0x7fb9d8068f50 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.295+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0004b60 con 0x7fb9d8068f50 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.295+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000ab40 con 0x7fb9d8068f50 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.295+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d8147790 con 0x7fb9d8068f50 2024-09-19T09:49:20.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.297+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d8148a70 con 0x7fb9d8068f50 2024-09-19T09:49:20.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.297+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb9d001b070 con 0x7fb9d8068f50 2024-09-19T09:49:20.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.298+0000 7fb9ceffd640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb9bc06c300 0x7fb9bc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:20.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.299+0000 7fb9dd93a640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb9bc06c300 0x7fb9bc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.305+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb9d0056bc0 con 0x7fb9d8068f50 2024-09-19T09:49:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.309+0000 7fb9dd93a640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb9bc06c300 0x7fb9bc06e7c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4035000 tx=0x7fb9d402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.310+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d81514a0 con 0x7fb9d8068f50 2024-09-19T09:49:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.319+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb9d0059220 con 0x7fb9d8068f50 2024-09-19T09:49:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.824+0000 7fb9e039f640 1 -- 172.21.15.123:0/1448280626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb9d80c1f80 con 0x7fb9d8068f50 2024-09-19T09:49:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.827+0000 7fb9ceffd640 1 -- 172.21.15.123:0/1448280626 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb9d0058b20 con 0x7fb9d8068f50 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.831+0000 7fb9ccff9640 1 -- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb9bc06c300 msgr2=0x7fb9bc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.831+0000 7fb9ccff9640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb9bc06c300 0x7fb9bc06e7c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4035000 tx=0x7fb9d402f000 comp rx=0 tx=0).stop 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.831+0000 7fb9ccff9640 1 -- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 msgr2=0x7fb9d8149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.831+0000 7fb9ccff9640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 0x7fb9d8149270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000cb60 tx=0x7fb9d000a430 comp rx=0 tx=0).stop 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.832+0000 7fb9ccff9640 1 -- 172.21.15.123:0/1448280626 shutdown_connections 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.832+0000 7fb9ccff9640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb9bc06c300 0x7fb9bc06e7c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.832+0000 7fb9ccff9640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9d815b350 0x7fb9d81464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.832+0000 7fb9ccff9640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9d80c8710 0x7fb9d8145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.832+0000 7fb9ccff9640 1 --2- 172.21.15.123:0/1448280626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9d8068f50 0x7fb9d8149270 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000cb60 tx=0x7fb9d000a430 comp rx=0 tx=0).stop 2024-09-19T09:49:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.832+0000 7fb9ccff9640 1 -- 172.21.15.123:0/1448280626 >> 172.21.15.123:0/1448280626 conn(0x7fb9d806f110 msgr2=0x7fb9d81582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.838+0000 7fb9ccff9640 1 -- 172.21.15.123:0/1448280626 shutdown_connections 2024-09-19T09:49:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:20.838+0000 7fb9ccff9640 1 -- 172.21.15.123:0/1448280626 wait complete. 2024-09-19T09:49:20.862 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:49:30.863 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:49:30.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:49:31.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.085+0000 7f803cef1640 1 Processor -- start 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.086+0000 7f803cef1640 1 -- start start 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.087+0000 7f803cef1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80380c95f0 0x7f8038163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.087+0000 7f803cef1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f803806c560 0x7f80380c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.087+0000 7f803cef1640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380c6e30 con 0x7f80380c3920 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.087+0000 7f803cef1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f80380c9140 con 0x7f80380c95f0 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.087+0000 7f803cef1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f8038071f50 con 0x7f803806c560 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f803806c560 0x7f80380c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f803806c560 0x7f80380c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:50352/0 (socket says 172.21.15.123:50352) 2024-09-19T09:49:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 -- 172.21.15.123:0/4072761134 learned_addr learned my addr 172.21.15.123:0/4072761134 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 -- 172.21.15.123:0/4072761134 >> v2:172.21.15.123:3300/0 conn(0x7f80380c95f0 msgr2=0x7f8038163390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 --2- 172.21.15.123:0/4072761134 >> v2:172.21.15.123:3300/0 conn(0x7f80380c95f0 0x7f8038163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 -- 172.21.15.123:0/4072761134 >> v1:172.21.15.194:6789/0 conn(0x7f80380c3920 legacy=0x7f803806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.088+0000 7f8036d9d640 1 -- 172.21.15.123:0/4072761134 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8038072230 con 0x7f803806c560 2024-09-19T09:49:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.089+0000 7f8036d9d640 1 --2- 172.21.15.123:0/4072761134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f803806c560 0x7f80380c99d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f80380c7510 tx=0x7f802802a350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c09a5892a80abaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.090+0000 7f803559a640 1 -- 172.21.15.123:0/4072761134 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028037070 con 0x7f803806c560 2024-09-19T09:49:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.091+0000 7f803559a640 1 -- 172.21.15.123:0/4072761134 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8028032640 con 0x7f803806c560 2024-09-19T09:49:31.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.091+0000 7f803559a640 1 -- 172.21.15.123:0/4072761134 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028032a50 con 0x7f803806c560 2024-09-19T09:49:31.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.092+0000 7f803cef1640 1 -- 172.21.15.123:0/4072761134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f803806c560 msgr2=0x7f80380c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.092+0000 7f803cef1640 1 --2- 172.21.15.123:0/4072761134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f803806c560 0x7f80380c99d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f80380c7510 tx=0x7f802802a350 comp rx=0 tx=0).stop 2024-09-19T09:49:31.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.092+0000 7f803cef1640 1 -- 172.21.15.123:0/4072761134 shutdown_connections 2024-09-19T09:49:31.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.092+0000 7f803cef1640 1 --2- 172.21.15.123:0/4072761134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f803806c560 0x7f80380c99d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.092+0000 7f803cef1640 1 --2- 172.21.15.123:0/4072761134 >> v2:172.21.15.123:3300/0 conn(0x7f80380c95f0 0x7f8038163390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.092+0000 7f803cef1640 1 -- 172.21.15.123:0/4072761134 >> 172.21.15.123:0/4072761134 conn(0x7f803806ec90 msgr2=0x7f803806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:31.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.094+0000 7f803cef1640 1 -- 172.21.15.123:0/4072761134 shutdown_connections 2024-09-19T09:49:31.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.098+0000 7f803cef1640 1 -- 172.21.15.123:0/4072761134 wait complete. 2024-09-19T09:49:31.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.100+0000 7f803cef1640 1 Processor -- start 2024-09-19T09:49:31.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.100+0000 7f803cef1640 1 -- start start 2024-09-19T09:49:31.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.101+0000 7f803cef1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f803806c560 0x7f803815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.101+0000 7f803cef1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80380c95f0 0x7f803815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.101+0000 7f803cef1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80380cd380 0x7f8038164fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.101+0000 7f803cef1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8038072ad0 con 0x7f803806c560 2024-09-19T09:49:31.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.101+0000 7f803cef1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f80380727f0 con 0x7f80380c95f0 2024-09-19T09:49:31.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.101+0000 7f803cef1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8038071c50 con 0x7f80380cd380 2024-09-19T09:49:31.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.103+0000 7f8036d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80380cd380 0x7f8038164fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.104+0000 7f8036d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80380cd380 0x7f8038164fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:56496/0 (socket says 172.21.15.123:56496) 2024-09-19T09:49:31.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.104+0000 7f8036d9d640 1 -- 172.21.15.123:0/1171235583 learned_addr learned my addr 172.21.15.123:0/1171235583 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:31.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.104+0000 7f8035d9b640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80380c95f0 0x7f803815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.104+0000 7f8035d9b640 1 -- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80380cd380 msgr2=0x7f8038164fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.104+0000 7f8035d9b640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80380cd380 0x7f8038164fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.104+0000 7f8035d9b640 1 -- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f803806c560 msgr2=0x7f803815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.105+0000 7f803659c640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f803806c560 0x7f803815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.105+0000 7f8035d9b640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f803806c560 0x7f803815b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.105+0000 7f8035d9b640 1 -- 172.21.15.123:0/1171235583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803814ac80 con 0x7f80380c95f0 2024-09-19T09:49:31.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.105+0000 7f803659c640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f803806c560 0x7f803815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:49:31.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.105+0000 7f8035d9b640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80380c95f0 0x7f803815bc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f803806d200 tx=0x7f803000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.106+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030003b70 con 0x7f80380c95f0 2024-09-19T09:49:31.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.106+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8038164110 con 0x7f80380c95f0 2024-09-19T09:49:31.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.108+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803814c6f0 con 0x7f80380c95f0 2024-09-19T09:49:31.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.109+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803000ce50 con 0x7f80380c95f0 2024-09-19T09:49:31.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.110+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803000a7f0 con 0x7f80380c95f0 2024-09-19T09:49:31.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.111+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801c005290 con 0x7f80380c95f0 2024-09-19T09:49:31.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.113+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f803000a990 con 0x7f80380c95f0 2024-09-19T09:49:31.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.114+0000 7f8026ffd640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f801806c3b0 0x7f801806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.114+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f803008b500 con 0x7f80380c95f0 2024-09-19T09:49:31.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.114+0000 7f803659c640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f801806c3b0 0x7f801806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.115+0000 7f803659c640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f801806c3b0 0x7f801806e870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f802c00a860 tx=0x7f802c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.122+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8030059c60 con 0x7f80380c95f0 2024-09-19T09:49:31.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.629+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f801c005580 con 0x7f80380c95f0 2024-09-19T09:49:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.631+0000 7f8026ffd640 1 -- 172.21.15.123:0/1171235583 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8030059560 con 0x7f80380c95f0 2024-09-19T09:49:31.634 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:49:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f801806c3b0 msgr2=0x7f801806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f801806c3b0 0x7f801806e870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f802c00a860 tx=0x7f802c008040 comp rx=0 tx=0).stop 2024-09-19T09:49:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80380c95f0 msgr2=0x7f803815bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80380c95f0 0x7f803815bc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f803806d200 tx=0x7f803000cc00 comp rx=0 tx=0).stop 2024-09-19T09:49:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 shutdown_connections 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f801806c3b0 0x7f801806e870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80380cd380 0x7f8038164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80380c95f0 0x7f803815bc40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 --2- 172.21.15.123:0/1171235583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f803806c560 0x7f803815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.635+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 >> 172.21.15.123:0/1171235583 conn(0x7f803806ec90 msgr2=0x7f803815ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.636+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 shutdown_connections 2024-09-19T09:49:31.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.636+0000 7f803cef1640 1 -- 172.21.15.123:0/1171235583 wait complete. 2024-09-19T09:49:31.660 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:49:31.660 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:49:31.660 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:49:31.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:49:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.834+0000 7f7e705fd640 1 Processor -- start 2024-09-19T09:49:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.834+0000 7f7e705fd640 1 -- start start 2024-09-19T09:49:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.836+0000 7f7e705fd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e68073170 0x7f7e68073550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.836+0000 7f7e705fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e6815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.836+0000 7f7e705fd640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6806e770 con 0x7f7e68159bb0 2024-09-19T09:49:31.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.836+0000 7f7e705fd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7e680c9eb0 con 0x7f7e68073170 2024-09-19T09:49:31.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.836+0000 7f7e705fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6815c9f0 con 0x7f7e680c59a0 2024-09-19T09:49:31.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.837+0000 7f7e6db98640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e6815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.837+0000 7f7e6db98640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e6815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:56510/0 (socket says 172.21.15.123:56510) 2024-09-19T09:49:31.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.837+0000 7f7e6db98640 1 -- 172.21.15.123:0/1035637009 learned_addr learned my addr 172.21.15.123:0/1035637009 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:31.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.840+0000 7f7e6e399640 1 --2- 172.21.15.123:0/1035637009 >> v2:172.21.15.194:3300/0 conn(0x7f7e68073170 0x7f7e68073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.841+0000 7f7e6db98640 1 -- 172.21.15.123:0/1035637009 >> v2:172.21.15.194:3300/0 conn(0x7f7e68073170 msgr2=0x7f7e68073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:31.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.841+0000 7f7e6db98640 1 --2- 172.21.15.123:0/1035637009 >> v2:172.21.15.194:3300/0 conn(0x7f7e68073170 0x7f7e68073550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.841+0000 7f7e6db98640 1 -- 172.21.15.123:0/1035637009 >> v1:172.21.15.194:6789/0 conn(0x7f7e68159bb0 legacy=0x7f7e680c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:31.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.841+0000 7f7e6db98640 1 -- 172.21.15.123:0/1035637009 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6806ea30 con 0x7f7e680c59a0 2024-09-19T09:49:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.844+0000 7f7e6db98640 1 --2- 172.21.15.123:0/1035637009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e6815c4b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2040fe5094ed5927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.846+0000 7f7e6d397640 1 -- 172.21.15.123:0/1035637009 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64037070 con 0x7f7e680c59a0 2024-09-19T09:49:31.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.846+0000 7f7e6d397640 1 -- 172.21.15.123:0/1035637009 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e64032440 con 0x7f7e680c59a0 2024-09-19T09:49:31.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.846+0000 7f7e6d397640 1 -- 172.21.15.123:0/1035637009 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64032810 con 0x7f7e680c59a0 2024-09-19T09:49:31.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.847+0000 7f7e705fd640 1 -- 172.21.15.123:0/1035637009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 msgr2=0x7f7e6815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.847+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1035637009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e6815c4b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6402a2a0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.847+0000 7f7e705fd640 1 -- 172.21.15.123:0/1035637009 shutdown_connections 2024-09-19T09:49:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.847+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1035637009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e6815c4b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.847+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1035637009 >> v2:172.21.15.194:3300/0 conn(0x7f7e68073170 0x7f7e68073550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.847+0000 7f7e705fd640 1 -- 172.21.15.123:0/1035637009 >> 172.21.15.123:0/1035637009 conn(0x7f7e680ce9a0 msgr2=0x7f7e680cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.848+0000 7f7e705fd640 1 -- 172.21.15.123:0/1035637009 shutdown_connections 2024-09-19T09:49:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.848+0000 7f7e705fd640 1 -- 172.21.15.123:0/1035637009 wait complete. 2024-09-19T09:49:31.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.850+0000 7f7e705fd640 1 Processor -- start 2024-09-19T09:49:31.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.851+0000 7f7e705fd640 1 -- start start 2024-09-19T09:49:31.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.853+0000 7f7e705fd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e68073170 0x7f7e681587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.853+0000 7f7e705fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e680cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.853+0000 7f7e705fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 0x7f7e6806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.853+0000 7f7e6e399640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e68073170 0x7f7e681587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.853+0000 7f7e6e399640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e68073170 0x7f7e681587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:50394/0 (socket says 172.21.15.123:50394) 2024-09-19T09:49:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e6db98640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e680cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e6db98640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e680cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:56522/0 (socket says 172.21.15.123:56522) 2024-09-19T09:49:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e6eb9a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 0x7f7e6806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e6eb9a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 0x7f7e6806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45084/0 (socket says 172.21.15.123:45084) 2024-09-19T09:49:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e6e399640 1 -- 172.21.15.123:0/1231170138 learned_addr learned my addr 172.21.15.123:0/1231170138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e681593b0 con 0x7f7e68159bb0 2024-09-19T09:49:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7e681590d0 con 0x7f7e68073170 2024-09-19T09:49:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.854+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7e68159690 con 0x7f7e680c59a0 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6eb9a640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 msgr2=0x7f7e680cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6eb9a640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e680c59a0 0x7f7e680cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6eb9a640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e68073170 msgr2=0x7f7e681587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6eb9a640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e68073170 0x7f7e681587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6eb9a640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e680ce7d0 con 0x7f7e68159bb0 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6e399640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e68073170 0x7f7e681587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.855+0000 7f7e6eb9a640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 0x7f7e6806ced0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000bf70 tx=0x7f7e6000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.856+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60019070 con 0x7f7e68159bb0 2024-09-19T09:49:31.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.856+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e60014440 con 0x7f7e68159bb0 2024-09-19T09:49:31.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.856+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60014810 con 0x7f7e68159bb0 2024-09-19T09:49:31.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.859+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e680cac70 con 0x7f7e68159bb0 2024-09-19T09:49:31.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.859+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e68156ca0 con 0x7f7e68159bb0 2024-09-19T09:49:31.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.860+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 0x7f7e6806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.860+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e68158d20 con 0x7f7e680cae40 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.861+0000 7f7e6e399640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 0x7f7e6806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.862+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e6001c070 con 0x7f7e68159bb0 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.862+0000 7f7e6e399640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e680c7e80 con 0x7f7e680cae40 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.862+0000 7f7e6e399640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 0x7f7e6806d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010c80 tx=0x7f7e5800e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.863+0000 7f7e5effd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7e4c06c300 0x7f7e4c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.863+0000 7f7e6db98640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7e4c06c300 0x7f7e4c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.864+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7e6008b410 con 0x7f7e68159bb0 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.864+0000 7f7e6db98640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7e4c06c300 0x7f7e4c06e7c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e64034000 tx=0x7f7e6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.864+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58018070 con 0x7f7e680cae40 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.864+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7e5801d450 con 0x7f7e680cae40 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.864+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 msgr2=0x7f7e6806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.864+0000 7f7e5effd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 0x7f7e6806d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010c80 tx=0x7f7e5800e5a0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.865+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 msgr2=0x7f7e6806d410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:31.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.865+0000 7f7e5effd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e680cae40 0x7f7e6806d410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.888+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 0x7f7e681f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:31.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.888+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e680caad0 con 0x7f7e681e4d20 2024-09-19T09:49:31.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.888+0000 7f7e6e399640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 0x7f7e681f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:31.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.893+0000 7f7e6e399640 1 -- 172.21.15.123:0/1231170138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7e68153270 con 0x7f7e681e4d20 2024-09-19T09:49:31.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.894+0000 7f7e6e399640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 0x7f7e681f8e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010c80 tx=0x7f7e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:31.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.895+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5801f2e0 con 0x7f7e681e4d20 2024-09-19T09:49:31.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.895+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f7e58003610 con 0x7f7e681e4d20 2024-09-19T09:49:31.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.895+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 msgr2=0x7f7e681f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.895+0000 7f7e5effd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 0x7f7e681f8e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010c80 tx=0x7f7e580046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.895+0000 7f7e5effd640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 msgr2=0x7f7e681f8e80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:31.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.895+0000 7f7e5effd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e681e4d20 0x7f7e681f8e80 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e58010c80 tx=0x7f7e580046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 38, 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 75116, 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.902 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:31.903 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:31.905 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:31.906 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:31.907 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:31.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.909 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:31.910 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:31.911 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:31.912 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.913 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.914 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:31.915 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7e4c06c300 msgr2=0x7f7e4c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7e4c06c300 0x7f7e4c06e7c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e64034000 tx=0x7f7e6402e000 comp rx=0 tx=0).stop 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e6eb9a640 1 -- 172.21.15.123:0/1231170138 reap_dead start 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 msgr2=0x7f7e6806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 0x7f7e6806ced0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000bf70 tx=0x7f7e6000c4d0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 shutdown_connections 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 --2- 172.21.15.123:0/1231170138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e68159bb0 0x7f7e6806ced0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:31.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.901+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 >> 172.21.15.123:0/1231170138 conn(0x7f7e680ce9a0 msgr2=0x7f7e680ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:31.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.902+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 shutdown_connections 2024-09-19T09:49:31.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:31.902+0000 7f7e705fd640 1 -- 172.21.15.123:0/1231170138 wait complete. 2024-09-19T09:49:31.926 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:49:31.926 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:49:31.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:49:32.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.131+0000 7f38bbfff640 1 Processor -- start 2024-09-19T09:49:32.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.133+0000 7f38bbfff640 1 -- start start 2024-09-19T09:49:32.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38bbfff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38b40d57a0 0x7f38b4006b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38bbfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 0x7f38b40474b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38bbfff640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40479f0 con 0x7f38b40de940 2024-09-19T09:49:32.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38bbfff640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f38b4046780 con 0x7f38b40d57a0 2024-09-19T09:49:32.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38bbfff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f38b4047020 con 0x7f38b404bb60 2024-09-19T09:49:32.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38ba7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 0x7f38b40474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38ba7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 0x7f38b40474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:56530/0 (socket says 172.21.15.123:56530) 2024-09-19T09:49:32.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.134+0000 7f38ba7fc640 1 -- 172.21.15.123:0/1299662680 learned_addr learned my addr 172.21.15.123:0/1299662680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:32.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.135+0000 7f38ba7fc640 1 -- 172.21.15.123:0/1299662680 >> v2:172.21.15.194:3300/0 conn(0x7f38b40d57a0 msgr2=0x7f38b4006b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:49:32.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.135+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/1299662680 >> v2:172.21.15.194:3300/0 conn(0x7f38b40d57a0 0x7f38b4006b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.135+0000 7f38ba7fc640 1 -- 172.21.15.123:0/1299662680 >> v1:172.21.15.123:6789/0 conn(0x7f38b40de940 legacy=0x7f38b4045c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:32.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.135+0000 7f38ba7fc640 1 -- 172.21.15.123:0/1299662680 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40df3f0 con 0x7f38b404bb60 2024-09-19T09:49:32.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.138+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/1299662680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 0x7f38b40474b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00bb10 tx=0x7f38ac02c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9910b023c91efb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.140+0000 7f38b9ffb640 1 -- 172.21.15.123:0/1299662680 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0325a0 con 0x7f38b404bb60 2024-09-19T09:49:32.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.140+0000 7f38b9ffb640 1 -- 172.21.15.123:0/1299662680 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac038070 con 0x7f38b404bb60 2024-09-19T09:49:32.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.140+0000 7f38b9ffb640 1 -- 172.21.15.123:0/1299662680 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac032960 con 0x7f38b404bb60 2024-09-19T09:49:32.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.141+0000 7f38bbfff640 1 -- 172.21.15.123:0/1299662680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 msgr2=0x7f38b40474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.141+0000 7f38bbfff640 1 --2- 172.21.15.123:0/1299662680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 0x7f38b40474b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00bb10 tx=0x7f38ac02c8e0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.142+0000 7f38bbfff640 1 -- 172.21.15.123:0/1299662680 shutdown_connections 2024-09-19T09:49:32.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.142+0000 7f38bbfff640 1 --2- 172.21.15.123:0/1299662680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b404bb60 0x7f38b40474b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.142+0000 7f38bbfff640 1 --2- 172.21.15.123:0/1299662680 >> v2:172.21.15.194:3300/0 conn(0x7f38b40d57a0 0x7f38b4006b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.142+0000 7f38bbfff640 1 -- 172.21.15.123:0/1299662680 >> 172.21.15.123:0/1299662680 conn(0x7f38b4050d70 msgr2=0x7f38b4051180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:32.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.143+0000 7f38bbfff640 1 -- 172.21.15.123:0/1299662680 shutdown_connections 2024-09-19T09:49:32.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.144+0000 7f38bbfff640 1 -- 172.21.15.123:0/1299662680 wait complete. 2024-09-19T09:49:32.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.147+0000 7f38bbfff640 1 Processor -- start 2024-09-19T09:49:32.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.147+0000 7f38bbfff640 1 -- start start 2024-09-19T09:49:32.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.148+0000 7f38bbfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b404bb60 0x7f38b40cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.148+0000 7f38bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b40d57a0 0x7f38b40cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.148+0000 7f38bbfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b40de940 0x7f38b40d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.148+0000 7f38bbfff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40469d0 con 0x7f38b40d57a0 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.148+0000 7f38bbfff640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d5b80 con 0x7f38b404bb60 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.148+0000 7f38bbfff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f38b4046cb0 con 0x7f38b40de940 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.150+0000 7f38baffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b404bb60 0x7f38b40cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.150+0000 7f38baffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b404bb60 0x7f38b40cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:50410/0 (socket says 172.21.15.123:50410) 2024-09-19T09:49:32.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.150+0000 7f38baffd640 1 -- 172.21.15.123:0/3857720253 learned_addr learned my addr 172.21.15.123:0/3857720253 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.152+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b40d57a0 0x7f38b40cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.152+0000 7f38baffd640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b40de940 msgr2=0x7f38b40d0540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:49:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.152+0000 7f38baffd640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38b40de940 0x7f38b40d0540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.152+0000 7f38baffd640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b40d57a0 msgr2=0x7f38b40cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.152+0000 7f38baffd640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b40d57a0 0x7f38b40cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.152+0000 7f38baffd640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b417c9b0 con 0x7f38b404bb60 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.153+0000 7f38baffd640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b404bb60 0x7f38b40cf2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b480 tx=0x7f38b000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.153+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0014070 con 0x7f38b404bb60 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.153+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b0010890 con 0x7f38b404bb60 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.154+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0010c80 con 0x7f38b404bb60 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.155+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b417cc50 con 0x7f38b404bb60 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.155+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b4178e80 con 0x7f38b404bb60 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.156+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b40d57a0 0x7f38b40cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.158+0000 7f38bbfff640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 0x7f38b4003190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.158+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4047bd0 con 0x7f38b40cfc30 2024-09-19T09:49:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.162+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 0x7f38b4003190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.162+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f38b0017070 con 0x7f38b404bb60 2024-09-19T09:49:32.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.163+0000 7f38a37fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38a806c380 0x7f38a806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.163+0000 7f38ba7fc640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38b404c6a0 con 0x7f38b40cfc30 2024-09-19T09:49:32.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.164+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 0x7f38b4003190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c720 tx=0x7f38ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f38b008b340 con 0x7f38b404bb60 2024-09-19T09:49:32.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac033980 con 0x7f38b40cfc30 2024-09-19T09:49:32.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f38ac038040 con 0x7f38b40cfc30 2024-09-19T09:49:32.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 msgr2=0x7f38b4003190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 0x7f38b4003190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c720 tx=0x7f38ac0046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 msgr2=0x7f38b4003190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:32.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.168+0000 7f38a37fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b40cfc30 0x7f38b4003190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.174+0000 7f38bb7fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38a806c380 0x7f38a806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.176+0000 7f38bb7fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38a806c380 0x7f38a806e840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38bc050d60 tx=0x7f38bc068dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.192+0000 7f38a17fa640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 0x7f38b404d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.194+0000 7f38a17fa640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4178990 con 0x7f38b4179680 2024-09-19T09:49:32.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.196+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 0x7f38b404d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.200+0000 7f38ba7fc640 1 -- 172.21.15.123:0/3857720253 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f38b4047490 con 0x7f38b4179680 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.204+0000 7f38ba7fc640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 0x7f38b404d2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00bb10 tx=0x7f38ac00b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.204+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac052070 con 0x7f38b4179680 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.205+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f38ac0044c0 con 0x7f38b4179680 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.205+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 msgr2=0x7f38b404d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.205+0000 7f38a37fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 0x7f38b404d2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00bb10 tx=0x7f38ac00b450 comp rx=0 tx=0).stop 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.205+0000 7f38a37fe640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 msgr2=0x7f38b404d2f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.205+0000 7f38a37fe640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b4179680 0x7f38b404d2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.210 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:32.210 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:32.210 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:32.210 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:49:32.210 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 38, 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 21313, 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:32.211 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:32.212 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:32.213 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:32.214 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:32.215 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:32.216 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.217 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.219 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:32.220 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.221 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:32.222 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.209+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38a806c380 msgr2=0x7f38a806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.209+0000 7f38bbfff640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38a806c380 0x7f38a806e840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38bc050d60 tx=0x7f38bc068dc0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.209+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b404bb60 msgr2=0x7f38b40cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.209+0000 7f38bbfff640 1 --2- 172.21.15.123:0/3857720253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b404bb60 0x7f38b40cf2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b480 tx=0x7f38b000b940 comp rx=0 tx=0).stop 2024-09-19T09:49:32.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.209+0000 7f38bb7fe640 1 -- 172.21.15.123:0/3857720253 reap_dead start 2024-09-19T09:49:32.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.209+0000 7f38bb7fe640 1 -- 172.21.15.123:0/3857720253 reap_dead start 2024-09-19T09:49:32.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.210+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 shutdown_connections 2024-09-19T09:49:32.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.210+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 >> 172.21.15.123:0/3857720253 conn(0x7f38b4050d70 msgr2=0x7f38b40351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:32.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.210+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 shutdown_connections 2024-09-19T09:49:32.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.210+0000 7f38bbfff640 1 -- 172.21.15.123:0/3857720253 wait complete. 2024-09-19T09:49:32.240 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:49:32.240 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:49:32.241 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:49:32.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.474+0000 7f9261155640 1 Processor -- start 2024-09-19T09:49:32.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.475+0000 7f9261155640 1 -- start start 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.476+0000 7f9261155640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540d66c0 0x7f925404bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.476+0000 7f9261155640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9254044b30 0x7f925404c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.476+0000 7f925bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f92540d62e0 0x7f92540dc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60532/0 (socket says 172.21.15.123:60532) 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9261155640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92540dcc30 con 0x7f92540d62e0 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9261155640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f925404b200 con 0x7f9254044b30 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9254044b30 0x7f925404c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9254044b30 0x7f925404c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:50428/0 (socket says 172.21.15.123:50428) 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 -- 172.21.15.123:0/3774043023 learned_addr learned my addr 172.21.15.123:0/3774043023 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:32.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9261155640 1 -- 172.21.15.123:0/3774043023 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f92540dcf10 con 0x7f92540d66c0 2024-09-19T09:49:32.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 -- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540d66c0 msgr2=0x7f925404bc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:49:32.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 --2- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540d66c0 0x7f925404bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 -- 172.21.15.123:0/3774043023 >> v1:172.21.15.123:6789/0 conn(0x7f92540d62e0 legacy=0x7f92540dc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:32.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.477+0000 7f9260954640 1 -- 172.21.15.123:0/3774043023 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92540dd1f0 con 0x7f9254044b30 2024-09-19T09:49:32.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.479+0000 7f9260954640 1 --2- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254044b30 0x7f925404c190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f925c051790 tx=0x7f925c0a72c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b79df202e6824767 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.480+0000 7f925affd640 1 -- 172.21.15.123:0/3774043023 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0b4070 con 0x7f9254044b30 2024-09-19T09:49:32.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.480+0000 7f925affd640 1 -- 172.21.15.123:0/3774043023 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c0a7e50 con 0x7f9254044b30 2024-09-19T09:49:32.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.480+0000 7f925affd640 1 -- 172.21.15.123:0/3774043023 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0af940 con 0x7f9254044b30 2024-09-19T09:49:32.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.481+0000 7f9261155640 1 -- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254044b30 msgr2=0x7f925404c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.481+0000 7f9261155640 1 --2- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254044b30 0x7f925404c190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f925c051790 tx=0x7f925c0a72c0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.483+0000 7f9261155640 1 -- 172.21.15.123:0/3774043023 shutdown_connections 2024-09-19T09:49:32.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.483+0000 7f9261155640 1 --2- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254044b30 0x7f925404c190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.483+0000 7f9261155640 1 --2- 172.21.15.123:0/3774043023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92540d66c0 0x7f925404bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.483+0000 7f9261155640 1 -- 172.21.15.123:0/3774043023 >> 172.21.15.123:0/3774043023 conn(0x7f925404fc50 msgr2=0x7f9254050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:32.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.485+0000 7f9261155640 1 -- 172.21.15.123:0/3774043023 shutdown_connections 2024-09-19T09:49:32.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.485+0000 7f9261155640 1 -- 172.21.15.123:0/3774043023 wait complete. 2024-09-19T09:49:32.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.487+0000 7f9261155640 1 Processor -- start 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.488+0000 7f9261155640 1 -- start start 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.489+0000 7f9261155640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9254044b30 0x7f9254005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.489+0000 7f9261155640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 0x7f9254048a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.489+0000 7f9261155640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254006be0 0x7f9254048fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.489+0000 7f9261155640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9254035cf0 con 0x7f92540d62e0 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.489+0000 7f9261155640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f925404b730 con 0x7f9254006be0 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.489+0000 7f9261155640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f9254035e70 con 0x7f9254044b30 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f925b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 0x7f9254048a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f925b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 0x7f9254048a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45132/0 (socket says 172.21.15.123:45132) 2024-09-19T09:49:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f925b7fe640 1 -- 172.21.15.123:0/2228556236 learned_addr learned my addr 172.21.15.123:0/2228556236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:32.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f9260954640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254006be0 0x7f9254048fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f925b7fe640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9254044b30 msgr2=0x7f9254005ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:49:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f925b7fe640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9254044b30 0x7f9254005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.490+0000 7f925b7fe640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254006be0 msgr2=0x7f9254048fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.491+0000 7f925b7fe640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9254006be0 0x7f9254048fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.491+0000 7f925b7fe640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9254049ac0 con 0x7f92540d62e0 2024-09-19T09:49:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.491+0000 7f925b7fe640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 0x7f9254048a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f924800b410 tx=0x7f924800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.492+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248015020 con 0x7f92540d62e0 2024-09-19T09:49:32.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.492+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9248011830 con 0x7f92540d62e0 2024-09-19T09:49:32.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.492+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248011c20 con 0x7f92540d62e0 2024-09-19T09:49:32.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.492+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9254049da0 con 0x7f92540d62e0 2024-09-19T09:49:32.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.492+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9254048020 con 0x7f92540d62e0 2024-09-19T09:49:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.498+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9248018020 con 0x7f92540d62e0 2024-09-19T09:49:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.498+0000 7f9258ff9640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9240070790 0x7f9240072c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.499+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f924808b400 con 0x7f92540d62e0 2024-09-19T09:49:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.499+0000 7f925bfff640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9240070790 0x7f9240072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.500+0000 7f925bfff640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9240070790 0x7f9240072c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9250004e50 tx=0x7f92500079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.501+0000 7f9261155640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 0x7f923c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.502+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f923c007ec0 con 0x7f923c002a70 2024-09-19T09:49:32.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.503+0000 7f9260954640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 0x7f923c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.504+0000 7f9260954640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f923c0080c0 con 0x7f923c002a70 2024-09-19T09:49:32.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.504+0000 7f9260954640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 0x7f923c004f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f925c069600 tx=0x7f925c0749f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.505+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0bf020 con 0x7f923c002a70 2024-09-19T09:49:32.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.505+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f925c0a7e50 con 0x7f923c002a70 2024-09-19T09:49:32.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.505+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 msgr2=0x7f923c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.505+0000 7f9258ff9640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 0x7f923c004f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f925c069600 tx=0x7f925c0749f0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.505+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 msgr2=0x7f923c004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:32.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.505+0000 7f9258ff9640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c002a70 0x7f923c004f30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.541+0000 7f9261155640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 0x7f923c007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:32.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.541+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f923c00a4a0 con 0x7f923c006ee0 2024-09-19T09:49:32.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.544+0000 7f9260954640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 0x7f923c007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:32.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.551+0000 7f9260954640 1 -- 172.21.15.123:0/2228556236 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f923c0078b0 con 0x7f923c006ee0 2024-09-19T09:49:32.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.557+0000 7f9260954640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 0x7f923c007370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f925c050b40 tx=0x7f925c0ac000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.559+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0bf070 con 0x7f923c006ee0 2024-09-19T09:49:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.559+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5198 (secure 0 0 0) 0x7f925c0ba470 con 0x7f923c006ee0 2024-09-19T09:49:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.559+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 msgr2=0x7f923c007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.559+0000 7f9258ff9640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 0x7f923c007370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f925c050b40 tx=0x7f925c0ac000 comp rx=0 tx=0).stop 2024-09-19T09:49:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.559+0000 7f9258ff9640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 msgr2=0x7f923c007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:32.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.559+0000 7f9258ff9640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f923c006ee0 0x7f923c007370 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f925c050b40 tx=0x7f925c0ac000 comp rx=0 tx=0).stop 2024-09-19T09:49:32.562 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:32.563 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:32.563 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:32.563 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:49:32.563 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 38, 2024-09-19T09:49:32.563 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 181875, 2024-09-19T09:49:32.564 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:32.564 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 16, 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:32.565 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:32.566 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:32.567 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:32.568 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:32.569 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.570 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.571 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.574 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:32.575 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:49:32.576 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:32.577 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:32.578 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:32.578 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:32.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:32.578 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:32.578 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9240070790 msgr2=0x7f9240072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f9240070790 0x7f9240072c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9250004e50 tx=0x7f92500079e0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9260954640 1 -- 172.21.15.123:0/2228556236 reap_dead start 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 msgr2=0x7f9254048a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 0x7f9254048a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f924800b410 tx=0x7f924800b8d0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 shutdown_connections 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 --2- 172.21.15.123:0/2228556236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540d62e0 0x7f9254048a60 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f924800b410 tx=0x7f924800b8d0 comp rx=0 tx=0).stop 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.565+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 >> 172.21.15.123:0/2228556236 conn(0x7f925404fc50 msgr2=0x7f92540d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.570+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 shutdown_connections 2024-09-19T09:49:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:32.570+0000 7f9261155640 1 -- 172.21.15.123:0/2228556236 wait complete. 2024-09-19T09:49:32.596 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:49:32.596 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-19T09:49:32.596 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-09-19T09:49:32.596 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-19T09:49:32.596 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:49:32.596 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:49:32.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:49:32.612 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:49:32.612 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-19T09:49:32.612 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-19T09:49:32.613 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-19T09:49:33.010 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:49:33.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:49:47.613 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-19T09:49:47.614 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-19T09:49:47.614 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:49:47.614 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:49:47.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.800+0000 7f071f59e640 1 Processor -- start 2024-09-19T09:49:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.804+0000 7f071f59e640 1 -- start start 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071f59e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f07200c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071f59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071e59c640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f07200c2900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071e59c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f07200c2900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071f59e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f072015f580 con 0x7f07200c9df0 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071f59e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0720160150 con 0x7f07200c7b60 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f071f59e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f072015f820 con 0x7f0720073c40 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f0717fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f0717fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37812/0 (socket says 172.21.15.123:37812) 2024-09-19T09:49:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.805+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 learned_addr learned my addr 172.21.15.123:0/3503368736 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.806+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:49:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.806+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.806+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:47.806+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.006+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f07200c2900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.006+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f07200c2900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:49:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.007+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.007+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:49:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.007+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.007+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.007+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:49:48.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.407+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f07200c2900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:48.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.407+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f07200c2900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:49:48.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.408+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.408+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:49:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.408+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.408+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:48.408+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:49:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.208+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f07200c2900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.208+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f07200c2900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:49:49.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.212+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:49.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.213+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:49:49.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.213+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:49.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.213+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:49.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:49.213+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f07200c2900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f07200c2900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 msgr2=0x7f072006c680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.123:3300/0 conn(0x7f07200c7b60 0x7f072006c680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.123:6789/0 conn(0x7f07200c9df0 legacy=0x7f072006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.194:6789/0 conn(0x7f0700003690 legacy=0x7f0700005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:49:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f072015fb00 con 0x7f0700003690 2024-09-19T09:49:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.805+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0720160150 con 0x7f0700007370 2024-09-19T09:49:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.806+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.806+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:49:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.806+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.806+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:50.806+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:51.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.006+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.194:6789/0 conn(0x7f0700003690 legacy=0x7f0700005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:49:51.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.007+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:51.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.008+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:49:51.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.008+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:51.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.008+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:51.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.008+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:49:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.407+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.194:6789/0 conn(0x7f0700003690 legacy=0x7f0700005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:49:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.409+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.409+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:49:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.409+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.409+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:51.409+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:49:52.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:52.208+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.194:6789/0 conn(0x7f0700003690 legacy=0x7f0700005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:49:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:52.215+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:52.215+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:49:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:52.215+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:49:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:52.215+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:49:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:52.215+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:49:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.805+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.805+0000 7f071cd99640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.194:6789/0 conn(0x7f0700003690 legacy=0x7f0700005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071cd99640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f0700009f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071ed9d640 1 -- 172.21.15.123:0/3503368736 reap_dead start 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071cd99640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070000b0b0 con 0x7f07200c9df0 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f0720160150 con 0x7f0720073c40 2024-09-19T09:49:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.806+0000 7f071cd99640 1 -- 172.21.15.123:0/3503368736 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f072015f820 con 0x7f0700007370 2024-09-19T09:49:53.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362796771 0 0) 0x7f070000b0b0 con 0x7f07200c9df0 2024-09-19T09:49:53.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f070c003520 con 0x7f07200c9df0 2024-09-19T09:49:53.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071ed9d640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:53.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f0700009f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:53.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f0700009f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3768539605 0 0) 0x7f070c003520 con 0x7f07200c9df0 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 msgr2=0x7f0700009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0700007370 0x7f0700009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 msgr2=0x7f0700009f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 --2- 172.21.15.123:0/3503368736 >> v2:172.21.15.194:3300/0 conn(0x7f0720073c40 0x7f0700009f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072015fb00 con 0x7f07200c9df0 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f071000f040 con 0x7f07200c9df0 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 >> v1:172.21.15.123:6789/0 conn(0x7f07200c9df0 legacy=0x7f070000a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f070c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f070c004800 0x7f070c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f070c0051c0 0x7f070c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0720160150 con 0x7f070c0039b0 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f072015f820 con 0x7f070c004800 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.807+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f070c00c060 con 0x7f070c0051c0 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.808+0000 7f0717fff640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f070c004800 msgr2=0x7f070c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.808+0000 7f0717fff640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f070c004800 0x7f070c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.808+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f070c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.808+0000 7f071ed9d640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f070c0051c0 0x7f070c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.809+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f070c0051c0 msgr2=0x7f070c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:53.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.809+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f070c0051c0 0x7f070c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.809+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f070c004800 msgr2=0x7f070c004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:53.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.809+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f070c004800 0x7f070c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.809+0000 7f071e59c640 1 -- 172.21.15.123:0/3503368736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072015fb00 con 0x7f070c0039b0 2024-09-19T09:49:53.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.810+0000 7f071e59c640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f070c003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0700007280 tx=0x7f070c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a23d45be44002b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:53.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.811+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07080079e0 con 0x7f070c0039b0 2024-09-19T09:49:53.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.811+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070802ae50 con 0x7f070c0039b0 2024-09-19T09:49:53.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.811+0000 7f071dd9b640 1 -- 172.21.15.123:0/3503368736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708032950 con 0x7f070c0039b0 2024-09-19T09:49:53.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071f59e640 1 -- 172.21.15.123:0/3503368736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 msgr2=0x7f070c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:53.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071f59e640 1 --2- 172.21.15.123:0/3503368736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f070c003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0700007280 tx=0x7f070c005830 comp rx=0 tx=0).stop 2024-09-19T09:49:53.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071ed9d640 1 -- 172.21.15.123:0/3503368736 reap_dead start 2024-09-19T09:49:53.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071f59e640 1 -- 172.21.15.123:0/3503368736 shutdown_connections 2024-09-19T09:49:53.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071f59e640 1 -- 172.21.15.123:0/3503368736 >> 172.21.15.123:0/3503368736 conn(0x7f072006d600 msgr2=0x7f072006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071f59e640 1 -- 172.21.15.123:0/3503368736 shutdown_connections 2024-09-19T09:49:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.812+0000 7f071f59e640 1 -- 172.21.15.123:0/3503368736 wait complete. 2024-09-19T09:49:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.814+0000 7f071f59e640 1 Processor -- start 2024-09-19T09:49:53.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.814+0000 7f071f59e640 1 -- start start 2024-09-19T09:49:53.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.817+0000 7f071f59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f07200c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f07200c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f07200c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36532/0 (socket says 172.21.15.123:36532) 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071e59c640 1 -- 172.21.15.123:0/3697271811 learned_addr learned my addr 172.21.15.123:0/3697271811 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07200c6ab0 0x7f07201fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07201fe080 0x7f0720158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0720074020 con 0x7f070c0039b0 2024-09-19T09:49:53.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f072006cd30 con 0x7f07201fe080 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f07200741a0 con 0x7f07200c6ab0 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f0717fff640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07200c6ab0 0x7f07201fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.818+0000 7f071ed9d640 1 -- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07201fe080 msgr2=0x7f0720158170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.819+0000 7f071ed9d640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07201fe080 0x7f0720158170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f0717fff640 1 -- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07201fe080 msgr2=0x7f0720158170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f0717fff640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07201fe080 0x7f0720158170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f0717fff640 1 -- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 msgr2=0x7f07200c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:53.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f0717fff640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f07200c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:53.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f0717fff640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07201617b0 con 0x7f07200c6ab0 2024-09-19T09:49:53.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f071e59c640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f07200c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:49:53.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.820+0000 7f0717fff640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07200c6ab0 0x7f07201fdb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0710019b00 tx=0x7f0710016fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.821+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710017db0 con 0x7f07200c6ab0 2024-09-19T09:49:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.821+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0710022420 con 0x7f07200c6ab0 2024-09-19T09:49:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.822+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710022810 con 0x7f07200c6ab0 2024-09-19T09:49:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.822+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07201fd360 con 0x7f07200c6ab0 2024-09-19T09:49:53.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.822+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0720159dc0 con 0x7f07200c6ab0 2024-09-19T09:49:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.825+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f071002b440 con 0x7f07200c6ab0 2024-09-19T09:49:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.825+0000 7f0716ffd640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f070006cf80 0x7f070006f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:53.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.826+0000 7f071e59c640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f070006cf80 0x7f070006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:53.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.827+0000 7f071e59c640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f070006cf80 0x7f070006f440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0708003dc0 tx=0x7f0708005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:53.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.827+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f071008ceb0 con 0x7f07200c6ab0 2024-09-19T09:49:53.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.827+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0720072450 con 0x7f07200c6ab0 2024-09-19T09:49:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:53.837+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0720072450 con 0x7f07200c6ab0 2024-09-19T09:49:54.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.380+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f07200cdfc0 con 0x7f07200c6ab0 2024-09-19T09:49:54.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.380+0000 7f0716ffd640 1 -- 172.21.15.123:0/3697271811 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f071005b480 con 0x7f07200c6ab0 2024-09-19T09:49:54.385 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":40,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:49:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f070006cf80 msgr2=0x7f070006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f070006cf80 0x7f070006f440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0708003dc0 tx=0x7f0708005000 comp rx=0 tx=0).stop 2024-09-19T09:49:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07200c6ab0 msgr2=0x7f07201fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07200c6ab0 0x7f07201fdb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0710019b00 tx=0x7f0710016fb0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 shutdown_connections 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07201fe080 0x7f0720158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f070006cf80 0x7f070006f440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07200c6ab0 0x7f07201fdb40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 --2- 172.21.15.123:0/3697271811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f070c0039b0 0x7f07200c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.387+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 >> 172.21.15.123:0/3697271811 conn(0x7f072006d600 msgr2=0x7f07200cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.389+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 shutdown_connections 2024-09-19T09:49:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.389+0000 7f071f59e640 1 -- 172.21.15.123:0/3697271811 wait complete. 2024-09-19T09:49:54.409 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:49:54.409 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:49:54.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:49:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.639+0000 7f11bcd6d640 1 Processor -- start 2024-09-19T09:49:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.640+0000 7f11bcd6d640 1 -- start start 2024-09-19T09:49:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.641+0000 7f11bcd6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11b00d5850 0x7f11b0007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.641+0000 7f11bcd6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b004d310 0x7f11b0045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.641+0000 7f11bcd6d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f11b0047a80 0x7f11b0046290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.643+0000 7f11bcd6d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f11b00dbe90 con 0x7f11b00d5850 2024-09-19T09:49:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.643+0000 7f11b7fff640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f11b0047a80 msgr2=0x7f11b0046290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.643+0000 7f11b7fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f11b0047a80 0x7f11b0046290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.644+0000 7f11b77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11b00d5850 0x7f11b0007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.644+0000 7f11b77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11b00d5850 0x7f11b0007730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36546/0 (socket says 172.21.15.123:36546) 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.644+0000 7f11b77fe640 1 -- 172.21.15.123:0/201053652 learned_addr learned my addr 172.21.15.123:0/201053652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.644+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/201053652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b004d310 0x7f11b0045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f11b00dc3a0 con 0x7f11b0047a80 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f11b00dc0c0 con 0x7f11b004d310 2024-09-19T09:49:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11b77fe640 1 -- 172.21.15.123:0/201053652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b004d310 msgr2=0x7f11b0045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:49:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11b77fe640 1 --2- 172.21.15.123:0/201053652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b004d310 0x7f11b0045d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11b77fe640 1 -- 172.21.15.123:0/201053652 >> v2:172.21.15.194:3300/0 conn(0x7f11b0047a80 msgr2=0x7f11b0046290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11b77fe640 1 --2- 172.21.15.123:0/201053652 >> v2:172.21.15.194:3300/0 conn(0x7f11b0047a80 0x7f11b0046290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.646+0000 7f11b77fe640 1 -- 172.21.15.123:0/201053652 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b0046cc0 con 0x7f11b00d5850 2024-09-19T09:49:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.647+0000 7f11b77fe640 1 --2- 172.21.15.123:0/201053652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b00d5850 0x7f11b0007730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11b8051500 tx=0x7f11b80a7350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0e01791acf632b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.648+0000 7f11b67fc640 1 -- 172.21.15.123:0/201053652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b80b4070 con 0x7f11b00d5850 2024-09-19T09:49:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.648+0000 7f11b67fc640 1 -- 172.21.15.123:0/201053652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b80af680 con 0x7f11b00d5850 2024-09-19T09:49:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.648+0000 7f11b67fc640 1 -- 172.21.15.123:0/201053652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b80afaf0 con 0x7f11b00d5850 2024-09-19T09:49:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b00d5850 msgr2=0x7f11b0007730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 --2- 172.21.15.123:0/201053652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b00d5850 0x7f11b0007730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11b8051500 tx=0x7f11b80a7350 comp rx=0 tx=0).stop 2024-09-19T09:49:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 shutdown_connections 2024-09-19T09:49:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 --2- 172.21.15.123:0/201053652 >> v2:172.21.15.194:3300/0 conn(0x7f11b0047a80 0x7f11b0046290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 --2- 172.21.15.123:0/201053652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b004d310 0x7f11b0045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 --2- 172.21.15.123:0/201053652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b00d5850 0x7f11b0007730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.649+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 >> 172.21.15.123:0/201053652 conn(0x7f11b004d830 msgr2=0x7f11b004dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:54.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.650+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 shutdown_connections 2024-09-19T09:49:54.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.652+0000 7f11bcd6d640 1 -- 172.21.15.123:0/201053652 wait complete. 2024-09-19T09:49:54.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.654+0000 7f11bcd6d640 1 Processor -- start 2024-09-19T09:49:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.655+0000 7f11bcd6d640 1 -- start start 2024-09-19T09:49:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11bcd6d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b0047a80 0x7f11b004a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11bcd6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004d310 0x7f11b00dd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11b77fe640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b0047a80 msgr2=0x7f11b004a3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11b77fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b0047a80 0x7f11b004a3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:54.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11bcd6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 0x7f11b00ddb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11bcd6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0047560 con 0x7f11b004d310 2024-09-19T09:49:54.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11bcd6d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0047280 con 0x7f11b0047a80 2024-09-19T09:49:54.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.656+0000 7f11bcd6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f11b00468c0 con 0x7f11b00d5850 2024-09-19T09:49:54.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 0x7f11b00ddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 0x7f11b00ddb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:59174/0 (socket says 172.21.15.123:59174) 2024-09-19T09:49:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 -- 172.21.15.123:0/1974554482 learned_addr learned my addr 172.21.15.123:0/1974554482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004d310 0x7f11b00dd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b0047a80 msgr2=0x7f11b004a3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:49:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b0047a80 0x7f11b004a3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004d310 msgr2=0x7f11b00dd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004d310 0x7f11b00dd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.659+0000 7f11b7fff640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b00df220 con 0x7f11b00d5850 2024-09-19T09:49:54.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.660+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004d310 0x7f11b00dd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:49:54.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.665+0000 7f11b7fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 0x7f11b00ddb60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f11a400b410 tx=0x7f11a400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.665+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4017070 con 0x7f11b00d5850 2024-09-19T09:49:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.665+0000 7f11bcd6d640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b0006fe0 con 0x7f11b00d5850 2024-09-19T09:49:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.665+0000 7f11bcd6d640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b0007280 con 0x7f11b00d5850 2024-09-19T09:49:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.667+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a4003d40 con 0x7f11b00d5850 2024-09-19T09:49:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.667+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4006310 con 0x7f11b00d5850 2024-09-19T09:49:54.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.667+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f11a401a070 con 0x7f11b00d5850 2024-09-19T09:49:54.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.669+0000 7f11a3fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f119c06c260 0x7f119c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.670+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f11a408a7a0 con 0x7f11b00d5850 2024-09-19T09:49:54.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.670+0000 7f11b77fe640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f119c06c260 0x7f119c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.672+0000 7f11b77fe640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f119c06c260 0x7f119c06e720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f11b000e5c0 tx=0x7f11b806e030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.672+0000 7f11a1ffb640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 0x7f11b0048cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.673+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 0x7f11b0048cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.673+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11b004c970 con 0x7f11b004a8f0 2024-09-19T09:49:54.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.674+0000 7f11b6ffd640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11b0035580 con 0x7f11b004a8f0 2024-09-19T09:49:54.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.674+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 0x7f11b0048cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11b0035550 tx=0x7f11ac00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.674+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac019070 con 0x7f11b004a8f0 2024-09-19T09:49:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.675+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f11ac004030 con 0x7f11b004a8f0 2024-09-19T09:49:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.675+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 msgr2=0x7f11b0048cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.675+0000 7f11a3fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 0x7f11b0048cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11b0035550 tx=0x7f11ac00f610 comp rx=0 tx=0).stop 2024-09-19T09:49:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.675+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 msgr2=0x7f11b0048cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.675+0000 7f11a3fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b004a8f0 0x7f11b0048cd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.693+0000 7f11a1ffb640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 0x7f11b00495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.693+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0049b30 con 0x7f11b0049210 2024-09-19T09:49:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.696+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 0x7f11b00495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.697+0000 7f11b6ffd640 1 -- 172.21.15.123:0/1974554482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11b00352a0 con 0x7f11b0049210 2024-09-19T09:49:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.698+0000 7f11b6ffd640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 0x7f11b00495f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11ac018000 tx=0x7f11ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.714+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac019040 con 0x7f11b0049210 2024-09-19T09:49:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.714+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7f11ac01e720 con 0x7f11b0049210 2024-09-19T09:49:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.714+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 msgr2=0x7f11b00495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.714+0000 7f11a3fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 0x7f11b00495f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11ac018000 tx=0x7f11ac0046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.714+0000 7f11a3fff640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 msgr2=0x7f11b00495f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:54.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.714+0000 7f11a3fff640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b0049210 0x7f11b00495f0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11ac018000 tx=0x7f11ac0046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.717 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:54.717 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:54.717 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:54.717 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:49:54.717 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 40, 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 97918, 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 2, 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:54.718 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:54.719 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:54.720 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:54.721 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:54.722 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:54.723 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:54.724 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.727 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:54.728 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:54.730 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.731 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:54.732 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:54.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:54.734 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:54.734 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f119c06c260 msgr2=0x7f119c06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f119c06c260 0x7f119c06e720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f11b000e5c0 tx=0x7f11b806e030 comp rx=0 tx=0).stop 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11b7fff640 1 -- 172.21.15.123:0/1974554482 reap_dead start 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 msgr2=0x7f11b00ddb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 0x7f11b00ddb60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f11a400b410 tx=0x7f11a400b8d0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 shutdown_connections 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 --2- 172.21.15.123:0/1974554482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00d5850 0x7f11b00ddb60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.716+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 >> 172.21.15.123:0/1974554482 conn(0x7f11b004d830 msgr2=0x7f11b0035aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:54.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.717+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 shutdown_connections 2024-09-19T09:49:54.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.717+0000 7f11a1ffb640 1 -- 172.21.15.123:0/1974554482 wait complete. 2024-09-19T09:49:54.750 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:49:54.750 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:49:54.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:49:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.952+0000 7fc5b5374640 1 Processor -- start 2024-09-19T09:49:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.952+0000 7fc5b5374640 1 -- start start 2024-09-19T09:49:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.958+0000 7fc5b5374640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 0x7fc5a804aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.958+0000 7fc5b5374640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5a80e5f30 0x7fc5a80e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.958+0000 7fc5b5374640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a80e6d30 con 0x7fc5a80dcd90 2024-09-19T09:49:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5b5374640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a8044d40 con 0x7fc5a80e5f30 2024-09-19T09:49:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5b5374640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a80dd170 con 0x7fc5a804a680 2024-09-19T09:49:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5b4b73640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7fc5a80e5f30 msgr2=0x7fc5a80e63c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5b4b73640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5a80e5f30 0x7fc5a80e63c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 0x7fc5a804aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 0x7fc5a804aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:59188/0 (socket says 172.21.15.123:59188) 2024-09-19T09:49:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5affff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc5a80dcd90 0x7fc5a8045d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46764/0 (socket says 172.21.15.123:46764) 2024-09-19T09:49:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.959+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1912055719 learned_addr learned my addr 172.21.15.123:0/1912055719 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.960+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1912055719 >> v2:172.21.15.194:3300/0 conn(0x7fc5a80e5f30 msgr2=0x7fc5a80e63c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:49:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.960+0000 7fc5af7fe640 1 --2- 172.21.15.123:0/1912055719 >> v2:172.21.15.194:3300/0 conn(0x7fc5a80e5f30 0x7fc5a80e63c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.960+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1912055719 >> v1:172.21.15.123:6789/0 conn(0x7fc5a80dcd90 legacy=0x7fc5a8045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.960+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1912055719 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a8044f90 con 0x7fc5a804a680 2024-09-19T09:49:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.961+0000 7fc5af7fe640 1 --2- 172.21.15.123:0/1912055719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 0x7fc5a804aa80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009870 tx=0x7fc59c02a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4b944e98c06f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.964+0000 7fc5aeffd640 1 -- 172.21.15.123:0/1912055719 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c037070 con 0x7fc5a804a680 2024-09-19T09:49:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.964+0000 7fc5aeffd640 1 -- 172.21.15.123:0/1912055719 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59c032640 con 0x7fc5a804a680 2024-09-19T09:49:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.965+0000 7fc5b5374640 1 -- 172.21.15.123:0/1912055719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 msgr2=0x7fc5a804aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.965+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1912055719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 0x7fc5a804aa80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009870 tx=0x7fc59c02a330 comp rx=0 tx=0).stop 2024-09-19T09:49:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.965+0000 7fc5b5374640 1 -- 172.21.15.123:0/1912055719 shutdown_connections 2024-09-19T09:49:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.965+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1912055719 >> v2:172.21.15.194:3300/0 conn(0x7fc5a80e5f30 0x7fc5a80e63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.965+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1912055719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804a680 0x7fc5a804aa80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.965+0000 7fc5b5374640 1 -- 172.21.15.123:0/1912055719 >> 172.21.15.123:0/1912055719 conn(0x7fc5a804fc50 msgr2=0x7fc5a8050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:54.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.968+0000 7fc5b5374640 1 -- 172.21.15.123:0/1912055719 shutdown_connections 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.968+0000 7fc5b5374640 1 -- 172.21.15.123:0/1912055719 wait complete. 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.970+0000 7fc5b5374640 1 Processor -- start 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.970+0000 7fc5b5374640 1 -- start start 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.971+0000 7fc5b5374640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a804a680 0x7fc5a80e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.971+0000 7fc5b5374640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 0x7fc5a80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5b5374640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a80e5f30 0x7fc5a80d94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5b5374640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8045830 con 0x7fc5a80e5f30 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5b5374640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8045550 con 0x7fc5a804a680 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5b5374640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a80e2be0 con 0x7fc5a80dcd90 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5affff640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a804a680 msgr2=0x7fc5a80e5830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5affff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a804a680 0x7fc5a80e5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:49:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 0x7fc5a80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 0x7fc5a80d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:59194/0 (socket says 172.21.15.123:59194) 2024-09-19T09:49:54.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.972+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1738179747 learned_addr learned my addr 172.21.15.123:0/1738179747 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.973+0000 7fc5b4b73640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a80e5f30 0x7fc5a80d94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.973+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a804a680 msgr2=0x7fc5a80e5830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.973+0000 7fc5af7fe640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5a804a680 0x7fc5a80e5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.973+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a80e5f30 msgr2=0x7fc5a80d94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.973+0000 7fc5af7fe640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a80e5f30 0x7fc5a80d94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.973+0000 7fc5af7fe640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a80d3780 con 0x7fc5a80dcd90 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.975+0000 7fc5af7fe640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 0x7fc5a80d3240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc59c02a850 tx=0x7fc59c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.975+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c037050 con 0x7fc5a80dcd90 2024-09-19T09:49:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.975+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a817bf60 con 0x7fc5a80dcd90 2024-09-19T09:49:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.975+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a817c200 con 0x7fc5a80dcd90 2024-09-19T09:49:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.976+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59c043070 con 0x7fc5a80dcd90 2024-09-19T09:49:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.977+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c032a10 con 0x7fc5a80dcd90 2024-09-19T09:49:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.977+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 0x7fc5a8003190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.978+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a804de30 con 0x7fc5a804f140 2024-09-19T09:49:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.979+0000 7fc5affff640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 0x7fc5a8003190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.980+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc59c032630 con 0x7fc5a80dcd90 2024-09-19T09:49:54.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.980+0000 7fc5acff9640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc5a006c3a0 0x7fc5a006e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.981+0000 7fc5b4b73640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc5a006c3a0 0x7fc5a006e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.982+0000 7fc5b4b73640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc5a006c3a0 0x7fc5a006e860 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0050d60 tx=0x7fc5b006e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.982+0000 7fc5affff640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5a80e5d70 con 0x7fc5a804f140 2024-09-19T09:49:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.982+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc59c0ac420 con 0x7fc5a80dcd90 2024-09-19T09:49:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.982+0000 7fc5affff640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 0x7fc5a8003190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4001120 tx=0x7fc5a400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.983+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40074e0 con 0x7fc5a804f140 2024-09-19T09:49:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.983+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc5a40074e0 con 0x7fc5a804f140 2024-09-19T09:49:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.983+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 msgr2=0x7fc5a8003190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.983+0000 7fc5acff9640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 0x7fc5a8003190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4001120 tx=0x7fc5a400c8e0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.983+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 msgr2=0x7fc5a8003190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.984+0000 7fc5acff9640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a804f140 0x7fc5a8003190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.998+0000 7fc59a7fc640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 0x7fc5a804eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:55.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:54.998+0000 7fc59a7fc640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a8005a00 con 0x7fc5a817c400 2024-09-19T09:49:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.000+0000 7fc5affff640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 0x7fc5a804eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:55.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.001+0000 7fc5affff640 1 -- 172.21.15.123:0/1738179747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5a804b1c0 con 0x7fc5a817c400 2024-09-19T09:49:55.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5affff640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 0x7fc5a804eb20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4013000 tx=0x7fc5a4000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a401b320 con 0x7fc5a817c400 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5186 (secure 0 0 0) 0x7fc5a401b320 con 0x7fc5a817c400 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 msgr2=0x7fc5a804eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5acff9640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 0x7fc5a804eb20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4013000 tx=0x7fc5a4000ed0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5acff9640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 msgr2=0x7fc5a804eb20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.002+0000 7fc5acff9640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a817c400 0x7fc5a804eb20 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4013000 tx=0x7fc5a4000ed0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:55.005 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 40, 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 204319, 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 2, 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:55.006 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:55.007 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:49:55.008 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:49:55.009 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:49:55.010 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:55.011 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:55.012 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:55.013 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:49:55.014 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:55.016 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.017 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:55.018 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:49:55.019 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.004+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc5a006c3a0 msgr2=0x7fc5a006e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.004+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc5a006c3a0 0x7fc5a006e860 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0050d60 tx=0x7fc5b006e040 comp rx=0 tx=0).stop 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.004+0000 7fc5b4b73640 1 -- 172.21.15.123:0/1738179747 reap_dead start 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.004+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 msgr2=0x7fc5a80d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.004+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 0x7fc5a80d3240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc59c02a850 tx=0x7fc59c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.007+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 shutdown_connections 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.007+0000 7fc5b5374640 1 --2- 172.21.15.123:0/1738179747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5a80dcd90 0x7fc5a80d3240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.007+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 >> 172.21.15.123:0/1738179747 conn(0x7fc5a804fc50 msgr2=0x7fc5a8005c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.017+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 shutdown_connections 2024-09-19T09:49:55.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:49:55.018+0000 7fc5b5374640 1 -- 172.21.15.123:0/1738179747 wait complete. 2024-09-19T09:49:55.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:49:55.058 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:50:03.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:50:03.146 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:50:15.059 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:50:15.060 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-19T09:50:15.060 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:50:15.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:50:15.067 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:50:15.067 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-19T09:50:15.067 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-19T09:50:15.068 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-19T09:50:30.069 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-19T09:50:30.070 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-19T09:50:30.070 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:50:30.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:50:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.293+0000 7f0580f49640 1 Processor -- start 2024-09-19T09:50:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.296+0000 7f0580f49640 1 -- start start 2024-09-19T09:50:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.298+0000 7f0580f49640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.298+0000 7f0580f49640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.298+0000 7f0580f49640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c15f9c0 con 0x7f057c159730 2024-09-19T09:50:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.298+0000 7f0580f49640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f057c15fca0 con 0x7f057c15f410 2024-09-19T09:50:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.298+0000 7f0580f49640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f057c15ff80 con 0x7f057c163720 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:60568/0 (socket says 172.21.15.123:60568) 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 learned_addr learned my addr 172.21.15.123:0/3285472542 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:30.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:30.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:30.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:30.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.299+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:30.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.300+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.501+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:30.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.501+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.501+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.501+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.501+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.501+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.502+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.502+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.502+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:30.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.502+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:50:30.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:30.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:30.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:30.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:30.903+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:50:31.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.704+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:31.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.705+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:50:31.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.705+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:31.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.705+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:31.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.705+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:50:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.705+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.706+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.706+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.706+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:31.706+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:50:33.278 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:50:33.281 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:50:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 msgr2=0x7f057c0c8040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f057c163720 0x7f057c0c8040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 msgr2=0x7f057c1631e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.123:3300/0 conn(0x7f057c15f410 0x7f057c1631e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 -- 172.21.15.123:0/3285472542 >> v1:172.21.15.194:6789/0 conn(0x7f057c159730 legacy=0x7f057c0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 -- 172.21.15.123:0/3285472542 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c160260 con 0x7f0564003680 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.298+0000 7f0573fff640 1 -- 172.21.15.123:0/3285472542 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f057c15fca0 con 0x7f05640073c0 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.299+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.299+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.299+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.299+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.299+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.500+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.500+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.500+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.500+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.500+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:50:33.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.901+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.901+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:33.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.901+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:33.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.901+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:33.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:33.901+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:50:34.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.702+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.702+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:50:34.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.702+0000 7f0579d9b640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:50:34.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.702+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.702+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:50:34.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.760+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303920778 0 0) 0x7f057c160260 con 0x7f0564003680 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.760+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0560003520 con 0x7f0564003680 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3352479550 0 0) 0x7f0560003520 con 0x7f0564003680 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 msgr2=0x7f0564009880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 --2- 172.21.15.123:0/3285472542 >> v2:172.21.15.194:3300/0 conn(0x7f05640073c0 0x7f0564009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056400af80 con 0x7f0564003680 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f0574001a70 con 0x7f0564003680 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 >> v1:172.21.15.123:6789/0 conn(0x7f0564003680 legacy=0x7f0564005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057ad9d640 1 -- 172.21.15.123:0/3285472542 reap_dead start 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0560003a00 0x7f0560003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560004800 0x7f0560004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05600053c0 0x7f056000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f057c15fca0 con 0x7f05600053c0 2024-09-19T09:50:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f056000c280 con 0x7f0560004800 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f056000c480 con 0x7f0560003a00 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.761+0000 7f057a59c640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0560003a00 0x7f0560003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f057ad9d640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05600053c0 0x7f056000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f0579d9b640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560004800 0x7f0560004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f057a59c640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560004800 msgr2=0x7f0560004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f057a59c640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560004800 0x7f0560004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f057a59c640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05600053c0 msgr2=0x7f056000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f057a59c640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05600053c0 0x7f056000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.762+0000 7f057a59c640 1 -- 172.21.15.123:0/3285472542 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0560003520 con 0x7f0560003a00 2024-09-19T09:50:34.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.764+0000 7f057a59c640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0560003a00 0x7f0560003e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f057400c4b0 tx=0x7f0560005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54ee3d8c768aee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.764+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574033070 con 0x7f0560003a00 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.764+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0574006d70 con 0x7f0560003a00 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.764+0000 7f057959a640 1 -- 172.21.15.123:0/3285472542 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057400c0e0 con 0x7f0560003a00 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.765+0000 7f0580f49640 1 -- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0560003a00 msgr2=0x7f0560003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.765+0000 7f0580f49640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0560003a00 0x7f0560003e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f057400c4b0 tx=0x7f0560005830 comp rx=0 tx=0).stop 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 -- 172.21.15.123:0/3285472542 shutdown_connections 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05600053c0 0x7f056000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560004800 0x7f0560004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 --2- 172.21.15.123:0/3285472542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0560003a00 0x7f0560003e00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 -- 172.21.15.123:0/3285472542 >> 172.21.15.123:0/3285472542 conn(0x7f057c06ec90 msgr2=0x7f057c06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:34.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 -- 172.21.15.123:0/3285472542 shutdown_connections 2024-09-19T09:50:34.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.766+0000 7f0580f49640 1 -- 172.21.15.123:0/3285472542 wait complete. 2024-09-19T09:50:34.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.768+0000 7f0580f49640 1 Processor -- start 2024-09-19T09:50:34.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.768+0000 7f0580f49640 1 -- start start 2024-09-19T09:50:34.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.770+0000 7f0580f49640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.770+0000 7f0580f49640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0560004800 0x7f057c0c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:60240/0 (socket says 172.21.15.123:60240) 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f0580f49640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 0x7f057c13df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f0580f49640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0715b0 con 0x7f0560004800 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f0580f49640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f057c162cc0 con 0x7f0560003a00 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f0580f49640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f057c159b10 con 0x7f05600053c0 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 -- 172.21.15.123:0/1155973741 learned_addr learned my addr 172.21.15.123:0/1155973741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 msgr2=0x7f057c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 msgr2=0x7f057c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:34.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057a59c640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f0579d9b640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0560004800 0x7f057c0c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.774+0000 7f057ad9d640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 0x7f057c13df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f057ad9d640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 msgr2=0x7f057c13df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f057ad9d640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 msgr2=0x7f057c13df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f057ad9d640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 0x7f057c13df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f057ad9d640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 0x7f057c13df90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f0579d9b640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 msgr2=0x7f057c13df90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f0579d9b640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 0x7f057c13df90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f0579d9b640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 msgr2=0x7f057c15e000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f0579d9b640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.775+0000 7f0579d9b640 1 -- 172.21.15.123:0/1155973741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c13eab0 con 0x7f0560004800 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.776+0000 7f0579d9b640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0560004800 0x7f057c0c4350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f056c017ba0 tx=0x7f056c0167a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.776+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c01a0d0 con 0x7f0560004800 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.776+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056c01a290 con 0x7f0560004800 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.776+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c017c90 con 0x7f0560004800 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.777+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c153340 con 0x7f0560004800 2024-09-19T09:50:34.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.777+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c15dd20 con 0x7f0560004800 2024-09-19T09:50:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.783+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f056c018450 con 0x7f0560004800 2024-09-19T09:50:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.783+0000 7f0572ffd640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f056406ccc0 0x7f056406f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.784+0000 7f057a59c640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f056406ccc0 0x7f056406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.784+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c0cda00 con 0x7f0560004800 2024-09-19T09:50:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.785+0000 7f057a59c640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f056406ccc0 0x7f056406f180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0574007e20 tx=0x7f057403a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.785+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f056c08c990 con 0x7f0560004800 2024-09-19T09:50:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:34.794+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f056c05b0f0 con 0x7f0560004800 2024-09-19T09:50:35.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.300+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f057c1431a0 con 0x7f0560004800 2024-09-19T09:50:35.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.305+0000 7f0572ffd640 1 -- 172.21.15.123:0/1155973741 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f056c05a9f0 con 0x7f0560004800 2024-09-19T09:50:35.310 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f056406ccc0 msgr2=0x7f056406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f056406ccc0 0x7f056406f180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0574007e20 tx=0x7f057403a040 comp rx=0 tx=0).stop 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0560004800 msgr2=0x7f057c0c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0560004800 0x7f057c0c4350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f056c017ba0 tx=0x7f056c0167a0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 shutdown_connections 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f056406ccc0 0x7f056406f180 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0574007e20 tx=0x7f057403a040 comp rx=0 tx=0).stop 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05600053c0 0x7f057c13df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0560004800 0x7f057c0c4350 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f056c017ba0 tx=0x7f056c0167a0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 --2- 172.21.15.123:0/1155973741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560003a00 0x7f057c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.309+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 >> 172.21.15.123:0/1155973741 conn(0x7f057c06ec90 msgr2=0x7f057c13f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:35.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.316+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 shutdown_connections 2024-09-19T09:50:35.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.316+0000 7f0580f49640 1 -- 172.21.15.123:0/1155973741 wait complete. 2024-09-19T09:50:35.339 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:50:35.339 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:50:35.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:50:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.530+0000 7f2df29e5640 1 Processor -- start 2024-09-19T09:50:35.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.530+0000 7f2df29e5640 1 -- start start 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df29e5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2dec0c9500 0x7f2dec06de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df29e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec06e360 0x7f2dec0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df29e5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2dec0c62d0 0x7f2dec1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df29e5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2dec0cf7b0 con 0x7f2dec0c62d0 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df29e5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f2dec0c6a50 con 0x7f2dec0c9500 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df29e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec159840 con 0x7f2dec06e360 2024-09-19T09:50:35.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df11e2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec06e360 0x7f2dec0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df19e3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2dec0c9500 0x7f2dec06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df11e2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec06e360 0x7f2dec0c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:57098/0 (socket says 172.21.15.123:57098) 2024-09-19T09:50:35.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.532+0000 7f2df11e2640 1 -- 172.21.15.123:0/2946148097 learned_addr learned my addr 172.21.15.123:0/2946148097 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:35.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.533+0000 7f2df19e3640 1 -- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec06e360 msgr2=0x7f2dec0c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.533+0000 7f2df19e3640 1 --2- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec06e360 0x7f2dec0c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.533+0000 7f2df19e3640 1 -- 172.21.15.123:0/2946148097 >> v2:172.21.15.123:3300/0 conn(0x7f2dec0c62d0 msgr2=0x7f2dec1529a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.533+0000 7f2df21e4640 1 --2- 172.21.15.123:0/2946148097 >> v2:172.21.15.123:3300/0 conn(0x7f2dec0c62d0 0x7f2dec1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.533+0000 7f2df19e3640 1 --2- 172.21.15.123:0/2946148097 >> v2:172.21.15.123:3300/0 conn(0x7f2dec0c62d0 0x7f2dec1529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.533+0000 7f2df19e3640 1 -- 172.21.15.123:0/2946148097 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec0c67b0 con 0x7f2dec0c9500 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.534+0000 7f2df21e4640 1 --2- 172.21.15.123:0/2946148097 >> v2:172.21.15.123:3300/0 conn(0x7f2dec0c62d0 0x7f2dec1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:50:35.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.535+0000 7f2df19e3640 1 --2- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec0c9500 0x7f2dec06de20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2de80097a0 tx=0x7f2de802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32861768b8be367a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.536+0000 7f2df09e1640 1 -- 172.21.15.123:0/2946148097 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8037070 con 0x7f2dec0c9500 2024-09-19T09:50:35.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.536+0000 7f2df09e1640 1 -- 172.21.15.123:0/2946148097 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de8032440 con 0x7f2dec0c9500 2024-09-19T09:50:35.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.537+0000 7f2df29e5640 1 -- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec0c9500 msgr2=0x7f2dec06de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.537+0000 7f2df29e5640 1 --2- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec0c9500 0x7f2dec06de20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2de80097a0 tx=0x7f2de802a210 comp rx=0 tx=0).stop 2024-09-19T09:50:35.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.555+0000 7f2df29e5640 1 -- 172.21.15.123:0/2946148097 shutdown_connections 2024-09-19T09:50:35.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.555+0000 7f2df29e5640 1 --2- 172.21.15.123:0/2946148097 >> v2:172.21.15.123:3300/0 conn(0x7f2dec0c62d0 0x7f2dec1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.555+0000 7f2df29e5640 1 --2- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec06e360 0x7f2dec0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.555+0000 7f2df29e5640 1 --2- 172.21.15.123:0/2946148097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec0c9500 0x7f2dec06de20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.555+0000 7f2df29e5640 1 -- 172.21.15.123:0/2946148097 >> 172.21.15.123:0/2946148097 conn(0x7f2dec0ce890 msgr2=0x7f2dec0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.562+0000 7f2df29e5640 1 -- 172.21.15.123:0/2946148097 shutdown_connections 2024-09-19T09:50:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.562+0000 7f2df29e5640 1 -- 172.21.15.123:0/2946148097 wait complete. 2024-09-19T09:50:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.563+0000 7f2df29e5640 1 Processor -- start 2024-09-19T09:50:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.564+0000 7f2df29e5640 1 -- start start 2024-09-19T09:50:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.565+0000 7f2df29e5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec06e360 0x7f2dec06d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.565+0000 7f2df29e5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 0x7f2dec157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.565+0000 7f2df29e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec0c9500 0x7f2dec06c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.565+0000 7f2df29e5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec1591f0 con 0x7f2dec0c62d0 2024-09-19T09:50:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.565+0000 7f2df29e5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec158f10 con 0x7f2dec06e360 2024-09-19T09:50:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.565+0000 7f2df29e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec1594d0 con 0x7f2dec0c9500 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.566+0000 7f2df11e2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 0x7f2dec157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.566+0000 7f2df11e2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 0x7f2dec157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36636/0 (socket says 172.21.15.123:36636) 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.566+0000 7f2df11e2640 1 -- 172.21.15.123:0/3294963779 learned_addr learned my addr 172.21.15.123:0/3294963779 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.567+0000 7f2df11e2640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec0c9500 msgr2=0x7f2dec06c260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.567+0000 7f2df11e2640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dec0c9500 0x7f2dec06c260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.567+0000 7f2df11e2640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec06e360 msgr2=0x7f2dec06d240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.567+0000 7f2df11e2640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dec06e360 0x7f2dec06d240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.567+0000 7f2df11e2640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec140720 con 0x7f2dec0c62d0 2024-09-19T09:50:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.567+0000 7f2df11e2640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 0x7f2dec157e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2de4007c00 tx=0x7f2de400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.568+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de400ddb0 con 0x7f2dec0c62d0 2024-09-19T09:50:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.568+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dec0ca360 con 0x7f2dec0c62d0 2024-09-19T09:50:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.568+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dec142310 con 0x7f2dec0c62d0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.569+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de4003990 con 0x7f2dec0c62d0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.569+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de4003d60 con 0x7f2dec0c62d0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.570+0000 7f2df29e5640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 0x7f2dec06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.570+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec0c98e0 con 0x7f2dec152ac0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.570+0000 7f2df19e3640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 0x7f2dec06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.570+0000 7f2df19e3640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dec1501d0 con 0x7f2dec152ac0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.574+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2de4004030 con 0x7f2dec0c62d0 2024-09-19T09:50:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.577+0000 7f2de27fc640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dd006c3b0 0x7f2dd006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.577+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f2de408b560 con 0x7f2dec0c62d0 2024-09-19T09:50:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.578+0000 7f2df19e3640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 0x7f2dec06c7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0cc3a0 tx=0x7f2de80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.578+0000 7f2df21e4640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dd006c3b0 0x7f2dd006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.578+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8037050 con 0x7f2dec152ac0 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.579+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2de8038040 con 0x7f2dec152ac0 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.579+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 msgr2=0x7f2dec06c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.579+0000 7f2de27fc640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 0x7f2dec06c7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0cc3a0 tx=0x7f2de80046c0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.579+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 msgr2=0x7f2dec06c7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:35.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.579+0000 7f2de27fc640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec152ac0 0x7f2dec06c7a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.580+0000 7f2df21e4640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dd006c3b0 0x7f2dd006e870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc006b10 tx=0x7f2ddc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.634+0000 7f2df29e5640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 0x7f2dec155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.634+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec0c8ab0 con 0x7f2dec155480 2024-09-19T09:50:35.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.634+0000 7f2df19e3640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 0x7f2dec155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.635+0000 7f2df19e3640 1 -- 172.21.15.123:0/3294963779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2dec1589a0 con 0x7f2dec155480 2024-09-19T09:50:35.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.636+0000 7f2df19e3640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 0x7f2dec155860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2de80097a0 tx=0x7f2de8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.636+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80093a0 con 0x7f2dec155480 2024-09-19T09:50:35.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.637+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f2de80093a0 con 0x7f2dec155480 2024-09-19T09:50:35.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.637+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 msgr2=0x7f2dec155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.637+0000 7f2de27fc640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 0x7f2dec155860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2de80097a0 tx=0x7f2de8009190 comp rx=0 tx=0).stop 2024-09-19T09:50:35.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.637+0000 7f2de27fc640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 msgr2=0x7f2dec155860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:35.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.637+0000 7f2de27fc640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec155480 0x7f2dec155860 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 46, 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 138856, 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.646 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:35.647 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:35.648 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:50:35.649 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:35.650 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:35.651 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.652 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.653 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:50:35.654 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:50:35.655 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.656 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:35.657 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:50:35.658 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:50:35.659 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:50:35.660 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:50:35.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dd006c3b0 msgr2=0x7f2dd006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dd006c3b0 0x7f2dd006e870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc006b10 tx=0x7f2ddc008040 comp rx=0 tx=0).stop 2024-09-19T09:50:35.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df21e4640 1 -- 172.21.15.123:0/3294963779 reap_dead start 2024-09-19T09:50:35.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 msgr2=0x7f2dec157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 0x7f2dec157e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2de4007c00 tx=0x7f2de400d4a0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 shutdown_connections 2024-09-19T09:50:35.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 --2- 172.21.15.123:0/3294963779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dec0c62d0 0x7f2dec157e10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.649+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 >> 172.21.15.123:0/3294963779 conn(0x7f2dec0ce890 msgr2=0x7f2dec13eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:35.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.653+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 shutdown_connections 2024-09-19T09:50:35.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.653+0000 7f2df29e5640 1 -- 172.21.15.123:0/3294963779 wait complete. 2024-09-19T09:50:35.704 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:50:35.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:50:35.705 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:50:35.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.920+0000 7fce27d5f640 1 Processor -- start 2024-09-19T09:50:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.922+0000 7fce27d5f640 1 -- start start 2024-09-19T09:50:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.923+0000 7fce27d5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce20153160 0x7fce200caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.923+0000 7fce27d5f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce2006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.923+0000 7fce27d5f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce200cb530 con 0x7fce2015c460 2024-09-19T09:50:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.923+0000 7fce27d5f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fce200ca880 con 0x7fce20153160 2024-09-19T09:50:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.923+0000 7fce27d5f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fce20153540 con 0x7fce200c3bd0 2024-09-19T09:50:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.924+0000 7fce262fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fce2015c460 0x7fce200731d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47360/0 (socket says 172.21.15.123:47360) 2024-09-19T09:50:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.924+0000 7fce262fc640 1 -- 172.21.15.123:0/856185339 learned_addr learned my addr 172.21.15.123:0/856185339 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:50:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.924+0000 7fce25afb640 1 --2- 172.21.15.123:0/856185339 >> v2:172.21.15.123:3300/0 conn(0x7fce20153160 0x7fce200caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.924+0000 7fce252fa640 1 --2- 172.21.15.123:0/856185339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce2006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.925+0000 7fce25afb640 1 -- 172.21.15.123:0/856185339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 msgr2=0x7fce2006f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.925+0000 7fce25afb640 1 --2- 172.21.15.123:0/856185339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce2006f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.925+0000 7fce25afb640 1 -- 172.21.15.123:0/856185339 >> v1:172.21.15.123:6789/0 conn(0x7fce2015c460 legacy=0x7fce200731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.925+0000 7fce25afb640 1 -- 172.21.15.123:0/856185339 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2006ecd0 con 0x7fce20153160 2024-09-19T09:50:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.927+0000 7fce25afb640 1 --2- 172.21.15.123:0/856185339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce20153160 0x7fce200caff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce18009d90 tx=0x7fce1802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f6f9da2341d49b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.928+0000 7fce24af9640 1 -- 172.21.15.123:0/856185339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18007740 con 0x7fce20153160 2024-09-19T09:50:35.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.928+0000 7fce24af9640 1 -- 172.21.15.123:0/856185339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce180078e0 con 0x7fce20153160 2024-09-19T09:50:35.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.928+0000 7fce24af9640 1 -- 172.21.15.123:0/856185339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18007cb0 con 0x7fce20153160 2024-09-19T09:50:35.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.929+0000 7fce27d5f640 1 -- 172.21.15.123:0/856185339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce20153160 msgr2=0x7fce200caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.929+0000 7fce27d5f640 1 --2- 172.21.15.123:0/856185339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce20153160 0x7fce200caff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce18009d90 tx=0x7fce1802a570 comp rx=0 tx=0).stop 2024-09-19T09:50:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.934+0000 7fce27d5f640 1 -- 172.21.15.123:0/856185339 shutdown_connections 2024-09-19T09:50:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.934+0000 7fce27d5f640 1 --2- 172.21.15.123:0/856185339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce2006f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.934+0000 7fce27d5f640 1 --2- 172.21.15.123:0/856185339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce20153160 0x7fce200caff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.934+0000 7fce27d5f640 1 -- 172.21.15.123:0/856185339 >> 172.21.15.123:0/856185339 conn(0x7fce200713d0 msgr2=0x7fce200cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.937+0000 7fce27d5f640 1 -- 172.21.15.123:0/856185339 shutdown_connections 2024-09-19T09:50:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.937+0000 7fce27d5f640 1 -- 172.21.15.123:0/856185339 wait complete. 2024-09-19T09:50:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.938+0000 7fce27d5f640 1 Processor -- start 2024-09-19T09:50:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.938+0000 7fce27d5f640 1 -- start start 2024-09-19T09:50:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.940+0000 7fce27d5f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce20157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.940+0000 7fce27d5f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce20153160 0x7fce20155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.940+0000 7fce27d5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce2015c460 0x7fce201562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.940+0000 7fce25afb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce20157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.940+0000 7fce25afb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce20157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:57122/0 (socket says 172.21.15.123:57122) 2024-09-19T09:50:35.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.941+0000 7fce262fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce2015c460 0x7fce201562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.941+0000 7fce262fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce2015c460 0x7fce201562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36680/0 (socket says 172.21.15.123:36680) 2024-09-19T09:50:35.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.941+0000 7fce25afb640 1 -- 172.21.15.123:0/372652582 learned_addr learned my addr 172.21.15.123:0/372652582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.941+0000 7fce27d5f640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fce2006e580 con 0x7fce2015c460 2024-09-19T09:50:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.941+0000 7fce27d5f640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fce2006e2a0 con 0x7fce20153160 2024-09-19T09:50:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.941+0000 7fce27d5f640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fce200caad0 con 0x7fce200c3bd0 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.942+0000 7fce262fc640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 msgr2=0x7fce20157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.942+0000 7fce262fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce20157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.942+0000 7fce262fc640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce20153160 msgr2=0x7fce20155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.942+0000 7fce262fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce20153160 0x7fce20155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.942+0000 7fce262fc640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20153dd0 con 0x7fce2015c460 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.942+0000 7fce262fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce2015c460 0x7fce201562c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fce1000c780 tx=0x7fce1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.943+0000 7fce25afb640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce200c3bd0 0x7fce20157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:50:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.943+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10018070 con 0x7fce2015c460 2024-09-19T09:50:35.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.943+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce100072d0 con 0x7fce2015c460 2024-09-19T09:50:35.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.943+0000 7fce27d5f640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce200cf210 con 0x7fce2015c460 2024-09-19T09:50:35.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.946+0000 7fce27d5f640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce20153af0 con 0x7fce2015c460 2024-09-19T09:50:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.947+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10007680 con 0x7fce2015c460 2024-09-19T09:50:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.947+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fce1001b070 con 0x7fce2015c460 2024-09-19T09:50:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.948+0000 7fce167fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fce0406c580 0x7fce0406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.949+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fce1008f060 con 0x7fce2015c460 2024-09-19T09:50:35.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.950+0000 7fce25afb640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fce0406c580 0x7fce0406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.950+0000 7fce27d5f640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 0x7fce08004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:35.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.950+0000 7fce27d5f640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fce08007ec0 con 0x7fce08002a70 2024-09-19T09:50:35.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.952+0000 7fce25afb640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fce0406c580 0x7fce0406ea40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fce18009bd0 tx=0x7fce1802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.957+0000 7fce252fa640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 0x7fce08004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:35.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.959+0000 7fce252fa640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce080080c0 con 0x7fce08002a70 2024-09-19T09:50:35.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.961+0000 7fce252fa640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 0x7fce08004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fce20152390 tx=0x7fce1c00d940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:35.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.963+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0125f0 con 0x7fce08002a70 2024-09-19T09:50:35.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.963+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fce1c019070 con 0x7fce08002a70 2024-09-19T09:50:35.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.963+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 msgr2=0x7fce08004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.963+0000 7fce167fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 0x7fce08004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fce20152390 tx=0x7fce1c00d940 comp rx=0 tx=0).stop 2024-09-19T09:50:35.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.963+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 msgr2=0x7fce08004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:35.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:35.963+0000 7fce167fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08002a70 0x7fce08004f30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.001+0000 7fce03fff640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 0x7fce0800cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.001+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fce0800a2e0 con 0x7fce08001de0 2024-09-19T09:50:36.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.001+0000 7fce252fa640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 0x7fce0800cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.002+0000 7fce252fa640 1 -- 172.21.15.123:0/372652582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fce0800a4e0 con 0x7fce08001de0 2024-09-19T09:50:36.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.002+0000 7fce252fa640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 0x7fce0800cbf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce1c015000 tx=0x7fce1c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.003+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c01e230 con 0x7fce08001de0 2024-09-19T09:50:36.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.003+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7fce1c01e230 con 0x7fce08001de0 2024-09-19T09:50:36.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.003+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 msgr2=0x7fce0800cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.004+0000 7fce167fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 0x7fce0800cbf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce1c015000 tx=0x7fce1c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.004+0000 7fce167fc640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 msgr2=0x7fce0800cbf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:36.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.004+0000 7fce167fc640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce08001de0 0x7fce0800cbf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.010 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:50:36.010 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:36.010 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:36.010 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:50:36.010 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 46, 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 20776, 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:36.011 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:36.012 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:36.013 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:50:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:36.015 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.016 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.017 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.018 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:50:36.019 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:36.020 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:50:36.021 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.022 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.023 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.024 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:36.024 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.024 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.024 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:50:36.024 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.010+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fce0406c580 msgr2=0x7fce0406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.010+0000 7fce03fff640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fce0406c580 0x7fce0406ea40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fce18009bd0 tx=0x7fce1802f000 comp rx=0 tx=0).stop 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.010+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce2015c460 msgr2=0x7fce201562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.010+0000 7fce03fff640 1 --2- 172.21.15.123:0/372652582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce2015c460 0x7fce201562c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fce1000c780 tx=0x7fce1000cc40 comp rx=0 tx=0).stop 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.010+0000 7fce262fc640 1 -- 172.21.15.123:0/372652582 reap_dead start 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.010+0000 7fce262fc640 1 -- 172.21.15.123:0/372652582 reap_dead start 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.012+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 shutdown_connections 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.012+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 >> 172.21.15.123:0/372652582 conn(0x7fce200713d0 msgr2=0x7fce2014c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.015+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 shutdown_connections 2024-09-19T09:50:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.015+0000 7fce03fff640 1 -- 172.21.15.123:0/372652582 wait complete. 2024-09-19T09:50:36.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:50:36.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:50:36.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:50:36.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.250+0000 7f5a35da8640 1 Processor -- start 2024-09-19T09:50:36.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.250+0000 7f5a35da8640 1 -- start start 2024-09-19T09:50:36.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.251+0000 7f5a35da8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5a301551d0 0x7f5a3015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.251+0000 7f5a35da8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a301555b0 0x7f5a300ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.251+0000 7f5a35da8640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3015e620 con 0x7f5a3015f300 2024-09-19T09:50:36.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.251+0000 7f5a35da8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5a300c5c50 con 0x7f5a301555b0 2024-09-19T09:50:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.251+0000 7f5a35da8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f5a3015b5f0 con 0x7f5a301551d0 2024-09-19T09:50:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.252+0000 7f5a2effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a301555b0 0x7f5a300ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.252+0000 7f5a2effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a301555b0 0x7f5a300ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36696/0 (socket says 172.21.15.123:36696) 2024-09-19T09:50:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.252+0000 7f5a2effd640 1 -- 172.21.15.123:0/3143983088 learned_addr learned my addr 172.21.15.123:0/3143983088 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:36.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.252+0000 7f5a2effd640 1 -- 172.21.15.123:0/3143983088 >> v2:172.21.15.194:3300/0 conn(0x7f5a301551d0 msgr2=0x7f5a3015edc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:50:36.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.252+0000 7f5a2effd640 1 --2- 172.21.15.123:0/3143983088 >> v2:172.21.15.194:3300/0 conn(0x7f5a301551d0 0x7f5a3015edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.253+0000 7f5a2effd640 1 -- 172.21.15.123:0/3143983088 >> v1:172.21.15.194:6789/0 conn(0x7f5a3015f300 legacy=0x7f5a3006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.253+0000 7f5a2effd640 1 -- 172.21.15.123:0/3143983088 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3015b8d0 con 0x7f5a301555b0 2024-09-19T09:50:36.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.254+0000 7f5a2effd640 1 --2- 172.21.15.123:0/3143983088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a301555b0 0x7f5a300ccb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5a3006d4c0 tx=0x7f5a2002a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2208a94046b510 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.256+0000 7f5a2e7fc640 1 -- 172.21.15.123:0/3143983088 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20037070 con 0x7f5a301555b0 2024-09-19T09:50:36.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.256+0000 7f5a2e7fc640 1 -- 172.21.15.123:0/3143983088 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a20032640 con 0x7f5a301555b0 2024-09-19T09:50:36.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.257+0000 7f5a35da8640 1 -- 172.21.15.123:0/3143983088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a301555b0 msgr2=0x7f5a300ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.257+0000 7f5a35da8640 1 --2- 172.21.15.123:0/3143983088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a301555b0 0x7f5a300ccb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5a3006d4c0 tx=0x7f5a2002a350 comp rx=0 tx=0).stop 2024-09-19T09:50:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.261+0000 7f5a35da8640 1 -- 172.21.15.123:0/3143983088 shutdown_connections 2024-09-19T09:50:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.261+0000 7f5a35da8640 1 --2- 172.21.15.123:0/3143983088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a301555b0 0x7f5a300ccb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.261+0000 7f5a35da8640 1 --2- 172.21.15.123:0/3143983088 >> v2:172.21.15.194:3300/0 conn(0x7f5a301551d0 0x7f5a3015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.261+0000 7f5a35da8640 1 -- 172.21.15.123:0/3143983088 >> 172.21.15.123:0/3143983088 conn(0x7f5a300d0e10 msgr2=0x7f5a300d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.264+0000 7f5a35da8640 1 -- 172.21.15.123:0/3143983088 shutdown_connections 2024-09-19T09:50:36.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.264+0000 7f5a35da8640 1 -- 172.21.15.123:0/3143983088 wait complete. 2024-09-19T09:50:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.266+0000 7f5a35da8640 1 Processor -- start 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.268+0000 7f5a35da8640 1 -- start start 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a35da8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a301551d0 0x7f5a30156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a35da8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a301555b0 0x7f5a300cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a35da8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3015f300 0x7f5a300cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a35da8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3015e8a0 con 0x7f5a3015f300 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a35da8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3015be90 con 0x7f5a301551d0 2024-09-19T09:50:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a35da8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3006cde0 con 0x7f5a301555b0 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.269+0000 7f5a2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3015f300 0x7f5a300cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a301555b0 0x7f5a300cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a301555b0 0x7f5a300cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:57126/0 (socket says 172.21.15.123:57126) 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2effd640 1 -- 172.21.15.123:0/1921435760 learned_addr learned my addr 172.21.15.123:0/1921435760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2ffff640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a301555b0 msgr2=0x7f5a300cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2ffff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a301555b0 0x7f5a300cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2ffff640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a301551d0 msgr2=0x7f5a30156af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2ffff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a301551d0 0x7f5a30156af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.270+0000 7f5a2ffff640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a30155ec0 con 0x7f5a3015f300 2024-09-19T09:50:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.271+0000 7f5a2ffff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3015f300 0x7f5a300cffc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c730 tx=0x7f5a2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.271+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28003b70 con 0x7f5a3015f300 2024-09-19T09:50:36.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.271+0000 7f5a35da8640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a301578e0 con 0x7f5a3015f300 2024-09-19T09:50:36.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.272+0000 7f5a35da8640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a30157ea0 con 0x7f5a3015f300 2024-09-19T09:50:36.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.272+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a28003d10 con 0x7f5a3015f300 2024-09-19T09:50:36.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.272+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28005310 con 0x7f5a3015f300 2024-09-19T09:50:36.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.277+0000 7f5a35da8640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 0x7f5a10004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.277+0000 7f5a35da8640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5a10007ec0 con 0x7f5a10002a70 2024-09-19T09:50:36.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.277+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a280054b0 con 0x7f5a3015f300 2024-09-19T09:50:36.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.278+0000 7f5a17fff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5a1c06c2b0 0x7f5a1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.278+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f5a2808b110 con 0x7f5a3015f300 2024-09-19T09:50:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.278+0000 7f5a2effd640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5a1c06c2b0 0x7f5a1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.279+0000 7f5a2effd640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5a1c06c2b0 0x7f5a1c06e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5a300cb360 tx=0x7f5a2002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.285+0000 7f5a2f7fe640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 0x7f5a10004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.290+0000 7f5a2f7fe640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a100080c0 con 0x7f5a10002a70 2024-09-19T09:50:36.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.290+0000 7f5a2f7fe640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 0x7f5a10004f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400b310 tx=0x7f5a2400b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.295+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24015020 con 0x7f5a10002a70 2024-09-19T09:50:36.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.295+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5a24011830 con 0x7f5a10002a70 2024-09-19T09:50:36.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.295+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 msgr2=0x7f5a10004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.295+0000 7f5a17fff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 0x7f5a10004f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400b310 tx=0x7f5a2400b7d0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.295+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 msgr2=0x7f5a10004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:36.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.295+0000 7f5a17fff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10002a70 0x7f5a10004f30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.315+0000 7f5a35da8640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 0x7f5a100073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.315+0000 7f5a35da8640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1000a4a0 con 0x7f5a10006f30 2024-09-19T09:50:36.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.318+0000 7f5a2f7fe640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 0x7f5a100073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.320+0000 7f5a2f7fe640 1 -- 172.21.15.123:0/1921435760 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5a10007900 con 0x7f5a10006f30 2024-09-19T09:50:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.324+0000 7f5a2f7fe640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 0x7f5a100073c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400b310 tx=0x7f5a240046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.326+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24015040 con 0x7f5a10006f30 2024-09-19T09:50:36.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.326+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7f5a24004220 con 0x7f5a10006f30 2024-09-19T09:50:36.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.326+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 msgr2=0x7f5a100073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.326+0000 7f5a17fff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 0x7f5a100073c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400b310 tx=0x7f5a240046e0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.326+0000 7f5a17fff640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 msgr2=0x7f5a100073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:36.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.326+0000 7f5a17fff640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a10006f30 0x7f5a100073c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.329 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:50:36.329 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 46, 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 245641, 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:50:36.330 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.331 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.332 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:50:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:36.334 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:36.335 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:36.336 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.337 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:36.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.339 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:36.340 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:50:36.341 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:50:36.342 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:36.343 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:36.344 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:36.344 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:36.344 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:36.344 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:36.344 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:50:36.344 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.335+0000 7f5a15ffb640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5a1c06c2b0 msgr2=0x7f5a1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.335+0000 7f5a15ffb640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f5a1c06c2b0 0x7f5a1c06e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5a300cb360 tx=0x7f5a2002e000 comp rx=0 tx=0).stop 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.335+0000 7f5a15ffb640 1 -- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3015f300 msgr2=0x7f5a300cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.335+0000 7f5a2ffff640 1 -- 172.21.15.123:0/1921435760 reap_dead start 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.335+0000 7f5a15ffb640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3015f300 0x7f5a300cffc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c730 tx=0x7f5a2800cbf0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.336+0000 7f5a15ffb640 1 -- 172.21.15.123:0/1921435760 shutdown_connections 2024-09-19T09:50:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.336+0000 7f5a15ffb640 1 --2- 172.21.15.123:0/1921435760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a3015f300 0x7f5a300cffc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.336+0000 7f5a15ffb640 1 -- 172.21.15.123:0/1921435760 >> 172.21.15.123:0/1921435760 conn(0x7f5a300d0e10 msgr2=0x7f5a300d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:36.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.336+0000 7f5a15ffb640 1 -- 172.21.15.123:0/1921435760 shutdown_connections 2024-09-19T09:50:36.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.336+0000 7f5a15ffb640 1 -- 172.21.15.123:0/1921435760 wait complete. 2024-09-19T09:50:36.364 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:50:36.364 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:50:36.365 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.560+0000 7f2d4c10a640 1 Processor -- start 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.560+0000 7f2d4c10a640 1 -- start start 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4c10a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d44152e00 0x7f2d4415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4c10a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d44073260 0x7f2d440736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4c10a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d440c8700 con 0x7f2d4406de20 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4c10a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f2d4415c440 con 0x7f2d44073260 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4c10a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4415ca00 con 0x7f2d44152e00 2024-09-19T09:50:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4a6a7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d44073260 0x7f2d440736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4a6a7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d44073260 0x7f2d440736d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:60306/0 (socket says 172.21.15.123:60306) 2024-09-19T09:50:36.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.562+0000 7f2d4a6a7640 1 -- 172.21.15.123:0/3641267668 learned_addr learned my addr 172.21.15.123:0/3641267668 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:36.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.563+0000 7f2d49ea6640 1 --2- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d44152e00 0x7f2d4415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.563+0000 7f2d4a6a7640 1 -- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d44152e00 msgr2=0x7f2d4415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.563+0000 7f2d4a6a7640 1 --2- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d44152e00 0x7f2d4415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.563+0000 7f2d4a6a7640 1 -- 172.21.15.123:0/3641267668 >> v1:172.21.15.194:6789/0 conn(0x7f2d4406de20 legacy=0x7f2d441598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.563+0000 7f2d4a6a7640 1 -- 172.21.15.123:0/3641267668 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d440c89e0 con 0x7f2d44073260 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.564+0000 7f2d4a6a7640 1 --2- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d44073260 0x7f2d440736d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009e50 tx=0x7f2d3c02eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12a4226de1109292 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.564+0000 7f2d48ea4640 1 -- 172.21.15.123:0/3641267668 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c036070 con 0x7f2d44073260 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.564+0000 7f2d48ea4640 1 -- 172.21.15.123:0/3641267668 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c030680 con 0x7f2d44073260 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.565+0000 7f2d4c10a640 1 -- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d44073260 msgr2=0x7f2d440736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.565+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d44073260 0x7f2d440736d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009e50 tx=0x7f2d3c02eb70 comp rx=0 tx=0).stop 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.566+0000 7f2d4c10a640 1 -- 172.21.15.123:0/3641267668 shutdown_connections 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.566+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d44073260 0x7f2d440736d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.566+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/3641267668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d44152e00 0x7f2d4415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.566+0000 7f2d4c10a640 1 -- 172.21.15.123:0/3641267668 >> 172.21.15.123:0/3641267668 conn(0x7f2d440ce9b0 msgr2=0x7f2d440ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:36.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.570+0000 7f2d4c10a640 1 -- 172.21.15.123:0/3641267668 shutdown_connections 2024-09-19T09:50:36.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.570+0000 7f2d4c10a640 1 -- 172.21.15.123:0/3641267668 wait complete. 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.572+0000 7f2d4c10a640 1 Processor -- start 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.572+0000 7f2d4c10a640 1 -- start start 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.573+0000 7f2d4c10a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 0x7f2d4415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.573+0000 7f2d4c10a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d44152e00 0x7f2d44140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.573+0000 7f2d4c10a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d440cd4c0 0x7f2d440cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.573+0000 7f2d4c10a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4415c690 con 0x7f2d44152e00 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.573+0000 7f2d4c10a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4415d3d0 con 0x7f2d440cd4c0 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.573+0000 7f2d4c10a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2d441531e0 con 0x7f2d4406de20 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.574+0000 7f2d49ea6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 0x7f2d4415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.574+0000 7f2d49ea6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 0x7f2d4415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:57162/0 (socket says 172.21.15.123:57162) 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.574+0000 7f2d49ea6640 1 -- 172.21.15.123:0/2455470285 learned_addr learned my addr 172.21.15.123:0/2455470285 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.575+0000 7f2d496a5640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d44152e00 0x7f2d44140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.575+0000 7f2d49ea6640 1 -- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d440cd4c0 msgr2=0x7f2d440cca30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.575+0000 7f2d49ea6640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d440cd4c0 0x7f2d440cca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.575+0000 7f2d49ea6640 1 -- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d44152e00 msgr2=0x7f2d44140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.575+0000 7f2d49ea6640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d44152e00 0x7f2d44140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.575+0000 7f2d49ea6640 1 -- 172.21.15.123:0/2455470285 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4415a090 con 0x7f2d4406de20 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.576+0000 7f2d496a5640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d44152e00 0x7f2d44140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.576+0000 7f2d49ea6640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 0x7f2d4415b110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400d620 tx=0x7f2d3400dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.577+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400b620 con 0x7f2d4406de20 2024-09-19T09:50:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.577+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4415a350 con 0x7f2d4406de20 2024-09-19T09:50:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.577+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4406cfe0 con 0x7f2d4406de20 2024-09-19T09:50:36.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.580+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d440c9470 con 0x7f2d4406de20 2024-09-19T09:50:36.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.580+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d34019070 con 0x7f2d4406de20 2024-09-19T09:50:36.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.580+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400b9e0 con 0x7f2d4406de20 2024-09-19T09:50:36.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.584+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2d3400bb80 con 0x7f2d4406de20 2024-09-19T09:50:36.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.585+0000 7f2d3a7fc640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2d2806c2e0 0x7f2d2806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.585+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f2d3408c320 con 0x7f2d4406de20 2024-09-19T09:50:36.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.586+0000 7f2d496a5640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2d2806c2e0 0x7f2d2806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.588+0000 7f2d496a5640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2d2806c2e0 0x7f2d2806e7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2d44151f80 tx=0x7f2d40007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:36.593+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2d3405a9f0 con 0x7f2d4406de20 2024-09-19T09:50:37.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.096+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2d44143560 con 0x7f2d4406de20 2024-09-19T09:50:37.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.100+0000 7f2d3a7fc640 1 -- 172.21.15.123:0/2455470285 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f2d3405a2f0 con 0x7f2d4406de20 2024-09-19T09:50:37.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2d2806c2e0 msgr2=0x7f2d2806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:37.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2d2806c2e0 0x7f2d2806e7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2d44151f80 tx=0x7f2d40007e30 comp rx=0 tx=0).stop 2024-09-19T09:50:37.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 msgr2=0x7f2d4415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:37.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 0x7f2d4415b110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400d620 tx=0x7f2d3400dae0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 shutdown_connections 2024-09-19T09:50:37.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d440cd4c0 0x7f2d440cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d44152e00 0x7f2d44140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2d2806c2e0 0x7f2d2806e7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 --2- 172.21.15.123:0/2455470285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4406de20 0x7f2d4415b110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.114+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 >> 172.21.15.123:0/2455470285 conn(0x7f2d440ce9b0 msgr2=0x7f2d44143d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:37.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.117+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 shutdown_connections 2024-09-19T09:50:37.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:37.117+0000 7f2d4c10a640 1 -- 172.21.15.123:0/2455470285 wait complete. 2024-09-19T09:50:37.150 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:50:47.151 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:50:47.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:50:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.394+0000 7f50db59e640 1 Processor -- start 2024-09-19T09:50:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.394+0000 7f50db59e640 1 -- start start 2024-09-19T09:50:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.395+0000 7f50db59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d404aa40 0x7f50d4005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.395+0000 7f50db59e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f50d40ff830 0x7f50d40ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.395+0000 7f50db59e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d41005c0 con 0x7f50d4046390 2024-09-19T09:50:47.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.395+0000 7f50db59e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f50d4045660 con 0x7f50d40ff830 2024-09-19T09:50:47.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.395+0000 7f50db59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f50d4045f00 con 0x7f50d404aa40 2024-09-19T09:50:47.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.396+0000 7f50d9d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50d4046390 0x7f50d40f6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55504/0 (socket says 172.21.15.123:55504) 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.396+0000 7f50d9d9b640 1 -- 172.21.15.123:0/283920488 learned_addr learned my addr 172.21.15.123:0/283920488 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.396+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001770045 0 0) 0x7f50d41005c0 con 0x7f50d4046390 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.396+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c4003520 con 0x7f50d4046390 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1078944581 0 0) 0x7f50c4003520 con 0x7f50d4046390 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50dad9d640 1 --2- 172.21.15.123:0/283920488 >> v2:172.21.15.194:3300/0 conn(0x7f50d40ff830 0x7f50d40ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d404aa40 msgr2=0x7f50d4005a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d404aa40 0x7f50d4005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 >> v2:172.21.15.194:3300/0 conn(0x7f50d40ff830 msgr2=0x7f50d40ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 --2- 172.21.15.123:0/283920488 >> v2:172.21.15.194:3300/0 conn(0x7f50d40ff830 0x7f50d40ffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d40458b0 con 0x7f50d4046390 2024-09-19T09:50:47.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f50cc001670 con 0x7f50d4046390 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 >> v1:172.21.15.123:6789/0 conn(0x7f50d4046390 legacy=0x7f50d40f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50c40039b0 0x7f50c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50c4004800 0x7f50c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50c40052e0 0x7f50c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4045660 con 0x7f50c4004800 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4045f00 con 0x7f50c40039b0 2024-09-19T09:50:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.397+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f50c400c1a0 con 0x7f50c40052e0 2024-09-19T09:50:47.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50dad9d640 1 --2- 172.21.15.123:0/283920488 >> v2:172.21.15.194:3300/0 conn(0x7f50d40ff830 0x7f50d40ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:50:47.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50c4004800 0x7f50c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50d9d9b640 1 -- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50c40052e0 msgr2=0x7f50c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:47.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50c40052e0 0x7f50c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50d9d9b640 1 -- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50c40039b0 msgr2=0x7f50c4003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50c40039b0 0x7f50c4003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.398+0000 7f50d9d9b640 1 -- 172.21.15.123:0/283920488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d40458b0 con 0x7f50c4004800 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.400+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50c4004800 0x7f50c4004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c290 tx=0x7f50c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f995463f882e927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.401+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc007d70 con 0x7f50c4004800 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.401+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc037070 con 0x7f50c4004800 2024-09-19T09:50:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.401+0000 7f50d959a640 1 -- 172.21.15.123:0/283920488 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc033e60 con 0x7f50c4004800 2024-09-19T09:50:47.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.402+0000 7f50db59e640 1 -- 172.21.15.123:0/283920488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50c4004800 msgr2=0x7f50c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.402+0000 7f50db59e640 1 --2- 172.21.15.123:0/283920488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50c4004800 0x7f50c4004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c290 tx=0x7f50c4005830 comp rx=0 tx=0).stop 2024-09-19T09:50:47.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.404+0000 7f50dad9d640 1 -- 172.21.15.123:0/283920488 reap_dead start 2024-09-19T09:50:47.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.404+0000 7f50db59e640 1 -- 172.21.15.123:0/283920488 shutdown_connections 2024-09-19T09:50:47.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.404+0000 7f50db59e640 1 -- 172.21.15.123:0/283920488 >> 172.21.15.123:0/283920488 conn(0x7f50d404fc50 msgr2=0x7f50d4050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:47.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.407+0000 7f50db59e640 1 -- 172.21.15.123:0/283920488 shutdown_connections 2024-09-19T09:50:47.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.411+0000 7f50db59e640 1 -- 172.21.15.123:0/283920488 wait complete. 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.413+0000 7f50db59e640 1 Processor -- start 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.413+0000 7f50db59e640 1 -- start start 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.414+0000 7f50db59e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d41890c0 0x7f50d40ff060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.414+0000 7f50db59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d41894a0 0x7f50d40f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.414+0000 7f50db59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50d40f1660 0x7f50d40ec480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.414+0000 7f50db59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4046910 con 0x7f50d40f1660 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.414+0000 7f50db59e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4046790 con 0x7f50d41890c0 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.414+0000 7f50db59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f50d4005a00 con 0x7f50d41894a0 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.415+0000 7f50d9d9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d41894a0 0x7f50d40f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.415+0000 7f50da59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d41890c0 0x7f50d40ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.415+0000 7f50da59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d41890c0 0x7f50d40ff060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55724/0 (socket says 172.21.15.123:55724) 2024-09-19T09:50:47.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.415+0000 7f50da59c640 1 -- 172.21.15.123:0/4273797143 learned_addr learned my addr 172.21.15.123:0/4273797143 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:47.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.416+0000 7f50d9d9b640 1 -- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d41890c0 msgr2=0x7f50d40ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.416+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d41890c0 0x7f50d40ff060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.416+0000 7f50d9d9b640 1 -- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50d40f1660 msgr2=0x7f50d40ec480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.416+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50d40f1660 0x7f50d40ec480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.416+0000 7f50d9d9b640 1 -- 172.21.15.123:0/4273797143 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d4195e00 con 0x7f50d41894a0 2024-09-19T09:50:47.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.416+0000 7f50d9d9b640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d41894a0 0x7f50d40f2300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50cc038000 tx=0x7f50cc001970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.419+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc004cb0 con 0x7f50d41894a0 2024-09-19T09:50:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.419+0000 7f50db59e640 1 -- 172.21.15.123:0/4273797143 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d41960e0 con 0x7f50d41894a0 2024-09-19T09:50:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.419+0000 7f50db59e640 1 -- 172.21.15.123:0/4273797143 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d40f0e60 con 0x7f50d41894a0 2024-09-19T09:50:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.419+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc007070 con 0x7f50d41894a0 2024-09-19T09:50:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.419+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc007460 con 0x7f50d41894a0 2024-09-19T09:50:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.423+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50cc007600 con 0x7f50d41894a0 2024-09-19T09:50:47.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.424+0000 7f50caffd640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f50bc06c2b0 0x7f50bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.424+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f50cc0b3bb0 con 0x7f50d41894a0 2024-09-19T09:50:47.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.426+0000 7f50db59e640 1 -- 172.21.15.123:0/4273797143 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c0005290 con 0x7f50d41894a0 2024-09-19T09:50:47.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.426+0000 7f50da59c640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f50bc06c2b0 0x7f50bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.427+0000 7f50da59c640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f50bc06c2b0 0x7f50bc06e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f50d000b7b0 tx=0x7f50d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:47.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:47.436+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f50cc039320 con 0x7f50d41894a0 2024-09-19T09:50:48.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.030+0000 7f50db59e640 1 -- 172.21.15.123:0/4273797143 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f50c0005580 con 0x7f50d41894a0 2024-09-19T09:50:48.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.031+0000 7f50caffd640 1 -- 172.21.15.123:0/4273797143 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f50cc082210 con 0x7f50d41894a0 2024-09-19T09:50:48.033 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.035+0000 7f50c8ff9640 1 -- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f50bc06c2b0 msgr2=0x7f50bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.035+0000 7f50c8ff9640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f50bc06c2b0 0x7f50bc06e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f50d000b7b0 tx=0x7f50d0008040 comp rx=0 tx=0).stop 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.035+0000 7f50c8ff9640 1 -- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d41894a0 msgr2=0x7f50d40f2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.035+0000 7f50c8ff9640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d41894a0 0x7f50d40f2300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50cc038000 tx=0x7f50cc001970 comp rx=0 tx=0).stop 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 -- 172.21.15.123:0/4273797143 shutdown_connections 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50d40f1660 0x7f50d40ec480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f50bc06c2b0 0x7f50bc06e770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50d41894a0 0x7f50d40f2300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 --2- 172.21.15.123:0/4273797143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d41890c0 0x7f50d40ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 -- 172.21.15.123:0/4273797143 >> 172.21.15.123:0/4273797143 conn(0x7f50d404fc50 msgr2=0x7f50d4050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 -- 172.21.15.123:0/4273797143 shutdown_connections 2024-09-19T09:50:48.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.036+0000 7f50c8ff9640 1 -- 172.21.15.123:0/4273797143 wait complete. 2024-09-19T09:50:48.062 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:50:48.062 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:50:48.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:50:48.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:50:48.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.294+0000 7fad4721e640 1 Processor -- start 2024-09-19T09:50:48.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.294+0000 7fad4721e640 1 -- start start 2024-09-19T09:50:48.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.295+0000 7fad4721e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad40154f80 0x7fad4006be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.295+0000 7fad4721e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c8ca0 0x7fad4006c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.295+0000 7fad4721e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4015b020 con 0x7fad400c7dd0 2024-09-19T09:50:48.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.295+0000 7fad4721e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fad4015b300 con 0x7fad40154f80 2024-09-19T09:50:48.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.295+0000 7fad4721e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fad4015b5e0 con 0x7fad400c8ca0 2024-09-19T09:50:48.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.296+0000 7fad457bb640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fad400c7dd0 0x7fad4006e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:50290/0 (socket says 172.21.15.123:50290) 2024-09-19T09:50:48.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.296+0000 7fad457bb640 1 -- 172.21.15.123:0/2922867948 learned_addr learned my addr 172.21.15.123:0/2922867948 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:50:48.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.296+0000 7fad3ffff640 1 --2- 172.21.15.123:0/2922867948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c8ca0 0x7fad4006c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.296+0000 7fad44fba640 1 --2- 172.21.15.123:0/2922867948 >> v2:172.21.15.123:3300/0 conn(0x7fad40154f80 0x7fad4006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.297+0000 7fad3f7fe640 1 -- 172.21.15.123:0/2922867948 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485405468 0 0) 0x7fad4015b020 con 0x7fad400c7dd0 2024-09-19T09:50:48.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.297+0000 7fad3f7fe640 1 -- 172.21.15.123:0/2922867948 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad28003520 con 0x7fad400c7dd0 2024-09-19T09:50:48.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.297+0000 7fad3ffff640 1 -- 172.21.15.123:0/2922867948 >> v2:172.21.15.123:3300/0 conn(0x7fad40154f80 msgr2=0x7fad4006be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:48.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.297+0000 7fad3ffff640 1 --2- 172.21.15.123:0/2922867948 >> v2:172.21.15.123:3300/0 conn(0x7fad40154f80 0x7fad4006be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.297+0000 7fad3ffff640 1 -- 172.21.15.123:0/2922867948 >> v1:172.21.15.194:6789/0 conn(0x7fad400c7dd0 legacy=0x7fad4006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.297+0000 7fad3ffff640 1 -- 172.21.15.123:0/2922867948 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4015b8c0 con 0x7fad400c8ca0 2024-09-19T09:50:48.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.298+0000 7fad3ffff640 1 --2- 172.21.15.123:0/2922867948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c8ca0 0x7fad4006c360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad300097a0 tx=0x7fad3002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24d7b08205ac34ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.298+0000 7fad3f7fe640 1 -- 172.21.15.123:0/2922867948 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30037070 con 0x7fad400c8ca0 2024-09-19T09:50:48.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.298+0000 7fad3f7fe640 1 -- 172.21.15.123:0/2922867948 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad30032440 con 0x7fad400c8ca0 2024-09-19T09:50:48.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.298+0000 7fad3f7fe640 1 -- 172.21.15.123:0/2922867948 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30032830 con 0x7fad400c8ca0 2024-09-19T09:50:48.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.299+0000 7fad4721e640 1 -- 172.21.15.123:0/2922867948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c8ca0 msgr2=0x7fad4006c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.299+0000 7fad4721e640 1 --2- 172.21.15.123:0/2922867948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c8ca0 0x7fad4006c360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad300097a0 tx=0x7fad3002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.301+0000 7fad4721e640 1 -- 172.21.15.123:0/2922867948 shutdown_connections 2024-09-19T09:50:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.301+0000 7fad4721e640 1 --2- 172.21.15.123:0/2922867948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c8ca0 0x7fad4006c360 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.301+0000 7fad4721e640 1 --2- 172.21.15.123:0/2922867948 >> v2:172.21.15.123:3300/0 conn(0x7fad40154f80 0x7fad4006be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.301+0000 7fad4721e640 1 -- 172.21.15.123:0/2922867948 >> 172.21.15.123:0/2922867948 conn(0x7fad400cc670 msgr2=0x7fad400cca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.304+0000 7fad4721e640 1 -- 172.21.15.123:0/2922867948 shutdown_connections 2024-09-19T09:50:48.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.306+0000 7fad4721e640 1 -- 172.21.15.123:0/2922867948 wait complete. 2024-09-19T09:50:48.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.308+0000 7fad4721e640 1 Processor -- start 2024-09-19T09:50:48.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.308+0000 7fad4721e640 1 -- start start 2024-09-19T09:50:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.309+0000 7fad4721e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c7dd0 0x7fad401592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad4721e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad400c8ca0 0x7fad400ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad4721e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 0x7fad400cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad44fba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c7dd0 0x7fad401592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad44fba640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c7dd0 0x7fad401592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:53210/0 (socket says 172.21.15.123:53210) 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad3ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad400c8ca0 0x7fad400ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad3ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad400c8ca0 0x7fad400ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55732/0 (socket says 172.21.15.123:55732) 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad457bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 0x7fad400cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad457bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 0x7fad400cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49796/0 (socket says 172.21.15.123:49796) 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.310+0000 7fad4721e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad401554e0 con 0x7fad40154f80 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.311+0000 7fad4721e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fad40155360 con 0x7fad400c8ca0 2024-09-19T09:50:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.311+0000 7fad4721e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fad4006ef10 con 0x7fad400c7dd0 2024-09-19T09:50:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.311+0000 7fad44fba640 1 -- 172.21.15.123:0/7733334 learned_addr learned my addr 172.21.15.123:0/7733334 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.312+0000 7fad457bb640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c7dd0 msgr2=0x7fad401592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.312+0000 7fad457bb640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad400c7dd0 0x7fad401592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.312+0000 7fad457bb640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad400c8ca0 msgr2=0x7fad400ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.312+0000 7fad457bb640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad400c8ca0 0x7fad400ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.312+0000 7fad457bb640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad40144820 con 0x7fad40154f80 2024-09-19T09:50:48.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.312+0000 7fad457bb640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 0x7fad400cac90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad3800cdf0 tx=0x7fad3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.314+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38017070 con 0x7fad40154f80 2024-09-19T09:50:48.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.314+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3800ad40 con 0x7fad40154f80 2024-09-19T09:50:48.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.314+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38012600 con 0x7fad40154f80 2024-09-19T09:50:48.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.315+0000 7fad4721e640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad40143930 con 0x7fad40154f80 2024-09-19T09:50:48.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.318+0000 7fad4721e640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad40143ef0 con 0x7fad40154f80 2024-09-19T09:50:48.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.318+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fad3801a070 con 0x7fad40154f80 2024-09-19T09:50:48.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.321+0000 7fad3d7fa640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad2c06c300 0x7fad2c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.321+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fad3808aff0 con 0x7fad40154f80 2024-09-19T09:50:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.322+0000 7fad26ffd640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 0x7fad40144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.322+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad40143700 con 0x7fad4015a4a0 2024-09-19T09:50:48.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.322+0000 7fad44fba640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad2c06c300 0x7fad2c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.322+0000 7fad3ffff640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 0x7fad40144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.323+0000 7fad3ffff640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad400c82a0 con 0x7fad4015a4a0 2024-09-19T09:50:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.324+0000 7fad44fba640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad2c06c300 0x7fad2c06e7c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad34009af0 tx=0x7fad34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.324+0000 7fad3ffff640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 0x7fad40144130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad4015f4c0 tx=0x7fad300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.325+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30037040 con 0x7fad4015a4a0 2024-09-19T09:50:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.325+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fad30003b90 con 0x7fad4015a4a0 2024-09-19T09:50:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.325+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 msgr2=0x7fad40144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.325+0000 7fad3d7fa640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 0x7fad40144130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad4015f4c0 tx=0x7fad300046c0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.325+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 msgr2=0x7fad40144130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:48.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.325+0000 7fad3d7fa640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4015a4a0 0x7fad40144130 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad4015f4c0 tx=0x7fad300046c0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.351+0000 7fad26ffd640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 0x7fad401f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.351+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad40145af0 con 0x7fad401f4180 2024-09-19T09:50:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.352+0000 7fad3ffff640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 0x7fad401f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.352+0000 7fad3ffff640 1 -- 172.21.15.123:0/7733334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad401597e0 con 0x7fad401f4180 2024-09-19T09:50:48.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.353+0000 7fad3ffff640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 0x7fad401f4560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad3002a1e0 tx=0x7fad30008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.358+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30037040 con 0x7fad401f4180 2024-09-19T09:50:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.358+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fad30046750 con 0x7fad401f4180 2024-09-19T09:50:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.358+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 msgr2=0x7fad401f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.358+0000 7fad3d7fa640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 0x7fad401f4560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad3002a1e0 tx=0x7fad30008030 comp rx=0 tx=0).stop 2024-09-19T09:50:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.358+0000 7fad3d7fa640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 msgr2=0x7fad401f4560 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.358+0000 7fad3d7fa640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad401f4180 0x7fad401f4560 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad3002a1e0 tx=0x7fad30008030 comp rx=0 tx=0).stop 2024-09-19T09:50:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:50:48.364 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:48.364 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 46, 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 151573, 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.365 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:50:48.366 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:48.366 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:50:48.366 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:50:48.366 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.367 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.368 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:50:48.369 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.370 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:48.371 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:48.372 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.373 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:48.374 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.375 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.376 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.377 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:50:48.379 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.361+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad2c06c300 msgr2=0x7fad2c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.361+0000 7fad26ffd640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad2c06c300 0x7fad2c06e7c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad34009af0 tx=0x7fad34008040 comp rx=0 tx=0).stop 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.362+0000 7fad457bb640 1 -- 172.21.15.123:0/7733334 reap_dead start 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.362+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 msgr2=0x7fad400cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.362+0000 7fad26ffd640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 0x7fad400cac90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad3800cdf0 tx=0x7fad3800a430 comp rx=0 tx=0).stop 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.362+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 shutdown_connections 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.362+0000 7fad26ffd640 1 --2- 172.21.15.123:0/7733334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad40154f80 0x7fad400cac90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.362+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 >> 172.21.15.123:0/7733334 conn(0x7fad400cc670 msgr2=0x7fad40072120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.364+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 shutdown_connections 2024-09-19T09:50:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.364+0000 7fad26ffd640 1 -- 172.21.15.123:0/7733334 wait complete. 2024-09-19T09:50:48.395 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:50:48.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:50:48.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:50:48.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.607+0000 7f8e68d4b640 1 Processor -- start 2024-09-19T09:50:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.608+0000 7f8e68d4b640 1 -- start start 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.610+0000 7f8e68d4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e64159720 0x7f8e640c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.610+0000 7f8e68d4b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 0x7f8e6415ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.610+0000 7f8e68d4b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e641604a0 con 0x7f8e640c2870 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.610+0000 7f8e68d4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8e640c7c00 con 0x7f8e64159720 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.610+0000 7f8e68d4b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8e64162b70 con 0x7f8e640c34c0 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.611+0000 7f8e62d9d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8e640c2870 0x7f8e640c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:50304/0 (socket says 172.21.15.123:50304) 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.611+0000 7f8e62d9d640 1 -- 172.21.15.123:0/2139951289 learned_addr learned my addr 172.21.15.123:0/2139951289 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.611+0000 7f8e61d9b640 1 --2- 172.21.15.123:0/2139951289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 0x7f8e6415ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.611+0000 7f8e6259c640 1 --2- 172.21.15.123:0/2139951289 >> v2:172.21.15.123:3300/0 conn(0x7f8e64159720 0x7f8e640c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.612+0000 7f8e6259c640 1 -- 172.21.15.123:0/2139951289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 msgr2=0x7f8e6415ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.612+0000 7f8e6259c640 1 --2- 172.21.15.123:0/2139951289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 0x7f8e6415ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.613+0000 7f8e6159a640 1 -- 172.21.15.123:0/2139951289 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745300408 0 0) 0x7f8e5c001490 con 0x7f8e640c2870 2024-09-19T09:50:48.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.614+0000 7f8e6259c640 1 -- 172.21.15.123:0/2139951289 >> v1:172.21.15.194:6789/0 conn(0x7f8e640c2870 legacy=0x7f8e640c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.614+0000 7f8e6259c640 1 -- 172.21.15.123:0/2139951289 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e64162e50 con 0x7f8e64159720 2024-09-19T09:50:48.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.617+0000 7f8e6259c640 1 --2- 172.21.15.123:0/2139951289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e64159720 0x7f8e640c7590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097a0 tx=0x7f8e5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ff89ff0b7dc410 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.617+0000 7f8e6159a640 1 -- 172.21.15.123:0/2139951289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037070 con 0x7f8e64159720 2024-09-19T09:50:48.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.617+0000 7f8e6159a640 1 -- 172.21.15.123:0/2139951289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58032440 con 0x7f8e64159720 2024-09-19T09:50:48.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.618+0000 7f8e68d4b640 1 -- 172.21.15.123:0/2139951289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e64159720 msgr2=0x7f8e640c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.618+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/2139951289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e64159720 0x7f8e640c7590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097a0 tx=0x7f8e5802a180 comp rx=0 tx=0).stop 2024-09-19T09:50:48.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.619+0000 7f8e68d4b640 1 -- 172.21.15.123:0/2139951289 shutdown_connections 2024-09-19T09:50:48.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.619+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/2139951289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 0x7f8e6415ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.619+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/2139951289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e64159720 0x7f8e640c7590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.619+0000 7f8e68d4b640 1 -- 172.21.15.123:0/2139951289 >> 172.21.15.123:0/2139951289 conn(0x7f8e6406f110 msgr2=0x7f8e6406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.623+0000 7f8e68d4b640 1 -- 172.21.15.123:0/2139951289 shutdown_connections 2024-09-19T09:50:48.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.624+0000 7f8e68d4b640 1 -- 172.21.15.123:0/2139951289 wait complete. 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.626+0000 7f8e68d4b640 1 Processor -- start 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.626+0000 7f8e68d4b640 1 -- start start 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e68d4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 0x7f8e6415c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e68d4b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 0x7f8e64153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e68d4b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64159720 0x7f8e64150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e68d4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64159b00 con 0x7f8e640c2870 2024-09-19T09:50:48.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e68d4b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64163410 con 0x7f8e64159720 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e68d4b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8e640c8990 con 0x7f8e640c34c0 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e6259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 0x7f8e6415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e6259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 0x7f8e6415c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49828/0 (socket says 172.21.15.123:49828) 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.628+0000 7f8e6259c640 1 -- 172.21.15.123:0/4248579992 learned_addr learned my addr 172.21.15.123:0/4248579992 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.629+0000 7f8e6259c640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 msgr2=0x7f8e64153490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.629+0000 7f8e6259c640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e640c34c0 0x7f8e64153490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.629+0000 7f8e6259c640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64159720 msgr2=0x7f8e64150440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:48.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.629+0000 7f8e6259c640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e64159720 0x7f8e64150440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.629+0000 7f8e6259c640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e640c3f90 con 0x7f8e640c2870 2024-09-19T09:50:48.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.629+0000 7f8e6259c640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 0x7f8e6415c730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8e5802a770 tx=0x7f8e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.630+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58040020 con 0x7f8e640c2870 2024-09-19T09:50:48.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.630+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6415a9d0 con 0x7f8e640c2870 2024-09-19T09:50:48.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.630+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e64159ef0 con 0x7f8e640c2870 2024-09-19T09:50:48.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.630+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58032e50 con 0x7f8e640c2870 2024-09-19T09:50:48.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.631+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037070 con 0x7f8e640c2870 2024-09-19T09:50:48.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.632+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 0x7f8e48004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.632+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48007ec0 con 0x7f8e48002a70 2024-09-19T09:50:48.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.632+0000 7f8e61d9b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 0x7f8e48004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.633+0000 7f8e61d9b640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e480080c0 con 0x7f8e48002a70 2024-09-19T09:50:48.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.633+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8e58043020 con 0x7f8e640c2870 2024-09-19T09:50:48.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.633+0000 7f8e61d9b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 0x7f8e48004f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e640b2980 tx=0x7f8e5400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.634+0000 7f8e52ffd640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8e4406c2b0 0x7f8e4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.634+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f8e580aba80 con 0x7f8e640c2870 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.634+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54017070 con 0x7f8e48002a70 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.634+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8e5400c6f0 con 0x7f8e48002a70 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.635+0000 7f8e62d9d640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8e4406c2b0 0x7f8e4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.635+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 msgr2=0x7f8e48004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.635+0000 7f8e52ffd640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 0x7f8e48004f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e640b2980 tx=0x7f8e5400ec00 comp rx=0 tx=0).stop 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.635+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 msgr2=0x7f8e48004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.635+0000 7f8e52ffd640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48002a70 0x7f8e48004f30 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e640b2980 tx=0x7f8e5400ec00 comp rx=0 tx=0).stop 2024-09-19T09:50:48.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.636+0000 7f8e62d9d640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8e4406c2b0 0x7f8e4406e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c000f80 tx=0x7f8e5c001610 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.647+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 0x7f8e48007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.648+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4800a4a0 con 0x7f8e48006f00 2024-09-19T09:50:48.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.651+0000 7f8e61d9b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 0x7f8e48007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.652+0000 7f8e61d9b640 1 -- 172.21.15.123:0/4248579992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8e480078d0 con 0x7f8e48006f00 2024-09-19T09:50:48.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.654+0000 7f8e61d9b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 0x7f8e48007390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e640c7480 tx=0x7f8e54004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 46, 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 33427, 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:50:48.659 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.660 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:50:48.662 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.663 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:50:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.666 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:48.667 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.668 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.669 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:50:48.670 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:50:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.655+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54017070 con 0x7f8e48006f00 2024-09-19T09:50:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.655+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f8e54006250 con 0x7f8e48006f00 2024-09-19T09:50:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.655+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 msgr2=0x7f8e48007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.655+0000 7f8e52ffd640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 0x7f8e48007390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e640c7480 tx=0x7f8e54004730 comp rx=0 tx=0).stop 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.656+0000 7f8e52ffd640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 msgr2=0x7f8e48007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.656+0000 7f8e52ffd640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e48006f00 0x7f8e48007390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8e4406c2b0 msgr2=0x7f8e4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8e4406c2b0 0x7f8e4406e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c000f80 tx=0x7f8e5c001610 comp rx=0 tx=0).stop 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e62d9d640 1 -- 172.21.15.123:0/4248579992 reap_dead start 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 msgr2=0x7f8e6415c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 0x7f8e6415c730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8e5802a770 tx=0x7f8e580046c0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 shutdown_connections 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 --2- 172.21.15.123:0/4248579992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e640c2870 0x7f8e6415c730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.657+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 >> 172.21.15.123:0/4248579992 conn(0x7f8e6406f110 msgr2=0x7f8e641613d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.661+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 shutdown_connections 2024-09-19T09:50:48.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.662+0000 7f8e68d4b640 1 -- 172.21.15.123:0/4248579992 wait complete. 2024-09-19T09:50:48.696 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:50:48.696 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:50:48.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:50:48.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.896+0000 7fb83561e640 1 Processor -- start 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.896+0000 7fb83561e640 1 -- start start 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.897+0000 7fb83561e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8300c91c0 0x7fb8300c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.897+0000 7fb83561e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb8300727e0 0x7fb83016b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.897+0000 7fb83561e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8300c8850 con 0x7fb830071110 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.897+0000 7fb83561e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb830071ab0 con 0x7fb8300c91c0 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.897+0000 7fb83561e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb8300ca170 con 0x7fb8300727e0 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.898+0000 7fb82f7fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb830071110 0x7fb8300c6130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:50318/0 (socket says 172.21.15.123:50318) 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.898+0000 7fb82f7fe640 1 -- 172.21.15.123:0/1797187360 learned_addr learned my addr 172.21.15.123:0/1797187360 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.898+0000 7fb82e7fc640 1 --2- 172.21.15.123:0/1797187360 >> v2:172.21.15.194:3300/0 conn(0x7fb8300727e0 0x7fb83016b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.899+0000 7fb82e7fc640 1 -- 172.21.15.123:0/1797187360 >> v2:172.21.15.123:3300/0 conn(0x7fb8300c91c0 msgr2=0x7fb8300c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.899+0000 7fb82e7fc640 1 --2- 172.21.15.123:0/1797187360 >> v2:172.21.15.123:3300/0 conn(0x7fb8300c91c0 0x7fb8300c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.899+0000 7fb82e7fc640 1 -- 172.21.15.123:0/1797187360 >> v1:172.21.15.194:6789/0 conn(0x7fb830071110 legacy=0x7fb8300c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.899+0000 7fb82e7fc640 1 -- 172.21.15.123:0/1797187360 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300c8b10 con 0x7fb8300727e0 2024-09-19T09:50:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.901+0000 7fb82e7fc640 1 --2- 172.21.15.123:0/1797187360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8300727e0 0x7fb83016b4f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8301690b0 tx=0x7fb82002b270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128cd7ab6f157c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.904+0000 7fb82dffb640 1 -- 172.21.15.123:0/1797187360 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8200333f0 con 0x7fb8300727e0 2024-09-19T09:50:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.904+0000 7fb82dffb640 1 -- 172.21.15.123:0/1797187360 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82000ae50 con 0x7fb8300727e0 2024-09-19T09:50:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.905+0000 7fb83561e640 1 -- 172.21.15.123:0/1797187360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8300727e0 msgr2=0x7fb83016b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.905+0000 7fb83561e640 1 --2- 172.21.15.123:0/1797187360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8300727e0 0x7fb83016b4f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8301690b0 tx=0x7fb82002b270 comp rx=0 tx=0).stop 2024-09-19T09:50:48.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.915+0000 7fb83561e640 1 -- 172.21.15.123:0/1797187360 shutdown_connections 2024-09-19T09:50:48.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.915+0000 7fb83561e640 1 --2- 172.21.15.123:0/1797187360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8300727e0 0x7fb83016b4f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.915+0000 7fb83561e640 1 --2- 172.21.15.123:0/1797187360 >> v2:172.21.15.123:3300/0 conn(0x7fb8300c91c0 0x7fb8300c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.915+0000 7fb83561e640 1 -- 172.21.15.123:0/1797187360 >> 172.21.15.123:0/1797187360 conn(0x7fb83006ed00 msgr2=0x7fb83006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.920+0000 7fb83561e640 1 -- 172.21.15.123:0/1797187360 shutdown_connections 2024-09-19T09:50:48.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.924+0000 7fb83561e640 1 -- 172.21.15.123:0/1797187360 wait complete. 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.926+0000 7fb83561e640 1 Processor -- start 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.926+0000 7fb83561e640 1 -- start start 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb83561e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb830071110 0x7fb8301fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb83561e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8300727e0 0x7fb830163ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb83561e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8300c91c0 0x7fb830200be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb83561e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb830071fe0 con 0x7fb8300c91c0 2024-09-19T09:50:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb83561e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb830071d00 con 0x7fb830071110 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb83561e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300722c0 con 0x7fb8300727e0 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.927+0000 7fb82f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8300c91c0 0x7fb830200be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8300c91c0 0x7fb830200be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49846/0 (socket says 172.21.15.123:49846) 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 -- 172.21.15.123:0/4050116864 learned_addr learned my addr 172.21.15.123:0/4050116864 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8300727e0 msgr2=0x7fb830163ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8300727e0 0x7fb830163ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb830071110 msgr2=0x7fb8301fb3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb830071110 0x7fb8301fb3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8301fb920 con 0x7fb8300c91c0 2024-09-19T09:50:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.928+0000 7fb82f7fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8300c91c0 0x7fb830200be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb82800cf30 tx=0x7fb82800a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.931+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828017070 con 0x7fb8300c91c0 2024-09-19T09:50:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.931+0000 7fb83561e640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb830201680 con 0x7fb8300c91c0 2024-09-19T09:50:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.931+0000 7fb83561e640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83015dcf0 con 0x7fb8300c91c0 2024-09-19T09:50:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.931+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828012400 con 0x7fb8300c91c0 2024-09-19T09:50:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.931+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280127b0 con 0x7fb8300c91c0 2024-09-19T09:50:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.935+0000 7fb83561e640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 0x7fb830163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.935+0000 7fb83561e640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300c8460 con 0x7fb830164ba0 2024-09-19T09:50:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.935+0000 7fb82effd640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 0x7fb830163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.936+0000 7fb82effd640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8300c4cc0 con 0x7fb830164ba0 2024-09-19T09:50:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.939+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb82801a070 con 0x7fb8300c91c0 2024-09-19T09:50:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.940+0000 7fb8277fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb810074ba0 0x7fb810077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.940+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb82808b2e0 con 0x7fb8300c91c0 2024-09-19T09:50:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.942+0000 7fb82e7fc640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb810074ba0 0x7fb810077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.944+0000 7fb82effd640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 0x7fb830163330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b340 tx=0x7fb81800b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.944+0000 7fb82e7fc640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb810074ba0 0x7fb810077060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb820034000 tx=0x7fb82002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.954+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818015020 con 0x7fb830164ba0 2024-09-19T09:50:48.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.954+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb818011830 con 0x7fb830164ba0 2024-09-19T09:50:48.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.954+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 msgr2=0x7fb830163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.954+0000 7fb8277fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 0x7fb830163330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b340 tx=0x7fb81800b800 comp rx=0 tx=0).stop 2024-09-19T09:50:48.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.954+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 msgr2=0x7fb830163330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:48.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.954+0000 7fb8277fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164ba0 0x7fb830163330 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b340 tx=0x7fb81800b800 comp rx=0 tx=0).stop 2024-09-19T09:50:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.978+0000 7fb83561e640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 0x7fb830157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.978+0000 7fb83561e640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb830068850 con 0x7fb830164220 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.986+0000 7fb82effd640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 0x7fb830157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.989+0000 7fb82effd640 1 -- 172.21.15.123:0/4050116864 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb830161cf0 con 0x7fb830164220 2024-09-19T09:50:48.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.990+0000 7fb82effd640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 0x7fb830157f70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b340 tx=0x7fb8180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.992+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818015040 con 0x7fb830164220 2024-09-19T09:50:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.992+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5198 (secure 0 0 0) 0x7fb81801a420 con 0x7fb830164220 2024-09-19T09:50:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.992+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 msgr2=0x7fb830157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.992+0000 7fb8277fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 0x7fb830157f70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b340 tx=0x7fb8180046c0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.993+0000 7fb8277fe640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 msgr2=0x7fb830157f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:50:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.993+0000 7fb8277fe640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb830164220 0x7fb830157f70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 46, 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 258307, 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.996 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.997 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:50:48.999 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:50:49.000 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.001 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.002 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:49.004 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:50:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:49.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.007 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:49.008 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.009 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:49.010 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:50:49.011 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:50:49.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb8257fa640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb810074ba0 msgr2=0x7fb810077060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb8257fa640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb810074ba0 0x7fb810077060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb820034000 tx=0x7fb82002f000 comp rx=0 tx=0).stop 2024-09-19T09:50:49.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb8257fa640 1 -- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8300c91c0 msgr2=0x7fb830200be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb8257fa640 1 --2- 172.21.15.123:0/4050116864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8300c91c0 0x7fb830200be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb82800cf30 tx=0x7fb82800a4f0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb82f7fe640 1 -- 172.21.15.123:0/4050116864 reap_dead start 2024-09-19T09:50:49.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb82f7fe640 1 -- 172.21.15.123:0/4050116864 reap_dead start 2024-09-19T09:50:49.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb8257fa640 1 -- 172.21.15.123:0/4050116864 shutdown_connections 2024-09-19T09:50:49.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.994+0000 7fb8257fa640 1 -- 172.21.15.123:0/4050116864 >> 172.21.15.123:0/4050116864 conn(0x7fb83006ed00 msgr2=0x7fb8300c51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:49.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.995+0000 7fb8257fa640 1 -- 172.21.15.123:0/4050116864 shutdown_connections 2024-09-19T09:50:49.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:48.996+0000 7fb8257fa640 1 -- 172.21.15.123:0/4050116864 wait complete. 2024-09-19T09:50:49.021 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:50:49.022 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-19T09:50:49.022 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:50:49.022 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-19T09:50:49.022 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:50:49.022 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:50:49.022 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:50:49.039 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:50:49.040 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:50:49.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:50:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.267+0000 7f18a8042640 1 Processor -- start 2024-09-19T09:50:49.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.269+0000 7f18a8042640 1 -- start start 2024-09-19T09:50:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a8042640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18a00c9970 0x7f18a0157120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a8042640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a015b310 0x7f18a01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a8042640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a00c7d20 con 0x7f18a006f7b0 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a8042640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00c8000 con 0x7f18a00c9970 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a8042640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f18a015a830 con 0x7f18a015b310 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a5dde640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f18a00c9970 msgr2=0x7f18a0157120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.270+0000 7f18a5dde640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18a00c9970 0x7f18a0157120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.271+0000 7f18a65df640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f18a006f7b0 0x7f18a006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55516/0 (socket says 172.21.15.123:55516) 2024-09-19T09:50:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.271+0000 7f18a65df640 1 -- 172.21.15.123:0/1205965890 learned_addr learned my addr 172.21.15.123:0/1205965890 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:50:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.271+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328213371 0 0) 0x7f18a00c7d20 con 0x7f18a006f7b0 2024-09-19T09:50:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.271+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f188c003520 con 0x7f18a006f7b0 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4165170587 0 0) 0x7f188c003520 con 0x7f18a006f7b0 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a015b310 msgr2=0x7f18a01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a015b310 0x7f18a01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 >> v2:172.21.15.194:3300/0 conn(0x7f18a00c9970 msgr2=0x7f18a0157120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 --2- 172.21.15.123:0/1205965890 >> v2:172.21.15.194:3300/0 conn(0x7f18a00c9970 0x7f18a0157120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a015ab10 con 0x7f18a006f7b0 2024-09-19T09:50:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f189c001670 con 0x7f18a006f7b0 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 >> v1:172.21.15.123:6789/0 conn(0x7f18a006f7b0 legacy=0x7f18a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c0039b0 0x7f188c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c004800 0x7f188c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f188c0051c0 0x7f188c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00c8000 con 0x7f188c0051c0 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f18a015a830 con 0x7f188c0039b0 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.273+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f188c00c1c0 con 0x7f188c004800 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.274+0000 7f18a5dde640 1 -- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c0039b0 msgr2=0x7f188c003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:50:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.274+0000 7f18a5dde640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c0039b0 0x7f188c003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.275+0000 7f18a65df640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f188c0051c0 0x7f188c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.275+0000 7f18a55dd640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c004800 0x7f188c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.276+0000 7f18a65df640 1 -- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c004800 msgr2=0x7f188c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.276+0000 7f18a65df640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c004800 0x7f188c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.276+0000 7f18a65df640 1 -- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c0039b0 msgr2=0x7f188c003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.276+0000 7f18a65df640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c0039b0 0x7f188c003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.276+0000 7f18a65df640 1 -- 172.21.15.123:0/1205965890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a015ab10 con 0x7f188c0051c0 2024-09-19T09:50:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.276+0000 7f18a55dd640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c004800 0x7f188c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:49.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.277+0000 7f18a65df640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f188c0051c0 0x7f188c00b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c260 tx=0x7f188c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f79dd90f5d17b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:49.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.279+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c02e070 con 0x7f188c0051c0 2024-09-19T09:50:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.279+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c005ad0 con 0x7f188c0051c0 2024-09-19T09:50:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.279+0000 7f18a4ddc640 1 -- 172.21.15.123:0/1205965890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c007d10 con 0x7f188c0051c0 2024-09-19T09:50:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.280+0000 7f18a8042640 1 -- 172.21.15.123:0/1205965890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f188c0051c0 msgr2=0x7f188c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.280+0000 7f18a8042640 1 --2- 172.21.15.123:0/1205965890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f188c0051c0 0x7f188c00b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c260 tx=0x7f188c005830 comp rx=0 tx=0).stop 2024-09-19T09:50:49.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.285+0000 7f18a65df640 1 -- 172.21.15.123:0/1205965890 reap_dead start 2024-09-19T09:50:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.285+0000 7f18a8042640 1 -- 172.21.15.123:0/1205965890 shutdown_connections 2024-09-19T09:50:49.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.285+0000 7f18a8042640 1 -- 172.21.15.123:0/1205965890 >> 172.21.15.123:0/1205965890 conn(0x7f18a006ec90 msgr2=0x7f18a006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:49.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.292+0000 7f18a8042640 1 -- 172.21.15.123:0/1205965890 shutdown_connections 2024-09-19T09:50:49.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.295+0000 7f18a8042640 1 -- 172.21.15.123:0/1205965890 wait complete. 2024-09-19T09:50:49.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.297+0000 7f18a8042640 1 Processor -- start 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.297+0000 7f18a8042640 1 -- start start 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a8042640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a0155db0 0x7f18a014a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a8042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 0x7f18a014a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a8042640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a01ed280 0x7f18a01ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a8042640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00c3f10 con 0x7f18a0156190 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a8042640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0157660 con 0x7f18a01ed280 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a8042640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00c4090 con 0x7f18a0155db0 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a65df640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a01ed280 msgr2=0x7f18a01ed700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:50:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a65df640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a01ed280 0x7f18a01ed700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:50:49.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.299+0000 7f18a55dd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 0x7f18a014a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 0x7f18a014a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49856/0 (socket says 172.21.15.123:49856) 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 -- 172.21.15.123:0/3345804125 learned_addr learned my addr 172.21.15.123:0/3345804125 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 -- 172.21.15.123:0/3345804125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a0155db0 msgr2=0x7f18a014a430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a0155db0 0x7f18a014a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 -- 172.21.15.123:0/3345804125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a01ed280 msgr2=0x7f18a01ed700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a01ed280 0x7f18a01ed700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.300+0000 7f18a55dd640 1 -- 172.21.15.123:0/3345804125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a01edc40 con 0x7f18a0156190 2024-09-19T09:50:49.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.301+0000 7f18a55dd640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 0x7f18a014a970 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f189800de90 tx=0x7f189800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:49.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.303+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898014070 con 0x7f18a0156190 2024-09-19T09:50:49.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.303+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189800be50 con 0x7f18a0156190 2024-09-19T09:50:49.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.303+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189800e870 con 0x7f18a0156190 2024-09-19T09:50:49.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.303+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a01ecd80 con 0x7f18a0156190 2024-09-19T09:50:49.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.303+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a0073240 con 0x7f18a0156190 2024-09-19T09:50:49.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.305+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a015c400 con 0x7f18a0156190 2024-09-19T09:50:49.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.308+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f189800ea10 con 0x7f18a0156190 2024-09-19T09:50:49.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.309+0000 7f18967fc640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f188406c380 0x7f188406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:49.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.309+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f189808b9d0 con 0x7f18a0156190 2024-09-19T09:50:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.312+0000 7f18a5dde640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f188406c380 0x7f188406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.313+0000 7f18a5dde640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f188406c380 0x7f188406e840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f189000c140 tx=0x7f1890006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:49.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.316+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f18a015c400 con 0x7f18a0156190 2024-09-19T09:50:49.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.858+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f18a00c3970 con 0x7f18a0156190 2024-09-19T09:50:49.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.859+0000 7f18967fc640 1 -- 172.21.15.123:0/3345804125 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f18a01edc40 con 0x7f18a0156190 2024-09-19T09:50:49.864 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:50:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f188406c380 msgr2=0x7f188406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f188406c380 0x7f188406e840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f189000c140 tx=0x7f1890006ab0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 msgr2=0x7f18a014a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 0x7f18a014a970 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f189800de90 tx=0x7f189800b700 comp rx=0 tx=0).stop 2024-09-19T09:50:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 shutdown_connections 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18a01ed280 0x7f18a01ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a0156190 0x7f18a014a970 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f188406c380 0x7f188406e840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 --2- 172.21.15.123:0/3345804125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18a0155db0 0x7f18a014a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.868+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 >> 172.21.15.123:0/3345804125 conn(0x7f18a006ec90 msgr2=0x7f18a01578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.869+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 shutdown_connections 2024-09-19T09:50:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:49.869+0000 7f18a8042640 1 -- 172.21.15.123:0/3345804125 wait complete. 2024-09-19T09:50:52.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:50:53.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.079+0000 7fe142812640 1 Processor -- start 2024-09-19T09:50:53.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.079+0000 7fe142812640 1 -- start start 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe142812640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe13c159600 0x7fe13c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe142812640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe13c1599e0 0x7fe13c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe142812640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c160020 con 0x7fe13c0c8ef0 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe142812640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c06cd00 con 0x7fe13c159600 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe142812640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c06c740 con 0x7fe13c1599e0 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe142011640 1 -- >> v1:172.21.15.194:6789/0 conn(0x7fe13c0c8ef0 legacy=0x7fe13c072270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe141810640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe13c159600 0x7fe13c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe141810640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe13c159600 0x7fe13c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49872/0 (socket says 172.21.15.123:49872) 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.081+0000 7fe141810640 1 -- 172.21.15.123:0/2406131514 learned_addr learned my addr 172.21.15.123:0/2406131514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.082+0000 7fe141810640 1 -- 172.21.15.123:0/2406131514 >> v2:172.21.15.194:3300/0 conn(0x7fe13c1599e0 msgr2=0x7fe13c06c150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.082+0000 7fe141810640 1 --2- 172.21.15.123:0/2406131514 >> v2:172.21.15.194:3300/0 conn(0x7fe13c1599e0 0x7fe13c06c150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.082+0000 7fe141810640 1 -- 172.21.15.123:0/2406131514 >> v1:172.21.15.194:6789/0 conn(0x7fe13c0c8ef0 legacy=0x7fe13c072270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.082+0000 7fe141810640 1 -- 172.21.15.123:0/2406131514 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c06ca20 con 0x7fe13c159600 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.083+0000 7fe141810640 1 --2- 172.21.15.123:0/2406131514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c159600 0x7fe13c06bc10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe13c06e230 tx=0x7fe13802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb5109cd1da9a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.083+0000 7fe14080e640 1 -- 172.21.15.123:0/2406131514 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138037070 con 0x7fe13c159600 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.083+0000 7fe14080e640 1 -- 172.21.15.123:0/2406131514 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe138032440 con 0x7fe13c159600 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.084+0000 7fe142812640 1 -- 172.21.15.123:0/2406131514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c159600 msgr2=0x7fe13c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.084+0000 7fe142812640 1 --2- 172.21.15.123:0/2406131514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c159600 0x7fe13c06bc10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe13c06e230 tx=0x7fe13802a250 comp rx=0 tx=0).stop 2024-09-19T09:50:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.085+0000 7fe142812640 1 -- 172.21.15.123:0/2406131514 shutdown_connections 2024-09-19T09:50:53.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.085+0000 7fe142812640 1 --2- 172.21.15.123:0/2406131514 >> v2:172.21.15.194:3300/0 conn(0x7fe13c1599e0 0x7fe13c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.085+0000 7fe142812640 1 --2- 172.21.15.123:0/2406131514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c159600 0x7fe13c06bc10 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe13c06e230 tx=0x7fe13802a250 comp rx=0 tx=0).stop 2024-09-19T09:50:53.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.085+0000 7fe142812640 1 -- 172.21.15.123:0/2406131514 >> 172.21.15.123:0/2406131514 conn(0x7fe13c0c9370 msgr2=0x7fe13c0c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:53.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.092+0000 7fe142812640 1 -- 172.21.15.123:0/2406131514 shutdown_connections 2024-09-19T09:50:53.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.093+0000 7fe142812640 1 -- 172.21.15.123:0/2406131514 wait complete. 2024-09-19T09:50:53.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.095+0000 7fe142812640 1 Processor -- start 2024-09-19T09:50:53.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.095+0000 7fe142812640 1 -- start start 2024-09-19T09:50:53.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.096+0000 7fe142812640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 0x7fe13c0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.097+0000 7fe141810640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 0x7fe13c0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.097+0000 7fe141810640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 0x7fe13c0cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49876/0 (socket says 172.21.15.123:49876) 2024-09-19T09:50:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.101+0000 7fe142812640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe13c1599e0 0x7fe13c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.101+0000 7fe142812640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe13c1554f0 0x7fe13c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.101+0000 7fe142812640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c160300 con 0x7fe13c0c8ef0 2024-09-19T09:50:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.101+0000 7fe142812640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0c3a20 con 0x7fe13c1599e0 2024-09-19T09:50:53.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.101+0000 7fe142812640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c0ca020 con 0x7fe13c1554f0 2024-09-19T09:50:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.101+0000 7fe141810640 1 -- 172.21.15.123:0/2842280251 learned_addr learned my addr 172.21.15.123:0/2842280251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.102+0000 7fe142011640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe13c1554f0 0x7fe13c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.102+0000 7fe142011640 1 -- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe13c1599e0 msgr2=0x7fe13c0cbe70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:50:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.102+0000 7fe142011640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe13c1599e0 0x7fe13c0cbe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.102+0000 7fe142011640 1 -- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 msgr2=0x7fe13c0cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.102+0000 7fe142011640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 0x7fe13c0cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.102+0000 7fe142011640 1 -- 172.21.15.123:0/2842280251 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c153010 con 0x7fe13c1554f0 2024-09-19T09:50:53.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.103+0000 7fe142011640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe13c1554f0 0x7fe13c150f00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009fd0 tx=0x7fe12c00b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:53.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.103+0000 7fe141810640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 0x7fe13c0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:53.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.104+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c003d70 con 0x7fe13c1554f0 2024-09-19T09:50:53.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.104+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c0050d0 con 0x7fe13c1554f0 2024-09-19T09:50:53.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.106+0000 7fe142812640 1 -- 172.21.15.123:0/2842280251 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c1532d0 con 0x7fe13c1554f0 2024-09-19T09:50:53.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.106+0000 7fe142812640 1 -- 172.21.15.123:0/2842280251 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c150700 con 0x7fe13c1554f0 2024-09-19T09:50:53.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.107+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0054a0 con 0x7fe13c1554f0 2024-09-19T09:50:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.113+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe12c005640 con 0x7fe13c1554f0 2024-09-19T09:50:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.113+0000 7fe1327fc640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe12006c300 0x7fe12006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.113+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fe12c08b0a0 con 0x7fe13c1554f0 2024-09-19T09:50:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.115+0000 7fe141810640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe12006c300 0x7fe12006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.116+0000 7fe141810640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe12006c300 0x7fe12006e7c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe138009630 tx=0x7fe13802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:53.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.117+0000 7fe142812640 1 -- 172.21.15.123:0/2842280251 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c071560 con 0x7fe13c1554f0 2024-09-19T09:50:53.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.126+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe12c059660 con 0x7fe13c1554f0 2024-09-19T09:50:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.626+0000 7fe142812640 1 -- 172.21.15.123:0/2842280251 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe13c06f8b0 con 0x7fe13c1554f0 2024-09-19T09:50:53.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.627+0000 7fe1327fc640 1 -- 172.21.15.123:0/2842280251 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fe12c058f60 con 0x7fe13c1554f0 2024-09-19T09:50:53.635 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:50:53.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 -- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe12006c300 msgr2=0x7fe12006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe12006c300 0x7fe12006e7c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe138009630 tx=0x7fe13802e000 comp rx=0 tx=0).stop 2024-09-19T09:50:53.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 -- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe13c1554f0 msgr2=0x7fe13c150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe13c1554f0 0x7fe13c150f00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009fd0 tx=0x7fe12c00b870 comp rx=0 tx=0).stop 2024-09-19T09:50:53.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 -- 172.21.15.123:0/2842280251 shutdown_connections 2024-09-19T09:50:53.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe12006c300 0x7fe12006e7c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe13c1554f0 0x7fe13c150f00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe13c1599e0 0x7fe13c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 --2- 172.21.15.123:0/2842280251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe13c0c8ef0 0x7fe13c0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 -- 172.21.15.123:0/2842280251 >> 172.21.15.123:0/2842280251 conn(0x7fe13c0c9370 msgr2=0x7fe13c156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:53.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.636+0000 7fe11ffff640 1 -- 172.21.15.123:0/2842280251 shutdown_connections 2024-09-19T09:50:53.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:53.637+0000 7fe11ffff640 1 -- 172.21.15.123:0/2842280251 wait complete. 2024-09-19T09:50:56.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:50:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.076+0000 7fa61359e640 1 Processor -- start 2024-09-19T09:50:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.076+0000 7fa61359e640 1 -- start start 2024-09-19T09:50:57.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.077+0000 7fa61359e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 0x7fa60c005e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:57.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.077+0000 7fa61359e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa60c04ae80 0x7fa60c0d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:57.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.077+0000 7fa61359e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c0de710 con 0x7fa60c0467d0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.077+0000 7fa61359e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa60c045aa0 con 0x7fa60c04ae80 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.077+0000 7fa61359e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c046340 con 0x7fa60c004af0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 0x7fa60c005e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 0x7fa60c005e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:55766/0 (socket says 172.21.15.123:55766) 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 -- 172.21.15.123:0/743618473 learned_addr learned my addr 172.21.15.123:0/743618473 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 -- 172.21.15.123:0/743618473 >> v2:172.21.15.123:3300/0 conn(0x7fa60c04ae80 msgr2=0x7fa60c0d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 --2- 172.21.15.123:0/743618473 >> v2:172.21.15.123:3300/0 conn(0x7fa60c04ae80 0x7fa60c0d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 -- 172.21.15.123:0/743618473 >> v1:172.21.15.123:6789/0 conn(0x7fa60c0467d0 legacy=0x7fa60c0ddc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.078+0000 7fa61259c640 1 -- 172.21.15.123:0/743618473 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c0de9f0 con 0x7fa60c004af0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.080+0000 7fa61259c640 1 --2- 172.21.15.123:0/743618473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 0x7fa60c005e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa60400ffd0 tx=0x7fa60403ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425475fee4cca1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.080+0000 7fa61159a640 1 -- 172.21.15.123:0/743618473 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604044070 con 0x7fa60c004af0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.081+0000 7fa61159a640 1 -- 172.21.15.123:0/743618473 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa604040890 con 0x7fa60c004af0 2024-09-19T09:50:57.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 -- 172.21.15.123:0/743618473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 msgr2=0x7fa60c005e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 --2- 172.21.15.123:0/743618473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 0x7fa60c005e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa60400ffd0 tx=0x7fa60403ba70 comp rx=0 tx=0).stop 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 -- 172.21.15.123:0/743618473 shutdown_connections 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 --2- 172.21.15.123:0/743618473 >> v2:172.21.15.123:3300/0 conn(0x7fa60c04ae80 0x7fa60c0d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 --2- 172.21.15.123:0/743618473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c004af0 0x7fa60c005e40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 -- 172.21.15.123:0/743618473 >> 172.21.15.123:0/743618473 conn(0x7fa60c050090 msgr2=0x7fa60c0504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 -- 172.21.15.123:0/743618473 shutdown_connections 2024-09-19T09:50:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.082+0000 7fa61359e640 1 -- 172.21.15.123:0/743618473 wait complete. 2024-09-19T09:50:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.084+0000 7fa61359e640 1 Processor -- start 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.084+0000 7fa61359e640 1 -- start start 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.086+0000 7fa61359e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c004af0 0x7fa60c0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.086+0000 7fa61359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 0x7fa60c04f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.086+0000 7fa61359e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c04ae80 0x7fa60c04f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.086+0000 7fa61359e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c046c20 con 0x7fa60c0467d0 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.086+0000 7fa61359e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c045fd0 con 0x7fa60c004af0 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.086+0000 7fa61359e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c0de370 con 0x7fa60c04ae80 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 0x7fa60c04f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 0x7fa60c04f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53586/0 (socket says 172.21.15.123:53586) 2024-09-19T09:50:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 -- 172.21.15.123:0/2321205878 learned_addr learned my addr 172.21.15.123:0/2321205878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 -- 172.21.15.123:0/2321205878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c04ae80 msgr2=0x7fa60c04f9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c04ae80 0x7fa60c04f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 -- 172.21.15.123:0/2321205878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c004af0 msgr2=0x7fa60c0d4bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c004af0 0x7fa60c0d4bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 -- 172.21.15.123:0/2321205878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c049370 con 0x7fa60c0467d0 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.087+0000 7fa611d9b640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 0x7fa60c04f460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa61406a090 tx=0x7fa614077830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.090+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614091070 con 0x7fa60c0467d0 2024-09-19T09:50:57.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.091+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c164860 con 0x7fa60c0467d0 2024-09-19T09:50:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.091+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c049cf0 con 0x7fa60c0467d0 2024-09-19T09:50:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.093+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c035010 con 0x7fa60c0467d0 2024-09-19T09:50:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.104+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614074260 con 0x7fa60c0467d0 2024-09-19T09:50:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.104+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6140699d0 con 0x7fa60c0467d0 2024-09-19T09:50:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.104+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa614063020 con 0x7fa60c0467d0 2024-09-19T09:50:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.105+0000 7fa602ffd640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5f406c3e0 0x7fa5f406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:57.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.105+0000 7fa61259c640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5f406c3e0 0x7fa5f406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:57.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.106+0000 7fa61259c640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5f406c3e0 0x7fa5f406e8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa604046000 tx=0x7fa604041000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:57.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.106+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa614107ab0 con 0x7fa60c0467d0 2024-09-19T09:50:57.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.106+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa60c035010 con 0x7fa60c0467d0 2024-09-19T09:50:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.662+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa60c049ae0 con 0x7fa60c0467d0 2024-09-19T09:50:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.664+0000 7fa602ffd640 1 -- 172.21.15.123:0/2321205878 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fa6140d6180 con 0x7fa60c0467d0 2024-09-19T09:50:57.669 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.674+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5f406c3e0 msgr2=0x7fa5f406e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.674+0000 7fa61359e640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5f406c3e0 0x7fa5f406e8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa604046000 tx=0x7fa604041000 comp rx=0 tx=0).stop 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.674+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 msgr2=0x7fa60c04f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.674+0000 7fa61359e640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 0x7fa60c04f460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa61406a090 tx=0x7fa614077830 comp rx=0 tx=0).stop 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 shutdown_connections 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5f406c3e0 0x7fa5f406e8a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c04ae80 0x7fa60c04f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa60c0467d0 0x7fa60c04f460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 --2- 172.21.15.123:0/2321205878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c004af0 0x7fa60c0d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 >> 172.21.15.123:0/2321205878 conn(0x7fa60c050090 msgr2=0x7fa60c0cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 shutdown_connections 2024-09-19T09:50:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:50:57.675+0000 7fa61359e640 1 -- 172.21.15.123:0/2321205878 wait complete. 2024-09-19T09:51:00.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.926+0000 7f1a0a58d640 1 Processor -- start 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.926+0000 7f1a0a58d640 1 -- start start 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a0a58d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a0a58d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 0x7f1a040c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a0a58d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a040c6e30 con 0x7f1a040c3920 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a0a58d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f1a040c9140 con 0x7f1a0406c560 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a0a58d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1a04071f50 con 0x7f1a040c95f0 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a08b2a640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 msgr2=0x7f1a040c99d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a08b2a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 0x7f1a040c99d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:55778/0 (socket says 172.21.15.123:55778) 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.927+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 learned_addr learned my addr 172.21.15.123:0/1835765482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.928+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.928+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.928+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.928+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:00.928+0000 7f1a037fe640 1 -- 172.21.15.123:0/1835765482 >> v1:172.21.15.194:6789/0 conn(0x7f1a040c3920 legacy=0x7f1a0406be50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:51:01.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.128+0000 7f1a08b2a640 1 -- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 msgr2=0x7f1a040c99d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:01.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.128+0000 7f1a08b2a640 1 --2- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 0x7f1a040c99d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:51:01.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.129+0000 7f1a037fe640 1 -- 172.21.15.123:0/1835765482 >> v1:172.21.15.194:6789/0 conn(0x7f1a040c3920 legacy=0x7f1a0406be50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:51:01.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.129+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:01.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.129+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:51:01.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.129+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:01.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.129+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:01.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.129+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:51:01.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.529+0000 7f1a08b2a640 1 -- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 msgr2=0x7f1a040c99d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:01.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.529+0000 7f1a08b2a640 1 --2- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 0x7f1a040c99d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:51:01.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.530+0000 7f1a037fe640 1 -- 172.21.15.123:0/1835765482 >> v1:172.21.15.194:6789/0 conn(0x7f1a040c3920 legacy=0x7f1a0406be50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:51:01.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.535+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:01.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.535+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:51:01.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.535+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:01.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.535+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:01.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:01.535+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:51:02.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.330+0000 7f1a08b2a640 1 -- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 msgr2=0x7f1a040c99d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:02.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.330+0000 7f1a08b2a640 1 --2- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 0x7f1a040c99d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:51:02.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.331+0000 7f1a037fe640 1 -- 172.21.15.123:0/1835765482 >> v1:172.21.15.194:6789/0 conn(0x7f1a040c3920 legacy=0x7f1a0406be50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.194:6789/0 2024-09-19T09:51:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.336+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.336+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:51:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.336+0000 7f1a03fff640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.336+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:02.336+0000 7f1a03fff640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:51:03.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:51:03.512 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.927+0000 7f1a01ffb640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 msgr2=0x7f1a04163390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.927+0000 7f1a01ffb640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a040c95f0 0x7f1a04163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.927+0000 7f1a01ffb640 1 -- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 msgr2=0x7f1a040c99d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.927+0000 7f1a01ffb640 1 --2- 172.21.15.123:0/1835765482 >> v2:172.21.15.194:3300/0 conn(0x7f1a0406c560 0x7f1a040c99d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.927+0000 7f1a01ffb640 1 -- 172.21.15.123:0/1835765482 >> v1:172.21.15.194:6789/0 conn(0x7f1a040c3920 legacy=0x7f1a0406be50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.927+0000 7f1a01ffb640 1 --2- 172.21.15.123:0/1835765482 >> v2:172.21.15.123:3300/0 conn(0x7f19f00073e0 0x7f19f00098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.928+0000 7f1a037fe640 1 --2- 172.21.15.123:0/1835765482 >> v2:172.21.15.123:3300/0 conn(0x7f19f00073e0 0x7f19f00098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.928+0000 7f1a01ffb640 1 -- 172.21.15.123:0/1835765482 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a04072230 con 0x7f19f00036a0 2024-09-19T09:51:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.928+0000 7f1a01ffb640 1 -- 172.21.15.123:0/1835765482 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1a040c9140 con 0x7f19f00073e0 2024-09-19T09:51:03.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.928+0000 7f1a037fe640 1 -- 172.21.15.123:0/1835765482 >> v1:172.21.15.123:6789/0 conn(0x7f19f00036a0 legacy=0x7f19f0005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:03.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.928+0000 7f1a037fe640 1 -- 172.21.15.123:0/1835765482 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a040c6e30 con 0x7f19f00073e0 2024-09-19T09:51:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.930+0000 7f1a037fe640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f00073e0 0x7f19f00098a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a04071310 tx=0x7f19f802a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51e58f5e24f66ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.969+0000 7f1a02ffd640 1 -- 172.21.15.123:0/1835765482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8036070 con 0x7f19f00073e0 2024-09-19T09:51:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.969+0000 7f1a02ffd640 1 -- 172.21.15.123:0/1835765482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f8005480 con 0x7f19f00073e0 2024-09-19T09:51:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.969+0000 7f1a02ffd640 1 -- 172.21.15.123:0/1835765482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8005850 con 0x7f19f00073e0 2024-09-19T09:51:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 -- 172.21.15.123:0/1835765482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f00073e0 msgr2=0x7f19f00098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:03.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f00073e0 0x7f19f00098a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a04071310 tx=0x7f19f802a890 comp rx=0 tx=0).stop 2024-09-19T09:51:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a08b2a640 1 -- 172.21.15.123:0/1835765482 reap_dead start 2024-09-19T09:51:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 -- 172.21.15.123:0/1835765482 shutdown_connections 2024-09-19T09:51:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 --2- 172.21.15.123:0/1835765482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19f00073e0 0x7f19f00098a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:03.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 -- 172.21.15.123:0/1835765482 >> 172.21.15.123:0/1835765482 conn(0x7f1a0406ec90 msgr2=0x7f1a0406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 -- 172.21.15.123:0/1835765482 shutdown_connections 2024-09-19T09:51:03.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.970+0000 7f1a0a58d640 1 -- 172.21.15.123:0/1835765482 wait complete. 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.972+0000 7f1a0a58d640 1 Processor -- start 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.973+0000 7f1a0a58d640 1 -- start start 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.973+0000 7f1a0a58d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f00073e0 0x7f1a04150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a03fff640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f00073e0 msgr2=0x7f1a04150690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f00073e0 0x7f1a04150690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a0a58d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a040c3390 0x7f1a041613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a0a58d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 0x7f1a041578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a0a58d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04072ad0 con 0x7f1a040c3390 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a0a58d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a040727f0 con 0x7f19f00073e0 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.974+0000 7f1a0a58d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1a04071c50 con 0x7f1a04161930 2024-09-19T09:51:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 0x7f1a041578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 0x7f1a041578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:43120/0 (socket says 172.21.15.123:43120) 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 -- 172.21.15.123:0/455037215 learned_addr learned my addr 172.21.15.123:0/455037215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a037fe640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a040c3390 0x7f1a041613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 -- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f00073e0 msgr2=0x7f1a04150690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f00073e0 0x7f1a04150690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 -- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a040c3390 msgr2=0x7f1a041613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.975+0000 7f1a08b2a640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a040c3390 0x7f1a041613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.976+0000 7f1a08b2a640 1 -- 172.21.15.123:0/455037215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a04158780 con 0x7f1a04161930 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.976+0000 7f1a037fe640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a040c3390 0x7f1a041613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:03.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.977+0000 7f1a08b2a640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 0x7f1a041578b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19fc003cb0 tx=0x7f19fc009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.980+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc016630 con 0x7f1a04161930 2024-09-19T09:51:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.980+0000 7f1a0a58d640 1 -- 172.21.15.123:0/455037215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a04161dc0 con 0x7f1a04161930 2024-09-19T09:51:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.980+0000 7f1a0a58d640 1 -- 172.21.15.123:0/455037215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a041641b0 con 0x7f1a04161930 2024-09-19T09:51:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.982+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19fc010030 con 0x7f1a04161930 2024-09-19T09:51:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.982+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc016a50 con 0x7f1a04161930 2024-09-19T09:51:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.982+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a040cc680 con 0x7f1a04161930 2024-09-19T09:51:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.984+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f19fc0153e0 con 0x7f1a04161930 2024-09-19T09:51:03.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.985+0000 7f1a00ff9640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19f006cf70 0x7f19f006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:03.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.985+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f19fc08c0c0 con 0x7f1a04161930 2024-09-19T09:51:03.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.985+0000 7f1a03fff640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19f006cf70 0x7f19f006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.987+0000 7f1a03fff640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19f006cf70 0x7f19f006f430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19f4006f40 tx=0x7f19f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:03.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:03.993+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1a040cc680 con 0x7f1a04161930 2024-09-19T09:51:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.490+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1a041599f0 con 0x7f1a04161930 2024-09-19T09:51:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.490+0000 7f1a00ff9640 1 -- 172.21.15.123:0/455037215 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f1a04161dc0 con 0x7f1a04161930 2024-09-19T09:51:04.498 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":50,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:04.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19f006cf70 msgr2=0x7f19f006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19f006cf70 0x7f19f006f430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19f4006f40 tx=0x7f19f4008040 comp rx=0 tx=0).stop 2024-09-19T09:51:04.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 msgr2=0x7f1a041578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 0x7f1a041578b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19fc003cb0 tx=0x7f19fc009e30 comp rx=0 tx=0).stop 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 shutdown_connections 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19f006cf70 0x7f19f006f430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a04161930 0x7f1a041578b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a040c3390 0x7f1a041613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 --2- 172.21.15.123:0/455037215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f00073e0 0x7f1a04150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 >> 172.21.15.123:0/455037215 conn(0x7f1a0406ec90 msgr2=0x7f1a040c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 shutdown_connections 2024-09-19T09:51:04.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:04.500+0000 7f19ea7fc640 1 -- 172.21.15.123:0/455037215 wait complete. 2024-09-19T09:51:04.522 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:51:04.522 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:51:04.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:51:05.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.330+0000 7f09eabfd640 1 Processor -- start 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.335+0000 7f09eabfd640 1 -- start start 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.336+0000 7f09eabfd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f09dc0d5690 0x7f09dc0dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.336+0000 7f09eabfd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09dc008b90 0x7f09dc04bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.336+0000 7f09eabfd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09dc045c40 con 0x7f09dc0087b0 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.336+0000 7f09eabfd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f09dc007750 con 0x7f09dc0d5690 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.336+0000 7f09eabfd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc0079f0 con 0x7f09dc008b90 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.338+0000 7f09e8999640 1 -- >> v2:172.21.15.194:3300/0 conn(0x7f09dc0d5690 msgr2=0x7f09dc0dbdd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:05.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.338+0000 7f09e8999640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f09dc0d5690 0x7f09dc0dbdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:05.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.338+0000 7f09e919a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09dc008b90 0x7f09dc04bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.338+0000 7f09e919a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09dc008b90 0x7f09dc04bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:43126/0 (socket says 172.21.15.123:43126) 2024-09-19T09:51:05.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.338+0000 7f09e919a640 1 -- 172.21.15.123:0/2962578036 learned_addr learned my addr 172.21.15.123:0/2962578036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:05.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.339+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949876643 0 0) 0x7f09dc045c40 con 0x7f09dc0087b0 2024-09-19T09:51:05.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.339+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d4003520 con 0x7f09dc0087b0 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 908522484 0 0) 0x7f09d4003520 con 0x7f09dc0087b0 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09dc008b90 msgr2=0x7f09dc04bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09dc008b90 0x7f09dc04bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 >> v2:172.21.15.194:3300/0 conn(0x7f09dc0d5690 msgr2=0x7f09dc0dbdd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 --2- 172.21.15.123:0/2962578036 >> v2:172.21.15.194:3300/0 conn(0x7f09dc0d5690 0x7f09dc0dbdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc007cd0 con 0x7f09dc0087b0 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f09e4063850 con 0x7f09dc0087b0 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 >> v1:172.21.15.123:6789/0 conn(0x7f09dc0087b0 legacy=0x7f09dc04cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 0x7f09d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09d4004350 0x7f09d4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.340+0000 7f09e37fe640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d4004fd0 0x7f09d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e3fff640 1 -- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09d4004350 msgr2=0x7f09d4004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:05.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e8999640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 0x7f09d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e3fff640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09d4004350 0x7f09d4004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc007750 con 0x7f09d4004fd0 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0079f0 con 0x7f09d4004350 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f09d400bfb0 con 0x7f09d40039b0 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.341+0000 7f09e919a640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d4004fd0 0x7f09d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.342+0000 7f09e8999640 1 -- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09d4004350 msgr2=0x7f09d4004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.342+0000 7f09e8999640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09d4004350 0x7f09d4004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.342+0000 7f09e8999640 1 -- 172.21.15.123:0/2962578036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d4004fd0 msgr2=0x7f09d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.342+0000 7f09e8999640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d4004fd0 0x7f09d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.342+0000 7f09e8999640 1 -- 172.21.15.123:0/2962578036 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d4003520 con 0x7f09d40039b0 2024-09-19T09:51:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.343+0000 7f09e919a640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d4004fd0 0x7f09d400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.345+0000 7f09e8999640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 0x7f09d4003dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009900 tx=0x7f09d4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53cda5ccf54b30d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.347+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0009500 con 0x7f09d40039b0 2024-09-19T09:51:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.347+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d002e070 con 0x7f09d40039b0 2024-09-19T09:51:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.347+0000 7f09e37fe640 1 -- 172.21.15.123:0/2962578036 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0003e30 con 0x7f09d40039b0 2024-09-19T09:51:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.348+0000 7f09eabfd640 1 -- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 msgr2=0x7f09d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.348+0000 7f09eabfd640 1 --2- 172.21.15.123:0/2962578036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 0x7f09d4003dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009900 tx=0x7f09d4005830 comp rx=0 tx=0).stop 2024-09-19T09:51:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.348+0000 7f09e919a640 1 -- 172.21.15.123:0/2962578036 reap_dead start 2024-09-19T09:51:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.348+0000 7f09eabfd640 1 -- 172.21.15.123:0/2962578036 shutdown_connections 2024-09-19T09:51:05.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.348+0000 7f09eabfd640 1 -- 172.21.15.123:0/2962578036 >> 172.21.15.123:0/2962578036 conn(0x7f09dc050d60 msgr2=0x7f09dc051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.349+0000 7f09eabfd640 1 -- 172.21.15.123:0/2962578036 shutdown_connections 2024-09-19T09:51:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.350+0000 7f09eabfd640 1 -- 172.21.15.123:0/2962578036 wait complete. 2024-09-19T09:51:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.352+0000 7f09eabfd640 1 Processor -- start 2024-09-19T09:51:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.352+0000 7f09eabfd640 1 -- start start 2024-09-19T09:51:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.353+0000 7f09eabfd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 0x7f09dc0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.353+0000 7f09eabfd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09dc164ff0 0x7f09dc0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.353+0000 7f09eabfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc164680 0x7f09dc04fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.353+0000 7f09eabfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc04d1d0 con 0x7f09dc164680 2024-09-19T09:51:05.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.353+0000 7f09eabfd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc04d580 con 0x7f09dc164ff0 2024-09-19T09:51:05.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.353+0000 7f09eabfd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc17bb30 con 0x7f09d40039b0 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.354+0000 7f09e3fff640 1 -- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09dc164ff0 msgr2=0x7f09dc0cdac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.354+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09dc164ff0 0x7f09dc0cdac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.354+0000 7f09e919a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc164680 0x7f09dc04fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.354+0000 7f09e919a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc164680 0x7f09dc04fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51286/0 (socket says 172.21.15.123:51286) 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.354+0000 7f09e919a640 1 -- 172.21.15.123:0/1138204215 learned_addr learned my addr 172.21.15.123:0/1138204215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e919a640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 msgr2=0x7f09dc0d0490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:51:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e919a640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09d40039b0 0x7f09dc0d0490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e919a640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09dc164ff0 msgr2=0x7f09dc0cdac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e919a640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09dc164ff0 0x7f09dc0cdac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e919a640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc178820 con 0x7f09dc164680 2024-09-19T09:51:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e919a640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc164680 0x7f09dc04fcc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f09dc008f70 tx=0x7f09d8011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.355+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8009720 con 0x7f09dc164680 2024-09-19T09:51:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.356+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc178b00 con 0x7f09dc164680 2024-09-19T09:51:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.356+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d8004020 con 0x7f09dc164680 2024-09-19T09:51:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.356+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc1790c0 con 0x7f09dc164680 2024-09-19T09:51:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.356+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d80041d0 con 0x7f09dc164680 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.357+0000 7f09eabfd640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 0x7f09c4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.357+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4007ec0 con 0x7f09c4002a70 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.359+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09d801e020 con 0x7f09dc164680 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.360+0000 7f09e8999640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 0x7f09c4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.360+0000 7f09e8999640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09c40080c0 con 0x7f09c4002a70 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.360+0000 7f09e17fa640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f09c806c210 0x7f09c806e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.361+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f09d808aed0 con 0x7f09dc164680 2024-09-19T09:51:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.361+0000 7f09e3fff640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f09c806c210 0x7f09c806e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.361+0000 7f09e8999640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 0x7f09c4004f30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09d0003930 tx=0x7f09d0005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.361+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0003e50 con 0x7f09c4002a70 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.362+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f09d002e050 con 0x7f09c4002a70 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.362+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 msgr2=0x7f09c4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.362+0000 7f09e17fa640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 0x7f09c4004f30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09d0003930 tx=0x7f09d0005a10 comp rx=0 tx=0).stop 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.362+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 msgr2=0x7f09c4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.362+0000 7f09e17fa640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4002a70 0x7f09c4004f30 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09d0003930 tx=0x7f09d0005a10 comp rx=0 tx=0).stop 2024-09-19T09:51:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.362+0000 7f09e3fff640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f09c806c210 0x7f09c806e6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09e4050d60 tx=0x7f09e40749f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.382+0000 7f09eabfd640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 0x7f09c4007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.383+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09c400a4a0 con 0x7f09c4006eb0 2024-09-19T09:51:05.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.383+0000 7f09e8999640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 0x7f09c4007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.386+0000 7f09e8999640 1 -- 172.21.15.123:0/1138204215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f09c4007880 con 0x7f09c4006eb0 2024-09-19T09:51:05.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.387+0000 7f09e8999640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 0x7f09c4007340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009900 tx=0x7f09d00090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.388+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0005660 con 0x7f09c4006eb0 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.389+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7f09d0005800 con 0x7f09c4006eb0 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.389+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 msgr2=0x7f09c4007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.389+0000 7f09e17fa640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 0x7f09c4007340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009900 tx=0x7f09d00090e0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.389+0000 7f09e17fa640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 msgr2=0x7f09c4007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.389+0000 7f09e17fa640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09c4006eb0 0x7f09c4007340 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009900 tx=0x7f09d00090e0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.391 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 50, 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 168608, 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:05.392 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.393 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.394 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:05.395 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:05.396 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.397 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:05.398 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.400 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:05.401 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:05.402 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:05.403 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.404 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:05.405 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:05.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.392+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f09c806c210 msgr2=0x7f09c806e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.392+0000 7f09eabfd640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f09c806c210 0x7f09c806e6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09e4050d60 tx=0x7f09e40749f0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.392+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc164680 msgr2=0x7f09dc04fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.392+0000 7f09e919a640 1 -- 172.21.15.123:0/1138204215 reap_dead start 2024-09-19T09:51:05.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.392+0000 7f09eabfd640 1 --2- 172.21.15.123:0/1138204215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc164680 0x7f09dc04fcc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f09dc008f70 tx=0x7f09d8011d40 comp rx=0 tx=0).stop 2024-09-19T09:51:05.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.392+0000 7f09e919a640 1 -- 172.21.15.123:0/1138204215 reap_dead start 2024-09-19T09:51:05.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.398+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 shutdown_connections 2024-09-19T09:51:05.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.398+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 >> 172.21.15.123:0/1138204215 conn(0x7f09dc050d60 msgr2=0x7f09dc0356d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:05.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.401+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 shutdown_connections 2024-09-19T09:51:05.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.401+0000 7f09eabfd640 1 -- 172.21.15.123:0/1138204215 wait complete. 2024-09-19T09:51:05.432 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:51:05.432 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:51:05.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:51:05.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.654+0000 7f380e2b7640 1 Processor -- start 2024-09-19T09:51:05.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.654+0000 7f380e2b7640 1 -- start start 2024-09-19T09:51:05.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.656+0000 7f380e2b7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38080c8a50 0x7f3808072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.656+0000 7f380e2b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3808155840 con 0x7f3808155460 2024-09-19T09:51:05.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.656+0000 7f380e2b7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f380815b5b0 con 0x7f380815b100 2024-09-19T09:51:05.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.656+0000 7f380e2b7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f380815b890 con 0x7f38080c8a50 2024-09-19T09:51:05.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.656+0000 7f3807fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3808155460 0x7f380815ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36870/0 (socket says 172.21.15.123:36870) 2024-09-19T09:51:05.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.656+0000 7f3807fff640 1 -- 172.21.15.123:0/2339267819 learned_addr learned my addr 172.21.15.123:0/2339267819 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:05.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.659+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206970607 0 0) 0x7f3808155840 con 0x7f3808155460 2024-09-19T09:51:05.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.659+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37f0003520 con 0x7f3808155460 2024-09-19T09:51:05.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.661+0000 7f380c854640 1 -- 172.21.15.123:0/2339267819 >> v2:172.21.15.194:3300/0 conn(0x7f38080c8a50 msgr2=0x7f3808072530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:05.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.661+0000 7f380c854640 1 --2- 172.21.15.123:0/2339267819 >> v2:172.21.15.194:3300/0 conn(0x7f38080c8a50 0x7f3808072530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:05.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1497578643 0 0) 0x7f37f0003520 con 0x7f3808155460 2024-09-19T09:51:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 >> v2:172.21.15.194:3300/0 conn(0x7f38080c8a50 msgr2=0x7f3808072530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 --2- 172.21.15.123:0/2339267819 >> v2:172.21.15.194:3300/0 conn(0x7f38080c8a50 0x7f3808072530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 >> v1:172.21.15.194:6789/0 conn(0x7f380815b100 legacy=0x7f38080c91c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:51:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380815bb70 con 0x7f3808155460 2024-09-19T09:51:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f37f8001670 con 0x7f3808155460 2024-09-19T09:51:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 >> v1:172.21.15.123:6789/0 conn(0x7f3808155460 legacy=0x7f380815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37f00039b0 0x7f37f0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f37f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37f00052e0 0x7f37f00141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f380815b890 con 0x7f37f0004800 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00149e0 con 0x7f37f00039b0 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f37f0014be0 con 0x7f37f00052e0 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3807fff640 1 -- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37f00039b0 msgr2=0x7f37f0003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3300/0 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f3807fff640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37f00039b0 0x7f37f0003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:05.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.663+0000 7f38077fe640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f37f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.664+0000 7f38077fe640 1 -- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37f00052e0 msgr2=0x7f37f00141d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:51:05.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.664+0000 7f38077fe640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37f00052e0 0x7f37f00141d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.664+0000 7f38077fe640 1 -- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37f00039b0 msgr2=0x7f37f0003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:05.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.664+0000 7f38077fe640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37f00039b0 0x7f37f0003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.664+0000 7f38077fe640 1 -- 172.21.15.123:0/2339267819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f0003520 con 0x7f37f0004800 2024-09-19T09:51:05.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.664+0000 7f380c854640 1 -- 172.21.15.123:0/2339267819 reap_dead start 2024-09-19T09:51:05.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.666+0000 7f38077fe640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f37f0004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009830 tx=0x7f37f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cc7aeffa061b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.667+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc037070 con 0x7f37f0004800 2024-09-19T09:51:05.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.667+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc02a9a0 con 0x7f37f0004800 2024-09-19T09:51:05.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.667+0000 7f3806ffd640 1 -- 172.21.15.123:0/2339267819 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc0093b0 con 0x7f37f0004800 2024-09-19T09:51:05.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.668+0000 7f380e2b7640 1 -- 172.21.15.123:0/2339267819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 msgr2=0x7f37f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.668+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f37f0004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009830 tx=0x7f37f0005830 comp rx=0 tx=0).stop 2024-09-19T09:51:05.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.671+0000 7f380e2b7640 1 -- 172.21.15.123:0/2339267819 shutdown_connections 2024-09-19T09:51:05.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.671+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2339267819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f37f0004c80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.671+0000 7f380e2b7640 1 -- 172.21.15.123:0/2339267819 >> 172.21.15.123:0/2339267819 conn(0x7f380806ed00 msgr2=0x7f380806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:05.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.674+0000 7f380e2b7640 1 -- 172.21.15.123:0/2339267819 shutdown_connections 2024-09-19T09:51:05.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.674+0000 7f380e2b7640 1 -- 172.21.15.123:0/2339267819 wait complete. 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.676+0000 7f380e2b7640 1 Processor -- start 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.676+0000 7f380e2b7640 1 -- start start 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.677+0000 7f380e2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f38081ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.678+0000 7f3807fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f38081ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.678+0000 7f3807fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f38081ed0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51312/0 (socket says 172.21.15.123:51312) 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.678+0000 7f3807fff640 1 -- 172.21.15.123:0/2381835042 learned_addr learned my addr 172.21.15.123:0/2381835042 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.678+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38081efc20 0x7f3808159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.678+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f380815e270 0x7f380815d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.678+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3808072530 con 0x7f37f0004800 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f380815e830 con 0x7f380815e270 2024-09-19T09:51:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f38080726b0 con 0x7f38081efc20 2024-09-19T09:51:05.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f3807fff640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38081efc20 msgr2=0x7f3808159f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:05.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f3807fff640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38081efc20 0x7f3808159f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f3807fff640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f380815e270 msgr2=0x7f380815d820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f3807fff640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f380815e270 0x7f380815d820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.679+0000 7f3807fff640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38081ed5e0 con 0x7f37f0004800 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.680+0000 7f3807fff640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f38081ed0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37f800caf0 tx=0x7f37f8001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.681+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8018070 con 0x7f37f0004800 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.681+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80072d0 con 0x7f37f0004800 2024-09-19T09:51:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.681+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80047e0 con 0x7f37f0004800 2024-09-19T09:51:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.684+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38080c5d40 con 0x7f37f0004800 2024-09-19T09:51:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.684+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38081ec8a0 con 0x7f37f0004800 2024-09-19T09:51:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.685+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 0x7f380814a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.685+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3808151060 con 0x7f380814a0a0 2024-09-19T09:51:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.686+0000 7f38077fe640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 0x7f380814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.686+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37f801b070 con 0x7f37f0004800 2024-09-19T09:51:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.687+0000 7f3804ff9640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f37f406c380 0x7f37f406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.687+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f37f808a980 con 0x7f37f0004800 2024-09-19T09:51:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.687+0000 7f380c854640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f37f406c380 0x7f37f406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.688+0000 7f380c854640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f37f406c380 0x7f37f406e840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f380806cd10 tx=0x7f38000091f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.688+0000 7f38077fe640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38080c6710 con 0x7f380814a0a0 2024-09-19T09:51:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.692+0000 7f38077fe640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 0x7f380814a480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37f00057e0 tx=0x7f37fc004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.692+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc041020 con 0x7f380814a0a0 2024-09-19T09:51:05.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.698+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f37fc032670 con 0x7f380814a0a0 2024-09-19T09:51:05.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.698+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 msgr2=0x7f380814a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.698+0000 7f3804ff9640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 0x7f380814a480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37f00057e0 tx=0x7f37fc004700 comp rx=0 tx=0).stop 2024-09-19T09:51:05.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.698+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 msgr2=0x7f380814a480 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:05.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.698+0000 7f3804ff9640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814a0a0 0x7f380814a480 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f37f00057e0 tx=0x7f37fc004700 comp rx=0 tx=0).stop 2024-09-19T09:51:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.714+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 0x7f3808150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.714+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f38081ec690 con 0x7f380814fc20 2024-09-19T09:51:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.719+0000 7f38077fe640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 0x7f3808150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.722+0000 7f38077fe640 1 -- 172.21.15.123:0/2381835042 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f380815ed50 con 0x7f380814fc20 2024-09-19T09:51:05.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.722+0000 7f38077fe640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 0x7f3808150000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009830 tx=0x7f37fc006ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.723+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc041040 con 0x7f380814fc20 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 50, 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 275040, 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:05.726 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:05.727 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:05.729 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:05.731 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:05.732 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:05.733 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.735 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.737 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.738 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.739 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:05.740 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.723+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5186 (secure 0 0 0) 0x7f37fc03dd40 con 0x7f380814fc20 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.723+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 msgr2=0x7f3808150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.723+0000 7f3804ff9640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 0x7f3808150000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009830 tx=0x7f37fc006ee0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.723+0000 7f3804ff9640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 msgr2=0x7f3808150000 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.723+0000 7f3804ff9640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f380814fc20 0x7f3808150000 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009830 tx=0x7f37fc006ee0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.724+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f37f406c380 msgr2=0x7f37f406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.724+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f37f406c380 0x7f37f406e840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f380806cd10 tx=0x7f38000091f0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.724+0000 7f380c854640 1 -- 172.21.15.123:0/2381835042 reap_dead start 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.724+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 msgr2=0x7f38081ed0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.724+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f38081ed0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37f800caf0 tx=0x7f37f8001d40 comp rx=0 tx=0).stop 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.725+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 shutdown_connections 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.725+0000 7f380e2b7640 1 --2- 172.21.15.123:0/2381835042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37f0004800 0x7f38081ed0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.725+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 >> 172.21.15.123:0/2381835042 conn(0x7f380806ed00 msgr2=0x7f380814e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.734+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 shutdown_connections 2024-09-19T09:51:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:05.735+0000 7f380e2b7640 1 -- 172.21.15.123:0/2381835042 wait complete. 2024-09-19T09:51:05.764 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:51:05.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:51:25.765 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-19T09:51:25.766 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-19T09:51:25.766 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:51:25.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:51:25.773 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:51:25.773 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:51:25.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.004+0000 7f594e731640 1 Processor -- start 2024-09-19T09:51:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.004+0000 7f594e731640 1 -- start start 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.005+0000 7f594e731640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59481597c0 0x7f5948163580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.005+0000 7f594e731640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f594815f5f0 0x7f594806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.005+0000 7f594e731640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594806efe0 con 0x7f59480ce3e0 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.005+0000 7f594e731640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f59480c7dd0 con 0x7f59481597c0 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.005+0000 7f594e731640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f59480cbae0 con 0x7f594815f5f0 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.006+0000 7f594ccce640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f59480ce3e0 0x7f5948067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47888/0 (socket says 172.21.15.123:47888) 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.006+0000 7f594ccce640 1 -- 172.21.15.123:0/4150296433 learned_addr learned my addr 172.21.15.123:0/4150296433 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:26.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.006+0000 7f5947fff640 1 --2- 172.21.15.123:0/4150296433 >> v2:172.21.15.123:3300/0 conn(0x7f59481597c0 0x7f5948163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.006+0000 7f5946ffd640 1 -- 172.21.15.123:0/4150296433 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042768693 0 0) 0x7f594806efe0 con 0x7f59480ce3e0 2024-09-19T09:51:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.006+0000 7f5946ffd640 1 -- 172.21.15.123:0/4150296433 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5930003520 con 0x7f59480ce3e0 2024-09-19T09:51:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.007+0000 7f5946ffd640 1 -- 172.21.15.123:0/4150296433 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3886714160 0 0) 0x7f5930003520 con 0x7f59480ce3e0 2024-09-19T09:51:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.007+0000 7f5947fff640 1 -- 172.21.15.123:0/4150296433 >> v2:172.21.15.194:3300/0 conn(0x7f594815f5f0 msgr2=0x7f594806cc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.007+0000 7f5947fff640 1 --2- 172.21.15.123:0/4150296433 >> v2:172.21.15.194:3300/0 conn(0x7f594815f5f0 0x7f594806cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.007+0000 7f5947fff640 1 -- 172.21.15.123:0/4150296433 >> v1:172.21.15.123:6789/0 conn(0x7f59480ce3e0 legacy=0x7f5948067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.007+0000 7f5947fff640 1 -- 172.21.15.123:0/4150296433 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59480cbd80 con 0x7f59481597c0 2024-09-19T09:51:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.008+0000 7f5947fff640 1 --2- 172.21.15.123:0/4150296433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59481597c0 0x7f5948163580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5948071850 tx=0x7f594002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698a191a2cc54404 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.008+0000 7f5946ffd640 1 -- 172.21.15.123:0/4150296433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c001670 con 0x7f59481597c0 2024-09-19T09:51:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.008+0000 7f5946ffd640 1 -- 172.21.15.123:0/4150296433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5940007540 con 0x7f59481597c0 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f594e731640 1 -- 172.21.15.123:0/4150296433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59481597c0 msgr2=0x7f5948163580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f5946ffd640 1 -- 172.21.15.123:0/4150296433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c001670 con 0x7f59481597c0 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f594e731640 1 --2- 172.21.15.123:0/4150296433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59481597c0 0x7f5948163580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5948071850 tx=0x7f594002a6c0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f594e731640 1 -- 172.21.15.123:0/4150296433 shutdown_connections 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f594e731640 1 --2- 172.21.15.123:0/4150296433 >> v2:172.21.15.194:3300/0 conn(0x7f594815f5f0 0x7f594806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f594e731640 1 --2- 172.21.15.123:0/4150296433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59481597c0 0x7f5948163580 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5948071850 tx=0x7f594002a6c0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.009+0000 7f594e731640 1 -- 172.21.15.123:0/4150296433 >> 172.21.15.123:0/4150296433 conn(0x7f59480cd8c0 msgr2=0x7f59480cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:26.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.014+0000 7f594e731640 1 -- 172.21.15.123:0/4150296433 shutdown_connections 2024-09-19T09:51:26.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.014+0000 7f594e731640 1 -- 172.21.15.123:0/4150296433 wait complete. 2024-09-19T09:51:26.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.016+0000 7f594e731640 1 Processor -- start 2024-09-19T09:51:26.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.016+0000 7f594e731640 1 -- start start 2024-09-19T09:51:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.017+0000 7f594e731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59480ce3e0 0x7f594815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.017+0000 7f594e731640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f594815f5f0 0x7f59481665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.017+0000 7f594e731640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 0x7f5948156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.017+0000 7f594e731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5948163060 con 0x7f59480ce3e0 2024-09-19T09:51:26.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.017+0000 7f594e731640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5948162d80 con 0x7f594815f5f0 2024-09-19T09:51:26.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.017+0000 7f594e731640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f59480c9db0 con 0x7f594806c9b0 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f594ccce640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 0x7f5948156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f594ccce640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 0x7f5948156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36764/0 (socket says 172.21.15.123:36764) 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f594ccce640 1 -- 172.21.15.123:0/1694047144 learned_addr learned my addr 172.21.15.123:0/1694047144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f5947fff640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59480ce3e0 0x7f594815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f59477fe640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f594815f5f0 0x7f59481665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f594ccce640 1 -- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f594815f5f0 msgr2=0x7f59481665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f594ccce640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f594815f5f0 0x7f59481665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.018+0000 7f594ccce640 1 -- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59480ce3e0 msgr2=0x7f594815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.019+0000 7f594ccce640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59480ce3e0 0x7f594815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.019+0000 7f594ccce640 1 -- 172.21.15.123:0/1694047144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5948162b80 con 0x7f594806c9b0 2024-09-19T09:51:26.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.019+0000 7f5947fff640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59480ce3e0 0x7f594815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:26.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.023+0000 7f594ccce640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 0x7f5948156460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f593c001380 tx=0x7f593c00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.023+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c017070 con 0x7f594806c9b0 2024-09-19T09:51:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.023+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59480c4350 con 0x7f594806c9b0 2024-09-19T09:51:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.024+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f594815ba70 con 0x7f594806c9b0 2024-09-19T09:51:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.024+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c005ad0 con 0x7f594806c9b0 2024-09-19T09:51:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.025+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c007070 con 0x7f594806c9b0 2024-09-19T09:51:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.027+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f593c01a070 con 0x7f594806c9b0 2024-09-19T09:51:26.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.028+0000 7f5944ff9640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f593406c2e0 0x7f593406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.028+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f593c08ab60 con 0x7f594806c9b0 2024-09-19T09:51:26.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.028+0000 7f5947fff640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f593406c2e0 0x7f593406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.029+0000 7f5947fff640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f593406c2e0 0x7f593406e7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5940034000 tx=0x7f594002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:26.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.033+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5928005290 con 0x7f594806c9b0 2024-09-19T09:51:26.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.041+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f593c058b70 con 0x7f594806c9b0 2024-09-19T09:51:26.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.559+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5928005580 con 0x7f594806c9b0 2024-09-19T09:51:26.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.561+0000 7f5944ff9640 1 -- 172.21.15.123:0/1694047144 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f593c05ce70 con 0x7f594806c9b0 2024-09-19T09:51:26.566 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":50,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:26.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.565+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f593406c2e0 msgr2=0x7f593406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.565+0000 7f594e731640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f593406c2e0 0x7f593406e7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5940034000 tx=0x7f594002f000 comp rx=0 tx=0).stop 2024-09-19T09:51:26.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.565+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 msgr2=0x7f5948156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.565+0000 7f594e731640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 0x7f5948156460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f593c001380 tx=0x7f593c00cbe0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 shutdown_connections 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f593406c2e0 0x7f593406e7a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f594806c9b0 0x7f5948156460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f594815f5f0 0x7f59481665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 --2- 172.21.15.123:0/1694047144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59480ce3e0 0x7f594815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 >> 172.21.15.123:0/1694047144 conn(0x7f59480cd8c0 msgr2=0x7f59480c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 shutdown_connections 2024-09-19T09:51:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:26.566+0000 7f594e731640 1 -- 172.21.15.123:0/1694047144 wait complete. 2024-09-19T09:51:29.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.823+0000 7f7c194f9640 1 Processor -- start 2024-09-19T09:51:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.823+0000 7f7c194f9640 1 -- start start 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c194f9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7c0c04aa30 0x7f7c0c0059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c194f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c0c0e6020 0x7f7c0c0e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c194f9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c0e6ad0 con 0x7f7c0c0dce80 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c194f9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c045650 con 0x7f7c0c0e6020 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c194f9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c045ef0 con 0x7f7c0c04aa30 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c0c0e6020 0x7f7c0c0e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c0c0e6020 0x7f7c0c0e6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35654/0 (socket says 172.21.15.123:35654) 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 -- 172.21.15.123:0/2410109865 learned_addr learned my addr 172.21.15.123:0/2410109865 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 -- 172.21.15.123:0/2410109865 >> v2:172.21.15.194:3300/0 conn(0x7f7c0c04aa30 msgr2=0x7f7c0c0059f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 --2- 172.21.15.123:0/2410109865 >> v2:172.21.15.194:3300/0 conn(0x7f7c0c04aa30 0x7f7c0c0059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 -- 172.21.15.123:0/2410109865 >> v1:172.21.15.194:6789/0 conn(0x7f7c0c0dce80 legacy=0x7f7c0c046380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.825+0000 7f7c18cf8640 1 -- 172.21.15.123:0/2410109865 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0e6db0 con 0x7f7c0c0e6020 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.826+0000 7f7c18cf8640 1 --2- 172.21.15.123:0/2410109865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0e6020 0x7f7c0c0e6470 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c1406a090 tx=0x7f7c140a72b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdd14fbafa669ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.826+0000 7f7c12ffd640 1 -- 172.21.15.123:0/2410109865 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b4070 con 0x7f7c0c0e6020 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.827+0000 7f7c12ffd640 1 -- 172.21.15.123:0/2410109865 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c140af640 con 0x7f7c0c0e6020 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.827+0000 7f7c194f9640 1 -- 172.21.15.123:0/2410109865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0e6020 msgr2=0x7f7c0c0e6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.827+0000 7f7c194f9640 1 --2- 172.21.15.123:0/2410109865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0e6020 0x7f7c0c0e6470 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c1406a090 tx=0x7f7c140a72b0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.828+0000 7f7c194f9640 1 -- 172.21.15.123:0/2410109865 shutdown_connections 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.828+0000 7f7c194f9640 1 --2- 172.21.15.123:0/2410109865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0e6020 0x7f7c0c0e6470 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.828+0000 7f7c194f9640 1 --2- 172.21.15.123:0/2410109865 >> v2:172.21.15.194:3300/0 conn(0x7f7c0c04aa30 0x7f7c0c0059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.828+0000 7f7c194f9640 1 -- 172.21.15.123:0/2410109865 >> 172.21.15.123:0/2410109865 conn(0x7f7c0c04fc40 msgr2=0x7f7c0c050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.831+0000 7f7c194f9640 1 -- 172.21.15.123:0/2410109865 shutdown_connections 2024-09-19T09:51:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.832+0000 7f7c194f9640 1 -- 172.21.15.123:0/2410109865 wait complete. 2024-09-19T09:51:29.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.834+0000 7f7c194f9640 1 Processor -- start 2024-09-19T09:51:29.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.834+0000 7f7c194f9640 1 -- start start 2024-09-19T09:51:29.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.835+0000 7f7c194f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0dce80 0x7f7c0c049820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.835+0000 7f7c194f9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c194f9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c0c04f280 0x7f7c0c0dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c194f9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c045b80 con 0x7f7c0c0dce80 2024-09-19T09:51:29.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c194f9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0dd260 con 0x7f7c0c0e0160 2024-09-19T09:51:29.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c194f9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c044b20 con 0x7f7c0c04f280 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c137fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c137fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40210/0 (socket says 172.21.15.123:40210) 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c137fe640 1 -- 172.21.15.123:0/3090793091 learned_addr learned my addr 172.21.15.123:0/3090793091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.836+0000 7f7c18cf8640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c0c04f280 0x7f7c0c0dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c137fe640 1 -- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 msgr2=0x7f7c0c0d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c137fe640 1 -- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 msgr2=0x7f7c0c0d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c137fe640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c137fe640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c18cf8640 1 -- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 msgr2=0x7f7c0c0d7a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c18cf8640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c18cf8640 1 -- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0dce80 msgr2=0x7f7c0c049820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c18cf8640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0dce80 0x7f7c0c049820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.837+0000 7f7c18cf8640 1 -- 172.21.15.123:0/3090793091 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0d7f50 con 0x7f7c0c04f280 2024-09-19T09:51:29.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.838+0000 7f7c18cf8640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c0c04f280 0x7f7c0c0dd3e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c1406b2c0 tx=0x7f7c140639f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.838+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140bc070 con 0x7f7c0c04f280 2024-09-19T09:51:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.838+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c048390 con 0x7f7c0c04f280 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.838+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c0df0c0 con 0x7f7c0c04f280 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.839+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c140b8610 con 0x7f7c0c04f280 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.839+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b4040 con 0x7f7c0c04f280 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.842+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c140bf070 con 0x7f7c0c04f280 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.843+0000 7f7c10ff9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7bf806c2b0 0x7f7bf806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.843+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7c14127f80 con 0x7f7c0c04f280 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.843+0000 7f7c13fff640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7bf806c2b0 0x7f7bf806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.843+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf4005290 con 0x7f7c0c04f280 2024-09-19T09:51:29.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.844+0000 7f7c13fff640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7bf806c2b0 0x7f7bf806e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00006b40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:29.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:29.853+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7c140c6070 con 0x7f7c0c04f280 2024-09-19T09:51:30.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.426+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7bf4005580 con 0x7f7c0c04f280 2024-09-19T09:51:30.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.427+0000 7f7c10ff9640 1 -- 172.21.15.123:0/3090793091 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f7c140f6660 con 0x7f7c0c04f280 2024-09-19T09:51:30.429 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.431+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7bf806c2b0 msgr2=0x7f7bf806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.431+0000 7f7c194f9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7bf806c2b0 0x7f7bf806e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00006b40 comp rx=0 tx=0).stop 2024-09-19T09:51:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.431+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c0c04f280 msgr2=0x7f7c0c0dd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.431+0000 7f7c194f9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c0c04f280 0x7f7c0c0dd3e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c1406b2c0 tx=0x7f7c140639f0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.436+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 shutdown_connections 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.436+0000 7f7c194f9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7bf806c2b0 0x7f7bf806e770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.436+0000 7f7c194f9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c0c04f280 0x7f7c0c0dd3e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.436+0000 7f7c194f9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c0c0e0160 0x7f7c0c0d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.436+0000 7f7c194f9640 1 --2- 172.21.15.123:0/3090793091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c0c0dce80 0x7f7c0c049820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.436+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 >> 172.21.15.123:0/3090793091 conn(0x7f7c0c04fc40 msgr2=0x7f7c0c0dbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.437+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 shutdown_connections 2024-09-19T09:51:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.437+0000 7f7c194f9640 1 -- 172.21.15.123:0/3090793091 wait complete. 2024-09-19T09:51:30.463 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:51:30.463 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:51:30.463 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:51:30.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.678+0000 7fe908a45640 1 Processor -- start 2024-09-19T09:51:30.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.678+0000 7fe908a45640 1 -- start start 2024-09-19T09:51:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.679+0000 7fe908a45640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe904159870 0x7fe90415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.680+0000 7fe908a45640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe904162ca0 con 0x7fe904071f40 2024-09-19T09:51:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.680+0000 7fe90259c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe904159870 0x7fe90415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.680+0000 7fe90259c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe904159870 0x7fe90415ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36782/0 (socket says 172.21.15.123:36782) 2024-09-19T09:51:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.680+0000 7fe90259c640 1 -- 172.21.15.123:0/1080026610 learned_addr learned my addr 172.21.15.123:0/1080026610 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.680+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe904162f80 con 0x7fe9040c8300 2024-09-19T09:51:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.680+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe904160460 con 0x7fe904159870 2024-09-19T09:51:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.681+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715985764 0 0) 0x7fe904162ca0 con 0x7fe904071f40 2024-09-19T09:51:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.681+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ec003520 con 0x7fe904071f40 2024-09-19T09:51:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 40417774 0 0) 0x7fe8ec003520 con 0x7fe904071f40 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe904159870 msgr2=0x7fe90415ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe904159870 0x7fe90415ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 >> v1:172.21.15.194:6789/0 conn(0x7fe9040c8300 legacy=0x7fe9040c7380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe904163260 con 0x7fe904071f40 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fe8fc0019f0 con 0x7fe904071f40 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 >> v1:172.21.15.123:6789/0 conn(0x7fe904071f40 legacy=0x7fe9040723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8ec0039e0 0x7fe8ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8ec004800 0x7fe8ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0052e0 0x7fe8ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe904160460 con 0x7fe8ec0052e0 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec00c180 con 0x7fe8ec004800 2024-09-19T09:51:30.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.682+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ec00c380 con 0x7fe8ec0039e0 2024-09-19T09:51:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.683+0000 7fe902d9d640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0052e0 0x7fe8ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.683+0000 7fe902d9d640 1 -- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8ec0039e0 msgr2=0x7fe8ec003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.683+0000 7fe902d9d640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8ec0039e0 0x7fe8ec003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.683+0000 7fe902d9d640 1 -- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8ec004800 msgr2=0x7fe8ec004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.683+0000 7fe902d9d640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8ec004800 0x7fe8ec004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.684+0000 7fe902d9d640 1 -- 172.21.15.123:0/1080026610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec003520 con 0x7fe8ec0052e0 2024-09-19T09:51:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.685+0000 7fe902d9d640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0052e0 0x7fe8ec00b9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c490 tx=0x7fe8ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a360e1cdcd999fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.685+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc033070 con 0x7fe8ec0052e0 2024-09-19T09:51:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.685+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc02f6a0 con 0x7fe8ec0052e0 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.685+0000 7fe90159a640 1 -- 172.21.15.123:0/1080026610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00c0e0 con 0x7fe8ec0052e0 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.686+0000 7fe90259c640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe904159870 0x7fe90415ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.686+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0052e0 msgr2=0x7fe8ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.686+0000 7fe908a45640 1 --2- 172.21.15.123:0/1080026610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0052e0 0x7fe8ec00b9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c490 tx=0x7fe8ec005830 comp rx=0 tx=0).stop 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.686+0000 7fe902d9d640 1 -- 172.21.15.123:0/1080026610 reap_dead start 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.686+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 shutdown_connections 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.686+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 >> 172.21.15.123:0/1080026610 conn(0x7fe90406ed00 msgr2=0x7fe90406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.687+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 shutdown_connections 2024-09-19T09:51:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.687+0000 7fe908a45640 1 -- 172.21.15.123:0/1080026610 wait complete. 2024-09-19T09:51:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.689+0000 7fe908a45640 1 Processor -- start 2024-09-19T09:51:30.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.692+0000 7fe908a45640 1 -- start start 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.693+0000 7fe908a45640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 0x7fe904201180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.693+0000 7fe908a45640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9042016c0 0x7fe9041586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.693+0000 7fe908a45640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9041f4e80 0x7fe904158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.693+0000 7fe908a45640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe904071ab0 con 0x7fe9041f4e80 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.693+0000 7fe908a45640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe904162a50 con 0x7fe9042016c0 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.693+0000 7fe908a45640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe9040c6ca0 con 0x7fe9041f4aa0 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.694+0000 7fe90259c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 0x7fe904201180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.694+0000 7fe90259c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 0x7fe904201180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36792/0 (socket says 172.21.15.123:36792) 2024-09-19T09:51:30.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.694+0000 7fe90259c640 1 -- 172.21.15.123:0/203211144 learned_addr learned my addr 172.21.15.123:0/203211144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:30.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.694+0000 7fe902d9d640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9041f4e80 0x7fe904158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.695+0000 7fe901d9b640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9042016c0 0x7fe9041586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.698+0000 7fe90259c640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9042016c0 msgr2=0x7fe9041586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.698+0000 7fe90259c640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9042016c0 0x7fe9041586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.698+0000 7fe90259c640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9041f4e80 msgr2=0x7fe904158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.698+0000 7fe90259c640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9041f4e80 0x7fe904158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.698+0000 7fe90259c640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe904159120 con 0x7fe9041f4aa0 2024-09-19T09:51:30.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.698+0000 7fe901d9b640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9042016c0 0x7fe9041586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:30.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.700+0000 7fe90259c640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 0x7fe904201180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c540 tx=0x7fe8f400ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:30.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.701+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4015070 con 0x7fe9041f4aa0 2024-09-19T09:51:30.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.701+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f4011800 con 0x7fe9041f4aa0 2024-09-19T09:51:30.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.701+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4011c30 con 0x7fe9041f4aa0 2024-09-19T09:51:30.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.703+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9041e97a0 con 0x7fe9041f4aa0 2024-09-19T09:51:30.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.703+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90415a300 con 0x7fe9041f4aa0 2024-09-19T09:51:30.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.705+0000 7fe908a45640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 0x7fe904161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.705+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe904072cc0 con 0x7fe9040c3190 2024-09-19T09:51:30.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.706+0000 7fe901d9b640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 0x7fe904161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.706+0000 7fe901d9b640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9040699a0 con 0x7fe9040c3190 2024-09-19T09:51:30.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.707+0000 7fe901d9b640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 0x7fe904161670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe9040c90b0 tx=0x7fe8f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:30.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.708+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8015070 con 0x7fe9040c3190 2024-09-19T09:51:30.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.708+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe8f4018070 con 0x7fe9041f4aa0 2024-09-19T09:51:30.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8e406c200 0x7fe8e406e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe8f8011800 con 0x7fe9040c3190 2024-09-19T09:51:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 msgr2=0x7fe904161670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 0x7fe904161670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe9040c90b0 tx=0x7fe8f800c950 comp rx=0 tx=0).stop 2024-09-19T09:51:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 msgr2=0x7fe904161670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9040c3190 0x7fe904161670 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe9040c90b0 tx=0x7fe8f800c950 comp rx=0 tx=0).stop 2024-09-19T09:51:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.709+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fe8f408b520 con 0x7fe9041f4aa0 2024-09-19T09:51:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.710+0000 7fe902d9d640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8e406c200 0x7fe8e406e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.710+0000 7fe902d9d640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8e406c200 0x7fe8e406e6c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc035000 tx=0x7fe8fc03a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 56, 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 193946, 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:30.729 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:30.730 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:30.731 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:30.732 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:30.733 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:30.734 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:30.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:30.737 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:30.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:30.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:30.740 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:30.741 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:30.742 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.724+0000 7fe908a45640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 0x7fe904161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.724+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9041624d0 con 0x7fe904161bb0 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.724+0000 7fe901d9b640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 0x7fe904161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.725+0000 7fe901d9b640 1 -- 172.21.15.123:0/203211144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe904071110 con 0x7fe904161bb0 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.725+0000 7fe901d9b640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 0x7fe904161f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8014000 tx=0x7fe8f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.725+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8028060 con 0x7fe904161bb0 2024-09-19T09:51:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.726+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fe8f8004020 con 0x7fe904161bb0 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.726+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 msgr2=0x7fe904161f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.726+0000 7fe8f2ffd640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 0x7fe904161f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8014000 tx=0x7fe8f8004770 comp rx=0 tx=0).stop 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe8f2ffd640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 msgr2=0x7fe904161f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe8f2ffd640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe904161bb0 0x7fe904161f90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8e406c200 msgr2=0x7fe8e406e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe908a45640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe8e406c200 0x7fe8e406e6c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc035000 tx=0x7fe8fc03a040 comp rx=0 tx=0).stop 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe902d9d640 1 -- 172.21.15.123:0/203211144 reap_dead start 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 msgr2=0x7fe904201180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.727+0000 7fe908a45640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 0x7fe904201180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c540 tx=0x7fe8f400ca00 comp rx=0 tx=0).stop 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.728+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 shutdown_connections 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.728+0000 7fe908a45640 1 --2- 172.21.15.123:0/203211144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9041f4aa0 0x7fe904201180 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c540 tx=0x7fe8f400ca00 comp rx=0 tx=0).stop 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.728+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 >> 172.21.15.123:0/203211144 conn(0x7fe90406ed00 msgr2=0x7fe9040c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.729+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 shutdown_connections 2024-09-19T09:51:30.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.730+0000 7fe908a45640 1 -- 172.21.15.123:0/203211144 wait complete. 2024-09-19T09:51:30.763 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:51:30.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:51:30.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:51:30.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.966+0000 7f15fc846640 1 Processor -- start 2024-09-19T09:51:30.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.967+0000 7f15fc846640 1 -- start start 2024-09-19T09:51:30.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15fc846640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f8159630 0x7f15f80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15fc846640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f15f806c8a0 0x7f15f806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15fc846640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f80c6aa0 con 0x7f15f806ccc0 2024-09-19T09:51:30.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15fc846640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f15f81634f0 con 0x7f15f806c8a0 2024-09-19T09:51:30.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15fc846640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f15f8162920 con 0x7f15f8159630 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15f759e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f15f806ccc0 0x7f15f80c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47908/0 (socket says 172.21.15.123:47908) 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15f759e640 1 -- 172.21.15.123:0/81249242 learned_addr learned my addr 172.21.15.123:0/81249242 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15f6d9d640 1 --2- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f8159630 0x7f15f80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.969+0000 7f15f659c640 1 --2- 172.21.15.123:0/81249242 >> v2:172.21.15.194:3300/0 conn(0x7f15f806c8a0 0x7f15f806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.970+0000 7f15f659c640 1 -- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f8159630 msgr2=0x7f15f80c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.970+0000 7f15f659c640 1 --2- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f8159630 0x7f15f80c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.970+0000 7f15f659c640 1 -- 172.21.15.123:0/81249242 >> v1:172.21.15.123:6789/0 conn(0x7f15f806ccc0 legacy=0x7f15f80c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.970+0000 7f15f659c640 1 -- 172.21.15.123:0/81249242 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f8162bc0 con 0x7f15f806c8a0 2024-09-19T09:51:30.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.971+0000 7f15f659c640 1 --2- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f806c8a0 0x7f15f806bc10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0097a0 tx=0x7f15ec02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438f0ea1bbd82b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.974+0000 7f15f5d9b640 1 -- 172.21.15.123:0/81249242 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec037070 con 0x7f15f806c8a0 2024-09-19T09:51:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.974+0000 7f15f5d9b640 1 -- 172.21.15.123:0/81249242 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec032440 con 0x7f15f806c8a0 2024-09-19T09:51:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.975+0000 7f15fc846640 1 -- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f806c8a0 msgr2=0x7f15f806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:30.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.975+0000 7f15fc846640 1 --2- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f806c8a0 0x7f15f806bc10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0097a0 tx=0x7f15ec02a210 comp rx=0 tx=0).stop 2024-09-19T09:51:30.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.983+0000 7f15fc846640 1 -- 172.21.15.123:0/81249242 shutdown_connections 2024-09-19T09:51:30.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.983+0000 7f15fc846640 1 --2- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f806c8a0 0x7f15f806bc10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.983+0000 7f15fc846640 1 --2- 172.21.15.123:0/81249242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f8159630 0x7f15f80c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:30.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.983+0000 7f15fc846640 1 -- 172.21.15.123:0/81249242 >> 172.21.15.123:0/81249242 conn(0x7f15f80c9100 msgr2=0x7f15f80c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:30.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.985+0000 7f15fc846640 1 -- 172.21.15.123:0/81249242 shutdown_connections 2024-09-19T09:51:30.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.985+0000 7f15fc846640 1 -- 172.21.15.123:0/81249242 wait complete. 2024-09-19T09:51:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.995+0000 7f15fc846640 1 Processor -- start 2024-09-19T09:51:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.995+0000 7f15fc846640 1 -- start start 2024-09-19T09:51:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.996+0000 7f15fc846640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15f806c8a0 0x7f15f815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.996+0000 7f15fc846640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 0x7f15f8150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.996+0000 7f15fc846640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f81f8c40 0x7f15f8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.996+0000 7f15fc846640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80c8ea0 con 0x7f15f806c8a0 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.996+0000 7f15fc846640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8163180 con 0x7f15f8159630 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.996+0000 7f15fc846640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f15f8159a10 con 0x7f15f81f8c40 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.997+0000 7f15f659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 0x7f15f8150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.997+0000 7f15f659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 0x7f15f8150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40236/0 (socket says 172.21.15.123:40236) 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.997+0000 7f15f659c640 1 -- 172.21.15.123:0/4131558625 learned_addr learned my addr 172.21.15.123:0/4131558625 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.997+0000 7f15f759e640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f81f8c40 0x7f15f8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:30.997+0000 7f15f6d9d640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15f806c8a0 0x7f15f815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.000+0000 7f15f659c640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f81f8c40 msgr2=0x7f15f8157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.000+0000 7f15f659c640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f81f8c40 0x7f15f8157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.000+0000 7f15f659c640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15f806c8a0 msgr2=0x7f15f815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.000+0000 7f15f659c640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15f806c8a0 0x7f15f815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.000+0000 7f15f659c640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f81ea7a0 con 0x7f15f8159630 2024-09-19T09:51:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.009+0000 7f15f659c640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 0x7f15f8150470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02a800 tx=0x7f15ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.021+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec040020 con 0x7f15f8159630 2024-09-19T09:51:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.021+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ec038040 con 0x7f15f8159630 2024-09-19T09:51:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.021+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec037070 con 0x7f15f8159630 2024-09-19T09:51:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.021+0000 7f15fc846640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f81eaa80 con 0x7f15f8159630 2024-09-19T09:51:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.021+0000 7f15fc846640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f81eb040 con 0x7f15f8159630 2024-09-19T09:51:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.025+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15ec043020 con 0x7f15f8159630 2024-09-19T09:51:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.025+0000 7f15df7fe640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f15e406c2b0 0x7f15e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.026+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f15ec0ab970 con 0x7f15f8159630 2024-09-19T09:51:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.027+0000 7f15f6d9d640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f15e406c2b0 0x7f15e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.027+0000 7f15dd7fa640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 0x7f15d8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.027+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8007ec0 con 0x7f15d8002a70 2024-09-19T09:51:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.027+0000 7f15f759e640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 0x7f15d8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.028+0000 7f15f6d9d640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f15e406c2b0 0x7f15e406e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009a20 tx=0x7f15e8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.028+0000 7f15f759e640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15d80080c0 con 0x7f15d8002a70 2024-09-19T09:51:31.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.028+0000 7f15f759e640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 0x7f15d8004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f15f806ddc0 tx=0x7f15f000def0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.032+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f000bc30 con 0x7f15d8002a70 2024-09-19T09:51:31.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.032+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f15f0017070 con 0x7f15d8002a70 2024-09-19T09:51:31.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.032+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 msgr2=0x7f15d8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.044+0000 7f15df7fe640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 0x7f15d8004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f15f806ddc0 tx=0x7f15f000def0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.044+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 msgr2=0x7f15d8004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:31.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.044+0000 7f15df7fe640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8002a70 0x7f15d8004f30 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f15f806ddc0 tx=0x7f15f000def0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.048+0000 7f15dd7fa640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 0x7f15d8007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.048+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f15d800a4a0 con 0x7f15d8006eb0 2024-09-19T09:51:31.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.050+0000 7f15f759e640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 0x7f15d8007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.051+0000 7f15f759e640 1 -- 172.21.15.123:0/4131558625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f15d8007880 con 0x7f15d8006eb0 2024-09-19T09:51:31.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.053+0000 7f15f759e640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 0x7f15d8007340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15f0016000 tx=0x7f15f0001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 56, 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 5123, 2024-09-19T09:51:31.057 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 2, 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:31.058 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:31.059 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:31.060 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:31.061 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:31.062 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:31.063 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:31.064 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.065 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:31.066 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.067 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:31.068 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:31.069 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:31.070 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:31.070 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:31.070 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.070 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.070 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.071 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.072 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.073 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:31.073 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.054+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f000bc30 con 0x7f15d8006eb0 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f15f0012620 con 0x7f15d8006eb0 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 msgr2=0x7f15d8007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15df7fe640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 0x7f15d8007340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15f0016000 tx=0x7f15f0001250 comp rx=0 tx=0).stop 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15df7fe640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 msgr2=0x7f15d8007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15df7fe640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15d8006eb0 0x7f15d8007340 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15f0016000 tx=0x7f15f0001250 comp rx=0 tx=0).stop 2024-09-19T09:51:31.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f15e406c2b0 msgr2=0x7f15e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15dd7fa640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f15e406c2b0 0x7f15e406e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009a20 tx=0x7f15e8009190 comp rx=0 tx=0).stop 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.055+0000 7f15f759e640 1 -- 172.21.15.123:0/4131558625 reap_dead start 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.056+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 msgr2=0x7f15f8150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.056+0000 7f15dd7fa640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 0x7f15f8150470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02a800 tx=0x7f15ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.056+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 shutdown_connections 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.056+0000 7f15dd7fa640 1 --2- 172.21.15.123:0/4131558625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f8159630 0x7f15f8150470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.056+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 >> 172.21.15.123:0/4131558625 conn(0x7f15f80c9100 msgr2=0x7f15f8156710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.056+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 shutdown_connections 2024-09-19T09:51:31.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.057+0000 7f15dd7fa640 1 -- 172.21.15.123:0/4131558625 wait complete. 2024-09-19T09:51:31.094 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:51:31.094 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:51:31.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:51:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.276+0000 7fc1b94a4640 1 Processor -- start 2024-09-19T09:51:31.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.276+0000 7fc1b94a4640 1 -- start start 2024-09-19T09:51:31.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.278+0000 7fc1b94a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b415b350 0x7fc1b4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.278+0000 7fc1b94a4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1b40c8710 0x7fc1b40c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.278+0000 7fc1b94a4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b40c7b30 con 0x7fc1b41514a0 2024-09-19T09:51:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.278+0000 7fc1b94a4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b4151880 con 0x7fc1b40c8710 2024-09-19T09:51:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.278+0000 7fc1b94a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40c7e10 con 0x7fc1b415b350 2024-09-19T09:51:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.279+0000 7fc1b37fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1b40c8710 0x7fc1b40c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.279+0000 7fc1b37fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1b40c8710 0x7fc1b40c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40268/0 (socket says 172.21.15.123:40268) 2024-09-19T09:51:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.279+0000 7fc1b27fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b415b350 0x7fc1b4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.280+0000 7fc1b37fe640 1 -- 172.21.15.123:0/2747122017 learned_addr learned my addr 172.21.15.123:0/2747122017 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.282+0000 7fc1b1ffb640 1 -- 172.21.15.123:0/2747122017 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800157726 0 0) 0x7fc1b40c7b30 con 0x7fc1b41514a0 2024-09-19T09:51:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.282+0000 7fc1b1ffb640 1 -- 172.21.15.123:0/2747122017 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc19c003520 con 0x7fc1b41514a0 2024-09-19T09:51:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.282+0000 7fc1b37fe640 1 -- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b415b350 msgr2=0x7fc1b4157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.282+0000 7fc1b37fe640 1 --2- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b415b350 0x7fc1b4157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.282+0000 7fc1b37fe640 1 -- 172.21.15.123:0/2747122017 >> v1:172.21.15.194:6789/0 conn(0x7fc1b41514a0 legacy=0x7fc1b40c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.282+0000 7fc1b37fe640 1 -- 172.21.15.123:0/2747122017 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b415a870 con 0x7fc1b40c8710 2024-09-19T09:51:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.283+0000 7fc1b27fc640 1 --2- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b415b350 0x7fc1b4157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.283+0000 7fc1b37fe640 1 --2- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40c8710 0x7fc1b40c9620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009870 tx=0x7fc1a402a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce8e14ad69aa2704 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.284+0000 7fc1b1ffb640 1 -- 172.21.15.123:0/2747122017 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4037070 con 0x7fc1b40c8710 2024-09-19T09:51:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.284+0000 7fc1b1ffb640 1 -- 172.21.15.123:0/2747122017 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4032640 con 0x7fc1b40c8710 2024-09-19T09:51:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.284+0000 7fc1b1ffb640 1 -- 172.21.15.123:0/2747122017 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4032a50 con 0x7fc1b40c8710 2024-09-19T09:51:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.285+0000 7fc1b94a4640 1 -- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40c8710 msgr2=0x7fc1b40c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.285+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40c8710 0x7fc1b40c9620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009870 tx=0x7fc1a402a330 comp rx=0 tx=0).stop 2024-09-19T09:51:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.288+0000 7fc1b94a4640 1 -- 172.21.15.123:0/2747122017 shutdown_connections 2024-09-19T09:51:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.288+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b40c8710 0x7fc1b40c9620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.288+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/2747122017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b415b350 0x7fc1b4157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.288+0000 7fc1b94a4640 1 -- 172.21.15.123:0/2747122017 >> 172.21.15.123:0/2747122017 conn(0x7fc1b406f110 msgr2=0x7fc1b406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:31.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.293+0000 7fc1b94a4640 1 -- 172.21.15.123:0/2747122017 shutdown_connections 2024-09-19T09:51:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.297+0000 7fc1b94a4640 1 -- 172.21.15.123:0/2747122017 wait complete. 2024-09-19T09:51:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.298+0000 7fc1b94a4640 1 Processor -- start 2024-09-19T09:51:31.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.299+0000 7fc1b94a4640 1 -- start start 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b94a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b40c8710 0x7fc1b41f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b94a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b41514a0 0x7fc1b41f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b94a4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b415b350 0x7fc1b4152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b94a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40c9250 con 0x7fc1b40c8710 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b94a4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b415ae30 con 0x7fc1b415b350 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b94a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40c93d0 con 0x7fc1b41514a0 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b37fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b415b350 0x7fc1b4152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b37fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b415b350 0x7fc1b4152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40284/0 (socket says 172.21.15.123:40284) 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b37fe640 1 -- 172.21.15.123:0/972157267 learned_addr learned my addr 172.21.15.123:0/972157267 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.300+0000 7fc1b2ffd640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b40c8710 0x7fc1b41f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b27fc640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b41514a0 0x7fc1b41f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b2ffd640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b41514a0 msgr2=0x7fc1b41f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b2ffd640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1b41514a0 0x7fc1b41f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b2ffd640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b415b350 msgr2=0x7fc1b4152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b2ffd640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b415b350 0x7fc1b4152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b2ffd640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4146690 con 0x7fc1b40c8710 2024-09-19T09:51:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.301+0000 7fc1b37fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1b415b350 0x7fc1b4152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.302+0000 7fc1b2ffd640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b40c8710 0x7fc1b41f9130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c6b0 tx=0x7fc1ac00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.304+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac003b70 con 0x7fc1b40c8710 2024-09-19T09:51:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.304+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b414e310 con 0x7fc1b40c8710 2024-09-19T09:51:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.304+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b414e8d0 con 0x7fc1b40c8710 2024-09-19T09:51:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.304+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac003d10 con 0x7fc1b40c8710 2024-09-19T09:51:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.304+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac005310 con 0x7fc1b40c8710 2024-09-19T09:51:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.306+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 0x7fc194004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.306+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc194007ec0 con 0x7fc194002a70 2024-09-19T09:51:31.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.307+0000 7fc1b27fc640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 0x7fc194004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.308+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc1ac0054b0 con 0x7fc1b40c8710 2024-09-19T09:51:31.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.309+0000 7fc1b27fc640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1940080c0 con 0x7fc194002a70 2024-09-19T09:51:31.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.309+0000 7fc19b7fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc1a006c380 0x7fc1a006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.310+0000 7fc1b37fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc1a006c380 0x7fc1a006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.311+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc1ac08b260 con 0x7fc1b40c8710 2024-09-19T09:51:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.311+0000 7fc1b27fc640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 0x7fc194004f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1b414ec60 tx=0x7fc1a80119f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.311+0000 7fc1b37fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc1a006c380 0x7fc1a006e840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009630 tx=0x7fc1a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.311+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8015870 con 0x7fc194002a70 2024-09-19T09:51:31.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.314+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc1a8015870 con 0x7fc194002a70 2024-09-19T09:51:31.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.314+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 msgr2=0x7fc194004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.314+0000 7fc19b7fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 0x7fc194004f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1b414ec60 tx=0x7fc1a80119f0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.314+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 msgr2=0x7fc194004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.314+0000 7fc19b7fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194002a70 0x7fc194004f30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.328+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 0x7fc1940073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.328+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc19400a4a0 con 0x7fc194006f30 2024-09-19T09:51:31.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.328+0000 7fc1b27fc640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 0x7fc1940073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.330+0000 7fc1b27fc640 1 -- 172.21.15.123:0/972157267 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc194007900 con 0x7fc194006f30 2024-09-19T09:51:31.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.333+0000 7fc1b27fc640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 0x7fc1940073c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8019000 tx=0x7fc1a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.334+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8026070 con 0x7fc194006f30 2024-09-19T09:51:31.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.334+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7fc1a8006840 con 0x7fc194006f30 2024-09-19T09:51:31.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.334+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 msgr2=0x7fc1940073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.334+0000 7fc19b7fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 0x7fc1940073c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8019000 tx=0x7fc1a80046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.334+0000 7fc19b7fe640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 msgr2=0x7fc1940073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.334+0000 7fc19b7fe640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc194006f30 0x7fc1940073c0 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8019000 tx=0x7fc1a80046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 56, 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 300651, 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:31.342 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 2, 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:31.343 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:31.344 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:31.345 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:31.345 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:31.345 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:31.345 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:31.345 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:31.345 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.346 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:31.348 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:31.348 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:31.348 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:31.348 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:31.348 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:31.348 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:31.349 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:31.349 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:31.349 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:31.349 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:31.349 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:31.349 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:31.350 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:31.350 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:31.350 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:31.350 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:31.350 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:31.350 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:31.351 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:31.351 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:31.351 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:31.351 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:31.351 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.351 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:31.352 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:31.353 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.354 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.354 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.354 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:31.354 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:31.354 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.354 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.355 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.355 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.355 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:31.355 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:31.355 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:31.356 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:31.356 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:31.356 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.356 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.356 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:31.356 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:31.357 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:31.357 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:31.357 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.357 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:31.357 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:31.358 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.358 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.358 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.358 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:31.358 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:31.358 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.359 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.359 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.359 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.359 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:31.359 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:31.359 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:31.360 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:31.360 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:31.360 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.360 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.360 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:31.360 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:31.361 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:31.361 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:31.361 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.361 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:31.361 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:31.362 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.362 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.362 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.362 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:31.362 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:31.362 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:31.363 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.363 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.363 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.363 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:31.363 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:31.363 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:31.364 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:31.364 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:31.364 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.364 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.364 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.365 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:31.365 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:31.365 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.365 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.365 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.365 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:31.366 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.366 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.366 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:31.366 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.366 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.366 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.367 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:31.367 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.367 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.367 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:31.367 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.367 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.368 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:31.370 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.340+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc1a006c380 msgr2=0x7fc1a006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.340+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc1a006c380 0x7fc1a006e840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009630 tx=0x7fc1a402e000 comp rx=0 tx=0).stop 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.340+0000 7fc1b37fe640 1 -- 172.21.15.123:0/972157267 reap_dead start 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.340+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b40c8710 msgr2=0x7fc1b41f9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.340+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b40c8710 0x7fc1b41f9130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c6b0 tx=0x7fc1ac00cb70 comp rx=0 tx=0).stop 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.341+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 shutdown_connections 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.341+0000 7fc1b94a4640 1 --2- 172.21.15.123:0/972157267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b40c8710 0x7fc1b41f9130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.341+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 >> 172.21.15.123:0/972157267 conn(0x7fc1b406f110 msgr2=0x7fc1b4158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.341+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 shutdown_connections 2024-09-19T09:51:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.341+0000 7fc1b94a4640 1 -- 172.21.15.123:0/972157267 wait complete. 2024-09-19T09:51:31.372 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:51:31.372 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:51:31.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:51:31.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.581+0000 7fc519986640 1 Processor -- start 2024-09-19T09:51:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.587+0000 7fc519986640 1 -- start start 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.588+0000 7fc519986640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc50c0d5850 0x7fc50c007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.588+0000 7fc519986640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c04d310 0x7fc50c045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.588+0000 7fc519986640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc50c047a80 0x7fc50c046290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.588+0000 7fc519986640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c0dbe90 con 0x7fc50c0d5850 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.588+0000 7fc519986640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c0dc3a0 con 0x7fc50c047a80 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.588+0000 7fc519986640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0dc0c0 con 0x7fc50c04d310 2024-09-19T09:51:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.590+0000 7fc519185640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc50c047a80 0x7fc50c046290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.590+0000 7fc519185640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc50c047a80 0x7fc50c046290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40294/0 (socket says 172.21.15.123:40294) 2024-09-19T09:51:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.590+0000 7fc519185640 1 -- 172.21.15.123:0/1785380388 learned_addr learned my addr 172.21.15.123:0/1785380388 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.590+0000 7fc513fff640 1 --2- 172.21.15.123:0/1785380388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c04d310 0x7fc50c045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.592+0000 7fc518984640 1 --2- 172.21.15.123:0/1785380388 >> v2:172.21.15.123:3300/0 conn(0x7fc50c0d5850 0x7fc50c007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.592+0000 7fc518984640 1 -- 172.21.15.123:0/1785380388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c04d310 msgr2=0x7fc50c045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:31.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.592+0000 7fc518984640 1 --2- 172.21.15.123:0/1785380388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c04d310 0x7fc50c045d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.592+0000 7fc518984640 1 -- 172.21.15.123:0/1785380388 >> v2:172.21.15.194:3300/0 conn(0x7fc50c047a80 msgr2=0x7fc50c046290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:31.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.592+0000 7fc518984640 1 --2- 172.21.15.123:0/1785380388 >> v2:172.21.15.194:3300/0 conn(0x7fc50c047a80 0x7fc50c046290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.592+0000 7fc518984640 1 -- 172.21.15.123:0/1785380388 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c046cc0 con 0x7fc50c0d5850 2024-09-19T09:51:31.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.594+0000 7fc518984640 1 --2- 172.21.15.123:0/1785380388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c0d5850 0x7fc50c007730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0dfaa0 tx=0x7fc50002a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e678e03a7c9925 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.594+0000 7fc5137fe640 1 -- 172.21.15.123:0/1785380388 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500037070 con 0x7fc50c0d5850 2024-09-19T09:51:31.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.594+0000 7fc5137fe640 1 -- 172.21.15.123:0/1785380388 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500032440 con 0x7fc50c0d5850 2024-09-19T09:51:31.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.594+0000 7fc5137fe640 1 -- 172.21.15.123:0/1785380388 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500032810 con 0x7fc50c0d5850 2024-09-19T09:51:31.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.596+0000 7fc519986640 1 -- 172.21.15.123:0/1785380388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c0d5850 msgr2=0x7fc50c007730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.596+0000 7fc519986640 1 --2- 172.21.15.123:0/1785380388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c0d5850 0x7fc50c007730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0dfaa0 tx=0x7fc50002a120 comp rx=0 tx=0).stop 2024-09-19T09:51:31.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.597+0000 7fc519986640 1 -- 172.21.15.123:0/1785380388 shutdown_connections 2024-09-19T09:51:31.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.597+0000 7fc519986640 1 --2- 172.21.15.123:0/1785380388 >> v2:172.21.15.194:3300/0 conn(0x7fc50c047a80 0x7fc50c046290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.597+0000 7fc519986640 1 --2- 172.21.15.123:0/1785380388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c04d310 0x7fc50c045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.597+0000 7fc519986640 1 --2- 172.21.15.123:0/1785380388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c0d5850 0x7fc50c007730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.597+0000 7fc519986640 1 -- 172.21.15.123:0/1785380388 >> 172.21.15.123:0/1785380388 conn(0x7fc50c04d830 msgr2=0x7fc50c04dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.601+0000 7fc519986640 1 -- 172.21.15.123:0/1785380388 shutdown_connections 2024-09-19T09:51:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.606+0000 7fc519986640 1 -- 172.21.15.123:0/1785380388 wait complete. 2024-09-19T09:51:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.608+0000 7fc519986640 1 Processor -- start 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.610+0000 7fc519986640 1 -- start start 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc519986640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c047a80 0x7fc50c0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc519986640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc50c04d310 0x7fc50c0dead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc519986640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c0d5850 0x7fc50c0df010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc519986640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c047560 con 0x7fc50c047a80 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc519986640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c047280 con 0x7fc50c04d310 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc519986640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0468c0 con 0x7fc50c0d5850 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc513fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc50c04d310 0x7fc50c0dead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc513fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc50c04d310 0x7fc50c0dead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40296/0 (socket says 172.21.15.123:40296) 2024-09-19T09:51:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.611+0000 7fc513fff640 1 -- 172.21.15.123:0/1678905955 learned_addr learned my addr 172.21.15.123:0/1678905955 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc519185640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c0d5850 0x7fc50c0df010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc518984640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c047a80 0x7fc50c0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc518984640 1 -- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c0d5850 msgr2=0x7fc50c0df010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc518984640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c0d5850 0x7fc50c0df010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc518984640 1 -- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc50c04d310 msgr2=0x7fc50c0dead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc518984640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc50c04d310 0x7fc50c0dead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.612+0000 7fc518984640 1 -- 172.21.15.123:0/1678905955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0c3e00 con 0x7fc50c047a80 2024-09-19T09:51:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.613+0000 7fc518984640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c047a80 0x7fc50c0c2ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc500031000 tx=0x7fc5000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.613+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500043070 con 0x7fc50c047a80 2024-09-19T09:51:31.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.613+0000 7fc519986640 1 -- 172.21.15.123:0/1678905955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c0c6a60 con 0x7fc50c047a80 2024-09-19T09:51:31.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.613+0000 7fc519986640 1 -- 172.21.15.123:0/1678905955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c0c7020 con 0x7fc50c047a80 2024-09-19T09:51:31.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.617+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500038040 con 0x7fc50c047a80 2024-09-19T09:51:31.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.617+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500037050 con 0x7fc50c047a80 2024-09-19T09:51:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.617+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc500046070 con 0x7fc50c047a80 2024-09-19T09:51:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.620+0000 7fc5117fa640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc4f806c3b0 0x7fc4f806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.620+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc5000ab4e0 con 0x7fc50c047a80 2024-09-19T09:51:31.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.622+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f4005290 con 0x7fc50c047a80 2024-09-19T09:51:31.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.626+0000 7fc513fff640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc4f806c3b0 0x7fc4f806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.632+0000 7fc513fff640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc4f806c3b0 0x7fc4f806e870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0d9020 tx=0x7fc508008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:31.632+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc500079560 con 0x7fc50c047a80 2024-09-19T09:51:32.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.173+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc4f4005d90 con 0x7fc50c047a80 2024-09-19T09:51:32.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.180+0000 7fc5117fa640 1 -- 172.21.15.123:0/1678905955 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc50007d860 con 0x7fc50c047a80 2024-09-19T09:51:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.198+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc4f806c3b0 msgr2=0x7fc4f806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.199+0000 7fc4feffd640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc4f806c3b0 0x7fc4f806e870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0d9020 tx=0x7fc508008040 comp rx=0 tx=0).stop 2024-09-19T09:51:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.199+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c047a80 msgr2=0x7fc50c0c2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.199+0000 7fc4feffd640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c047a80 0x7fc50c0c2ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc500031000 tx=0x7fc5000046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.199+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 shutdown_connections 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.199+0000 7fc4feffd640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc4f806c3b0 0x7fc4f806e870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.200+0000 7fc4feffd640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc50c0d5850 0x7fc50c0df010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.200+0000 7fc4feffd640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc50c04d310 0x7fc50c0dead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.200+0000 7fc4feffd640 1 --2- 172.21.15.123:0/1678905955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc50c047a80 0x7fc50c0c2ec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.200+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 >> 172.21.15.123:0/1678905955 conn(0x7fc50c04d830 msgr2=0x7fc50c0051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:32.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.201+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 shutdown_connections 2024-09-19T09:51:32.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:32.201+0000 7fc4feffd640 1 -- 172.21.15.123:0/1678905955 wait complete. 2024-09-19T09:51:32.227 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:51:33.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:51:33.597 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:51:42.228 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:51:42.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:42.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.438+0000 7f7c09a75640 1 Processor -- start 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.440+0000 7f7c09a75640 1 -- start start 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.441+0000 7f7c09a75640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c04162a00 0x7f7c0415ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.441+0000 7f7c09a75640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c040cb7b0 con 0x7f7c04159600 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.441+0000 7f7c09a75640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c040cba90 con 0x7f7c041599e0 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.441+0000 7f7c09a75640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7c040c4a00 con 0x7f7c04162a00 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.441+0000 7f7c08a73640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7c04159600 0x7f7c0406cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55116/0 (socket says 172.21.15.123:55116) 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.441+0000 7f7c08a73640 1 -- 172.21.15.123:0/1033918332 learned_addr learned my addr 172.21.15.123:0/1033918332 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:42.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.442+0000 7f7c09274640 1 --2- 172.21.15.123:0/1033918332 >> v2:172.21.15.123:3300/0 conn(0x7f7c04162a00 0x7f7c0415ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.442+0000 7f7c09274640 1 -- 172.21.15.123:0/1033918332 >> v1:172.21.15.194:6789/0 conn(0x7f7c041599e0 legacy=0x7f7c04167d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.442+0000 7f7c09274640 1 -- 172.21.15.123:0/1033918332 >> v1:172.21.15.123:6789/0 conn(0x7f7c04159600 legacy=0x7f7c0406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.442+0000 7f7c09274640 1 -- 172.21.15.123:0/1033918332 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c040cbd70 con 0x7f7c04162a00 2024-09-19T09:51:42.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.444+0000 7f7c09274640 1 --2- 172.21.15.123:0/1033918332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04162a00 0x7f7c0415ffc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097a0 tx=0x7f7bf402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492c2a86c0887008 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:42.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.454+0000 7f7c037fe640 1 -- 172.21.15.123:0/1033918332 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4037070 con 0x7f7c04162a00 2024-09-19T09:51:42.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.454+0000 7f7c037fe640 1 -- 172.21.15.123:0/1033918332 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf402add0 con 0x7f7c04162a00 2024-09-19T09:51:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.455+0000 7f7c09a75640 1 -- 172.21.15.123:0/1033918332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04162a00 msgr2=0x7f7c0415ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.455+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1033918332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04162a00 0x7f7c0415ffc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097a0 tx=0x7f7bf402a140 comp rx=0 tx=0).stop 2024-09-19T09:51:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.455+0000 7f7c09a75640 1 -- 172.21.15.123:0/1033918332 shutdown_connections 2024-09-19T09:51:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.455+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1033918332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04162a00 0x7f7c0415ffc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.455+0000 7f7c09a75640 1 -- 172.21.15.123:0/1033918332 >> 172.21.15.123:0/1033918332 conn(0x7f7c0406fad0 msgr2=0x7f7c0406fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.457+0000 7f7c09a75640 1 -- 172.21.15.123:0/1033918332 shutdown_connections 2024-09-19T09:51:42.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.457+0000 7f7c09a75640 1 -- 172.21.15.123:0/1033918332 wait complete. 2024-09-19T09:51:42.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.459+0000 7f7c09a75640 1 Processor -- start 2024-09-19T09:51:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.459+0000 7f7c09a75640 1 -- start start 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c09a75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 0x7f7c04161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c09a75640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c041599e0 0x7f7c04148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c09a75640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c04162a00 0x7f7c041499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c09a75640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0415f470 con 0x7f7c04159600 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c09a75640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0415faa0 con 0x7f7c04162a00 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c09a75640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7c040c4680 con 0x7f7c041599e0 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c08a73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 0x7f7c04161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c08a73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 0x7f7c04161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43616/0 (socket says 172.21.15.123:43616) 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c08a73640 1 -- 172.21.15.123:0/1756981167 learned_addr learned my addr 172.21.15.123:0/1756981167 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.461+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c041599e0 0x7f7c04148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.462+0000 7f7c08a73640 1 -- 172.21.15.123:0/1756981167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c041599e0 msgr2=0x7f7c04148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.462+0000 7f7c08a73640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c041599e0 0x7f7c04148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.462+0000 7f7c08a73640 1 -- 172.21.15.123:0/1756981167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c04162a00 msgr2=0x7f7c041499c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:51:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.462+0000 7f7c08a73640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c04162a00 0x7f7c041499c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.462+0000 7f7c08a73640 1 -- 172.21.15.123:0/1756981167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0414a750 con 0x7f7c04159600 2024-09-19T09:51:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.462+0000 7f7c08a73640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 0x7f7c04161280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bec01d780 tx=0x7f7bec01dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.466+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec029070 con 0x7f7c04159600 2024-09-19T09:51:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.466+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c041478d0 con 0x7f7c04159600 2024-09-19T09:51:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.466+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c04147b70 con 0x7f7c04159600 2024-09-19T09:51:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.466+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec0182d0 con 0x7f7c04159600 2024-09-19T09:51:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.468+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0157f0 con 0x7f7c04159600 2024-09-19T09:51:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.469+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bec02c070 con 0x7f7c04159600 2024-09-19T09:51:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.469+0000 7f7c017fa640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7be406c380 0x7f7be406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.470+0000 7f7c03fff640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7be406c380 0x7f7be406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.470+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be8005290 con 0x7f7c04159600 2024-09-19T09:51:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.470+0000 7f7c03fff640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7be406c380 0x7f7be406e840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c04156aa0 tx=0x7f7bfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.479+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7bec09b890 con 0x7f7c04159600 2024-09-19T09:51:42.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.481+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7bec0699a0 con 0x7f7c04159600 2024-09-19T09:51:42.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.995+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7be8005580 con 0x7f7c04159600 2024-09-19T09:51:42.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:42.997+0000 7f7c017fa640 1 -- 172.21.15.123:0/1756981167 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f7bec06dca0 con 0x7f7c04159600 2024-09-19T09:51:42.999 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:43.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7be406c380 msgr2=0x7f7be406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7be406c380 0x7f7be406e840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c04156aa0 tx=0x7f7bfc009040 comp rx=0 tx=0).stop 2024-09-19T09:51:43.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 msgr2=0x7f7c04161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 0x7f7c04161280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bec01d780 tx=0x7f7bec01dc40 comp rx=0 tx=0).stop 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 shutdown_connections 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c04162a00 0x7f7c041499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7be406c380 0x7f7be406e840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c041599e0 0x7f7c04148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 --2- 172.21.15.123:0/1756981167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c04159600 0x7f7c04161280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.002+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 >> 172.21.15.123:0/1756981167 conn(0x7f7c0406fad0 msgr2=0x7f7c04073980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.003+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 shutdown_connections 2024-09-19T09:51:43.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.003+0000 7f7c09a75640 1 -- 172.21.15.123:0/1756981167 wait complete. 2024-09-19T09:51:43.027 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:51:43.028 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:51:43.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:51:43.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.247+0000 7efed759e640 1 Processor -- start 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.248+0000 7efed759e640 1 -- start start 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed759e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efed00d6620 0x7efed00dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed759e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efed00e0010 0x7efed00e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed759e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed0052590 con 0x7efed0052a20 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed759e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efed00dd440 con 0x7efed00d6620 2024-09-19T09:51:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed759e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7efed00d6a00 con 0x7efed00e0010 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed6d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efed00e0010 0x7efed00e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed6d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efed00e0010 0x7efed00e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55180/0 (socket says 172.21.15.123:55180) 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.250+0000 7efed6d9d640 1 -- 172.21.15.123:0/560989797 learned_addr learned my addr 172.21.15.123:0/560989797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.251+0000 7efed6d9d640 1 -- 172.21.15.123:0/560989797 >> v2:172.21.15.123:3300/0 conn(0x7efed00d6620 msgr2=0x7efed00dfad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.251+0000 7efed6d9d640 1 --2- 172.21.15.123:0/560989797 >> v2:172.21.15.123:3300/0 conn(0x7efed00d6620 0x7efed00dfad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.251+0000 7efed6d9d640 1 -- 172.21.15.123:0/560989797 >> v1:172.21.15.123:6789/0 conn(0x7efed0052a20 legacy=0x7efed00098e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:43.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.251+0000 7efed6d9d640 1 -- 172.21.15.123:0/560989797 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed004e400 con 0x7efed00e0010 2024-09-19T09:51:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.252+0000 7efed6d9d640 1 --2- 172.21.15.123:0/560989797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00e0010 0x7efed00e6e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efed00d6d50 tx=0x7efecc02a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2f6880222dfbf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.253+0000 7efed559a640 1 -- 172.21.15.123:0/560989797 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc037070 con 0x7efed00e0010 2024-09-19T09:51:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.253+0000 7efed559a640 1 -- 172.21.15.123:0/560989797 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc032440 con 0x7efed00e0010 2024-09-19T09:51:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.254+0000 7efed759e640 1 -- 172.21.15.123:0/560989797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00e0010 msgr2=0x7efed00e6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.254+0000 7efed759e640 1 --2- 172.21.15.123:0/560989797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00e0010 0x7efed00e6e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efed00d6d50 tx=0x7efecc02a2e0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.254+0000 7efed759e640 1 -- 172.21.15.123:0/560989797 shutdown_connections 2024-09-19T09:51:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.254+0000 7efed759e640 1 --2- 172.21.15.123:0/560989797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00e0010 0x7efed00e6e60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.254+0000 7efed759e640 1 --2- 172.21.15.123:0/560989797 >> v2:172.21.15.123:3300/0 conn(0x7efed00d6620 0x7efed00dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.254+0000 7efed759e640 1 -- 172.21.15.123:0/560989797 >> 172.21.15.123:0/560989797 conn(0x7efed000e290 msgr2=0x7efed0051e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.256+0000 7efed759e640 1 -- 172.21.15.123:0/560989797 shutdown_connections 2024-09-19T09:51:43.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.256+0000 7efed759e640 1 -- 172.21.15.123:0/560989797 wait complete. 2024-09-19T09:51:43.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.258+0000 7efed759e640 1 Processor -- start 2024-09-19T09:51:43.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.258+0000 7efed759e640 1 -- start start 2024-09-19T09:51:43.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed759e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00493c0 0x7efed00497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efed0008d90 0x7efed004a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d8090 0x7efed00d2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed759e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efed00dc960 con 0x7efed00d8090 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed759e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efed004e6e0 con 0x7efed00493c0 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed759e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7efed00dcc40 con 0x7efed0008d90 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.259+0000 7efed659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00493c0 0x7efed00497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00493c0 0x7efed00497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55194/0 (socket says 172.21.15.123:55194) 2024-09-19T09:51:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed659c640 1 -- 172.21.15.123:0/1143072634 learned_addr learned my addr 172.21.15.123:0/1143072634 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed6d9d640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d8090 0x7efed00d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed5d9b640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efed0008d90 0x7efed004a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed6d9d640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efed0008d90 msgr2=0x7efed004a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed6d9d640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efed0008d90 0x7efed004a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed6d9d640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00493c0 msgr2=0x7efed00497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed6d9d640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00493c0 0x7efed00497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.260+0000 7efed6d9d640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00d6dd0 con 0x7efed00d8090 2024-09-19T09:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.261+0000 7efed6d9d640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d8090 0x7efed00d2720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efecc031000 tx=0x7efecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.261+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc037040 con 0x7efed00d8090 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.261+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed0049ce0 con 0x7efed00d8090 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.261+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed00d7330 con 0x7efed00d8090 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.264+0000 7efed759e640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 0x7efed0003190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.264+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efed004c240 con 0x7efed00d2c60 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.265+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc042070 con 0x7efed00d8090 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.265+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc03d450 con 0x7efed00d8090 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.265+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efecc03d6b0 con 0x7efed00d8090 2024-09-19T09:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.266+0000 7efed659c640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 0x7efed0003190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.266+0000 7efec6ffd640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efeb806c3e0 0x7efeb806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.266+0000 7efed659c640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efed00d3040 con 0x7efed00d2c60 2024-09-19T09:51:43.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.266+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7efecc0abcd0 con 0x7efed00d8090 2024-09-19T09:51:43.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.267+0000 7efed659c640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 0x7efed0003190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efed8074e70 tx=0x7efed8069a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.269+0000 7efed5d9b640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efeb806c3e0 0x7efeb806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.270+0000 7efed5d9b640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efeb806c3e0 0x7efeb806e8a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efec8006fd0 tx=0x7efec8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.271+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed80008d0 con 0x7efed00d2c60 2024-09-19T09:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.271+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efed8091070 con 0x7efed00d2c60 2024-09-19T09:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.271+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 msgr2=0x7efed0003190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.271+0000 7efec6ffd640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 0x7efed0003190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efed8074e70 tx=0x7efed8069a30 comp rx=0 tx=0).stop 2024-09-19T09:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.271+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 msgr2=0x7efed0003190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.271+0000 7efec6ffd640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d2c60 0x7efed0003190 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efed8074e70 tx=0x7efed8069a30 comp rx=0 tx=0).stop 2024-09-19T09:51:43.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.300+0000 7efed759e640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 0x7efed0008480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.300+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efed00d3ee0 con 0x7efed00080a0 2024-09-19T09:51:43.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.301+0000 7efed659c640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 0x7efed0008480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.302+0000 7efed659c640 1 -- 172.21.15.123:0/1143072634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efed0009450 con 0x7efed00080a0 2024-09-19T09:51:43.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.302+0000 7efed659c640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 0x7efed0008480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efed802dd50 tx=0x7efed80749f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.303+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8096880 con 0x7efed00080a0 2024-09-19T09:51:43.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.303+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7efed80a3460 con 0x7efed00080a0 2024-09-19T09:51:43.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.303+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 msgr2=0x7efed0008480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.303+0000 7efec6ffd640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 0x7efed0008480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efed802dd50 tx=0x7efed80749f0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.303+0000 7efec6ffd640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 msgr2=0x7efed0008480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:43.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.303+0000 7efec6ffd640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00080a0 0x7efed0008480 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.309 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 56, 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 206524, 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 14, 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:43.310 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.311 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.312 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.313 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:43.314 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:43.315 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.316 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.317 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.318 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.319 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.320 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.321 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.322 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.323 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.324 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.324 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.324 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:43.324 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:43.324 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.325 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:43.326 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.328 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.329 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.310+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efeb806c3e0 msgr2=0x7efeb806e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.310+0000 7efed759e640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7efeb806c3e0 0x7efeb806e8a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efec8006fd0 tx=0x7efec8008040 comp rx=0 tx=0).stop 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.310+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d8090 msgr2=0x7efed00d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.310+0000 7efed759e640 1 --2- 172.21.15.123:0/1143072634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed00d8090 0x7efed00d2720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efecc031000 tx=0x7efecc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.310+0000 7efed6d9d640 1 -- 172.21.15.123:0/1143072634 reap_dead start 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.310+0000 7efed6d9d640 1 -- 172.21.15.123:0/1143072634 reap_dead start 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.311+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 shutdown_connections 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.311+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 >> 172.21.15.123:0/1143072634 conn(0x7efed000e290 msgr2=0x7efed004ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.311+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 shutdown_connections 2024-09-19T09:51:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.311+0000 7efed759e640 1 -- 172.21.15.123:0/1143072634 wait complete. 2024-09-19T09:51:43.339 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:51:43.340 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:51:43.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:51:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.524+0000 7f3904ea8640 1 Processor -- start 2024-09-19T09:51:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.524+0000 7f3904ea8640 1 -- start start 2024-09-19T09:51:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.526+0000 7f3904ea8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 0x7f39000c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.526+0000 7f38ff7fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3900151080 0x7f3900157810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:52114/0 (socket says 172.21.15.123:52114) 2024-09-19T09:51:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.526+0000 7f38feffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 0x7f39000c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f38feffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 0x7f39000c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42990/0 (socket says 172.21.15.123:42990) 2024-09-19T09:51:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f38ff7fe640 1 -- 172.21.15.123:0/1566889543 learned_addr learned my addr 172.21.15.123:0/1566889543 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f3904ea8640 1 --2- 172.21.15.123:0/1566889543 >> v2:172.21.15.194:3300/0 conn(0x7f390006cd10 0x7f390006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39000c7440 con 0x7f3900151080 2024-09-19T09:51:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f39000c8d00 con 0x7f3900158280 2024-09-19T09:51:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f39000c8330 con 0x7f390006cd10 2024-09-19T09:51:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.527+0000 7f38fffff640 1 --2- 172.21.15.123:0/1566889543 >> v2:172.21.15.194:3300/0 conn(0x7f390006cd10 0x7f390006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.528+0000 7f38fffff640 1 -- 172.21.15.123:0/1566889543 >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 msgr2=0x7f39000c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.528+0000 7f38fffff640 1 --2- 172.21.15.123:0/1566889543 >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 0x7f39000c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.528+0000 7f38fffff640 1 -- 172.21.15.123:0/1566889543 >> v1:172.21.15.194:6789/0 conn(0x7f3900151080 legacy=0x7f3900157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.528+0000 7f38fffff640 1 -- 172.21.15.123:0/1566889543 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000c7720 con 0x7f390006cd10 2024-09-19T09:51:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.529+0000 7f38feffd640 1 --2- 172.21.15.123:0/1566889543 >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 0x7f39000c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.530+0000 7f38fffff640 1 --2- 172.21.15.123:0/1566889543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390006cd10 0x7f390006bc10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3900075e60 tx=0x7f38f802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1b5b7bdfbbb3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.536+0000 7f38fe7fc640 1 -- 172.21.15.123:0/1566889543 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8031770 con 0x7f390006cd10 2024-09-19T09:51:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.536+0000 7f38fe7fc640 1 -- 172.21.15.123:0/1566889543 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f8037070 con 0x7f390006cd10 2024-09-19T09:51:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.536+0000 7f38fe7fc640 1 -- 172.21.15.123:0/1566889543 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8031b10 con 0x7f390006cd10 2024-09-19T09:51:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.537+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390006cd10 msgr2=0x7f390006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.537+0000 7f3904ea8640 1 --2- 172.21.15.123:0/1566889543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390006cd10 0x7f390006bc10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3900075e60 tx=0x7f38f802b930 comp rx=0 tx=0).stop 2024-09-19T09:51:43.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.540+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 shutdown_connections 2024-09-19T09:51:43.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.540+0000 7f3904ea8640 1 --2- 172.21.15.123:0/1566889543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390006cd10 0x7f390006bc10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.540+0000 7f3904ea8640 1 --2- 172.21.15.123:0/1566889543 >> v2:172.21.15.123:3300/0 conn(0x7f3900158280 0x7f39000c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.540+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 >> 172.21.15.123:0/1566889543 conn(0x7f39000c9100 msgr2=0x7f39000c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.541+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 shutdown_connections 2024-09-19T09:51:43.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.542+0000 7f3904ea8640 1 -- 172.21.15.123:0/1566889543 wait complete. 2024-09-19T09:51:43.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.544+0000 7f3904ea8640 1 Processor -- start 2024-09-19T09:51:43.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.544+0000 7f3904ea8640 1 -- start start 2024-09-19T09:51:43.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.547+0000 7f3904ea8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 0x7f390014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.547+0000 7f38ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 0x7f390014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.547+0000 7f38ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 0x7f390014f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43006/0 (socket says 172.21.15.123:43006) 2024-09-19T09:51:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.547+0000 7f38ff7fe640 1 -- 172.21.15.123:0/2056264794 learned_addr learned my addr 172.21.15.123:0/2056264794 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:43.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.547+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3900151080 0x7f390014d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.547+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3900158280 0x7f3900153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.548+0000 7f38feffd640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3900151080 0x7f390014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.548+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39000c7fc0 con 0x7f390006cd10 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.548+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39000c7ce0 con 0x7f3900158280 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.548+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3900151460 con 0x7f3900151080 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.549+0000 7f38ff7fe640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3900151080 msgr2=0x7f390014d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.549+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3900151080 0x7f390014d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.549+0000 7f38ff7fe640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3900158280 msgr2=0x7f3900153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.549+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3900158280 0x7f3900153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.549+0000 7f38ff7fe640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39001f1480 con 0x7f390006cd10 2024-09-19T09:51:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.549+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 0x7f390014f610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f38f000c8f0 tx=0x7f38f000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.551+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0018070 con 0x7f390006cd10 2024-09-19T09:51:43.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.551+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f00072d0 con 0x7f390006cd10 2024-09-19T09:51:43.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.551+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f00047e0 con 0x7f390006cd10 2024-09-19T09:51:43.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.552+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39001f1720 con 0x7f390006cd10 2024-09-19T09:51:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.557+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f38f001b070 con 0x7f390006cd10 2024-09-19T09:51:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.557+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390014bd90 con 0x7f390006cd10 2024-09-19T09:51:43.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.562+0000 7f38e7fff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38ec06c300 0x7f38ec06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.563+0000 7f38feffd640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38ec06c300 0x7f38ec06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.564+0000 7f38feffd640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38ec06c300 0x7f38ec06e7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f390014ffe0 tx=0x7f38f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.564+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f38f008a710 con 0x7f390006cd10 2024-09-19T09:51:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.572+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 0x7f3900153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.572+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39001f19c0 con 0x7f39000cb8a0 2024-09-19T09:51:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.576+0000 7f38fffff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 0x7f3900153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.578+0000 7f38fffff640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39000c7000 con 0x7f39000cb8a0 2024-09-19T09:51:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.578+0000 7f38fffff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 0x7f3900153db0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39000c9e10 tx=0x7f38f8004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.580+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8004830 con 0x7f39000cb8a0 2024-09-19T09:51:43.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.580+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f38f8037040 con 0x7f39000cb8a0 2024-09-19T09:51:43.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.580+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 msgr2=0x7f3900153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.580+0000 7f38e7fff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 0x7f3900153db0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39000c9e10 tx=0x7f38f8004570 comp rx=0 tx=0).stop 2024-09-19T09:51:43.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.580+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 msgr2=0x7f3900153db0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:43.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.580+0000 7f38e7fff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39000cb8a0 0x7f3900153db0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.595+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 0x7f390014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.595+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39000c33d0 con 0x7f390014d6d0 2024-09-19T09:51:43.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.595+0000 7f38fffff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 0x7f390014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.596+0000 7f38fffff640 1 -- 172.21.15.123:0/2056264794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f39000cbf50 con 0x7f390014d6d0 2024-09-19T09:51:43.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.596+0000 7f38fffff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 0x7f390014bfd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38f8034040 tx=0x7f38f8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.596+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8031980 con 0x7f390014d6d0 2024-09-19T09:51:43.600 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:43.600 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:43.600 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:43.600 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 56, 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 17665, 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.601 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 14, 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.602 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.603 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:43.605 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:43.606 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.607 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:43.608 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.609 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:43.610 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.611 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:43.612 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.613 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.614 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.615 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:43.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.597+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f38f8031980 con 0x7f390014d6d0 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.597+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 msgr2=0x7f390014bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.597+0000 7f38e7fff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 0x7f390014bfd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38f8034040 tx=0x7f38f8032000 comp rx=0 tx=0).stop 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.597+0000 7f38e7fff640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 msgr2=0x7f390014bfd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.597+0000 7f38e7fff640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390014d6d0 0x7f390014bfd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38ec06c300 msgr2=0x7f38ec06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f38ec06c300 0x7f38ec06e7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f390014ffe0 tx=0x7f38f4008040 comp rx=0 tx=0).stop 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f38fffff640 1 -- 172.21.15.123:0/2056264794 reap_dead start 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 msgr2=0x7f390014f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 0x7f390014f610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f38f000c8f0 tx=0x7f38f000cdb0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 shutdown_connections 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 --2- 172.21.15.123:0/2056264794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390006cd10 0x7f390014f610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.600+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 >> 172.21.15.123:0/2056264794 conn(0x7f39000c9100 msgr2=0x7f390015a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.603+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 shutdown_connections 2024-09-19T09:51:43.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.603+0000 7f3904ea8640 1 -- 172.21.15.123:0/2056264794 wait complete. 2024-09-19T09:51:43.636 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:51:43.636 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:51:43.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:51:43.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.866+0000 7f1478ccf640 1 Processor -- start 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.866+0000 7f1478ccf640 1 -- start start 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f1478ccf640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f146c005a00 0x7f146c0da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f1478ccf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c0d49d0 con 0x7f146c0d45f0 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f1478ccf640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c005fd0 con 0x7f146c04ae70 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f1478ccf640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f146c032c10 con 0x7f146c005a00 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f14737fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f146c0d45f0 0x7f146c034250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33196/0 (socket says 172.21.15.123:33196) 2024-09-19T09:51:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f14737fe640 1 -- 172.21.15.123:0/214334910 learned_addr learned my addr 172.21.15.123:0/214334910 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:43.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913047692 0 0) 0x7f146c0d49d0 con 0x7f146c0d45f0 2024-09-19T09:51:43.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.868+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1464003520 con 0x7f146c0d45f0 2024-09-19T09:51:43.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2080566543 0 0) 0x7f1464003520 con 0x7f146c0d45f0 2024-09-19T09:51:43.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 >> v2:172.21.15.194:3300/0 conn(0x7f146c005a00 msgr2=0x7f146c0da540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:43.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 --2- 172.21.15.123:0/214334910 >> v2:172.21.15.194:3300/0 conn(0x7f146c005a00 0x7f146c0da540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 >> v1:172.21.15.194:6789/0 conn(0x7f146c04ae70 legacy=0x7f146c0e4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c0062b0 con 0x7f146c0d45f0 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f1474050800 con 0x7f146c0d45f0 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 >> v1:172.21.15.123:6789/0 conn(0x7f146c0d45f0 legacy=0x7f146c034250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14640037a0 0x7f1464003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640040e0 0x7f146400b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f146400b550 0x7f146400d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f146c032c10 con 0x7f14640040e0 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f146400e290 con 0x7f14640037a0 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f146400e490 con 0x7f146400b550 2024-09-19T09:51:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.869+0000 7f14737fe640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14640037a0 0x7f1464003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.871+0000 7f14737fe640 1 -- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f146400b550 msgr2=0x7f146400d9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.871+0000 7f14737fe640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f146400b550 0x7f146400d9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.871+0000 7f14737fe640 1 -- 172.21.15.123:0/214334910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640040e0 msgr2=0x7f146400b010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.871+0000 7f14737fe640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640040e0 0x7f146400b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.871+0000 7f14737fe640 1 -- 172.21.15.123:0/214334910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c0062b0 con 0x7f14640037a0 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.871+0000 7f1473fff640 1 -- 172.21.15.123:0/214334910 reap_dead start 2024-09-19T09:51:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.874+0000 7f14737fe640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14640037a0 0x7f1464003ba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f147402dd50 tx=0x7f1464004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3bf7e6053326b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.875+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740bc070 con 0x7f14640037a0 2024-09-19T09:51:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.875+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14740b7400 con 0x7f14640037a0 2024-09-19T09:51:43.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.875+0000 7f14727fc640 1 -- 172.21.15.123:0/214334910 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474068960 con 0x7f14640037a0 2024-09-19T09:51:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.876+0000 7f1478ccf640 1 -- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14640037a0 msgr2=0x7f1464003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.876+0000 7f1478ccf640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14640037a0 0x7f1464003ba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f147402dd50 tx=0x7f1464004820 comp rx=0 tx=0).stop 2024-09-19T09:51:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.877+0000 7f1478ccf640 1 -- 172.21.15.123:0/214334910 shutdown_connections 2024-09-19T09:51:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.877+0000 7f1478ccf640 1 --2- 172.21.15.123:0/214334910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14640037a0 0x7f1464003ba0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.877+0000 7f1478ccf640 1 -- 172.21.15.123:0/214334910 >> 172.21.15.123:0/214334910 conn(0x7f146c04fc50 msgr2=0x7f146c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.880+0000 7f1478ccf640 1 -- 172.21.15.123:0/214334910 shutdown_connections 2024-09-19T09:51:43.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.882+0000 7f1478ccf640 1 -- 172.21.15.123:0/214334910 wait complete. 2024-09-19T09:51:43.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.884+0000 7f1478ccf640 1 Processor -- start 2024-09-19T09:51:43.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.885+0000 7f1478ccf640 1 -- start start 2024-09-19T09:51:43.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.886+0000 7f1478ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 0x7f146c1750e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.886+0000 7f1478ccf640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f146c0d9f40 0x7f146c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.886+0000 7f1478ccf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f146c184cf0 0x7f146c045b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.886+0000 7f1478ccf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f146c006b50 con 0x7f14640037a0 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.886+0000 7f1478ccf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f146c006870 con 0x7f146c184cf0 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.886+0000 7f1478ccf640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f146c006e30 con 0x7f146c0d9f40 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 0x7f146c1750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 0x7f146c1750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43010/0 (socket says 172.21.15.123:43010) 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 -- 172.21.15.123:0/1992318402 learned_addr learned my addr 172.21.15.123:0/1992318402 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f146c0d9f40 msgr2=0x7f146c0cc470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:51:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f146c0d9f40 0x7f146c0cc470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f146c184cf0 msgr2=0x7f146c045b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f146c184cf0 0x7f146c045b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.887+0000 7f14737fe640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c0d1bb0 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.888+0000 7f14737fe640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 0x7f146c1750e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f14740766e0 tx=0x7f14740749f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.888+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740bc070 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.888+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c04f1b0 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.888+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c04f770 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.889+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1474067e10 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.889+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147409a2d0 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.894+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f14740bf070 con 0x7f14640037a0 2024-09-19T09:51:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.895+0000 7f145ffff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f145806c380 0x7f145806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.895+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1474050ea0 con 0x7f14640037a0 2024-09-19T09:51:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.895+0000 7f1478ccf640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 0x7f1454004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.895+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1454007ec0 con 0x7f1454002a70 2024-09-19T09:51:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.897+0000 7f1473fff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 0x7f1454004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.897+0000 7f1472ffd640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f145806c380 0x7f145806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.898+0000 7f1473fff640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14540080c0 con 0x7f1454002a70 2024-09-19T09:51:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.899+0000 7f1472ffd640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f145806c380 0x7f145806e840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1468006fd0 tx=0x7f1468006b40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.899+0000 7f1473fff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 0x7f1454004f30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f146c050c10 tx=0x7f1460009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.901+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460016070 con 0x7f1454002a70 2024-09-19T09:51:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.901+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f14600052d0 con 0x7f1454002a70 2024-09-19T09:51:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.901+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 msgr2=0x7f1454004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.901+0000 7f145ffff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 0x7f1454004f30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f146c050c10 tx=0x7f1460009780 comp rx=0 tx=0).stop 2024-09-19T09:51:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.901+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 msgr2=0x7f1454004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.901+0000 7f145ffff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454002a70 0x7f1454004f30 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f146c050c10 tx=0x7f1460009780 comp rx=0 tx=0).stop 2024-09-19T09:51:43.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.933+0000 7f1478ccf640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 0x7f1454007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.933+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f145400a4a0 con 0x7f1454006f00 2024-09-19T09:51:43.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.935+0000 7f1473fff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 0x7f1454007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.936+0000 7f1473fff640 1 -- 172.21.15.123:0/1992318402 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f14540078d0 con 0x7f1454006f00 2024-09-19T09:51:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.936+0000 7f1473fff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 0x7f1454007390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1454008090 tx=0x7f14600058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.936+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460016040 con 0x7f1454006f00 2024-09-19T09:51:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.937+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5198 (secure 0 0 0) 0x7f14600198c0 con 0x7f1454006f00 2024-09-19T09:51:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.937+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 msgr2=0x7f1454007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.937+0000 7f145ffff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 0x7f1454007390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1454008090 tx=0x7f14600058e0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.937+0000 7f145ffff640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 msgr2=0x7f1454007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.937+0000 7f145ffff640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1454006f00 0x7f1454007390 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1454008090 tx=0x7f14600058e0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.940 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:43.940 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:43.940 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:43.940 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:51:43.940 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 56, 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 313253, 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 14, 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.941 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.942 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:43.943 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:43.944 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:43.945 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.948 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:43.949 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.950 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.951 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.952 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:43.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:43.954 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:43.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.938+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f145806c380 msgr2=0x7f145806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.938+0000 7f1478ccf640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f145806c380 0x7f145806e840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1468006fd0 tx=0x7f1468006b40 comp rx=0 tx=0).stop 2024-09-19T09:51:43.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.938+0000 7f1473fff640 1 -- 172.21.15.123:0/1992318402 reap_dead start 2024-09-19T09:51:43.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.938+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 msgr2=0x7f146c1750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.938+0000 7f1478ccf640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 0x7f146c1750e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f14740766e0 tx=0x7f14740749f0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.939+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 shutdown_connections 2024-09-19T09:51:43.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.939+0000 7f1478ccf640 1 --2- 172.21.15.123:0/1992318402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640037a0 0x7f146c1750e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.939+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 >> 172.21.15.123:0/1992318402 conn(0x7f146c04fc50 msgr2=0x7f146c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.945+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 shutdown_connections 2024-09-19T09:51:43.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:43.945+0000 7f1478ccf640 1 -- 172.21.15.123:0/1992318402 wait complete. 2024-09-19T09:51:43.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:51:43.979 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-19T09:51:43.979 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:51:43.979 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-19T09:51:43.979 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-19T09:51:43.979 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T09:51:43.979 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:51:44.003 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T09:51:44.003 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:51:44.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:44.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.263+0000 7fb56050a640 1 Processor -- start 2024-09-19T09:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.265+0000 7fb56050a640 1 -- start start 2024-09-19T09:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.266+0000 7fb56050a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558159730 0x7fb5580c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.266+0000 7fb56050a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb55815f410 0x7fb5581631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.266+0000 7fb56050a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55815f9c0 con 0x7fb558163720 2024-09-19T09:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.266+0000 7fb56050a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fb55815fca0 con 0x7fb55815f410 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.266+0000 7fb56050a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb55815ff80 con 0x7fb558159730 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.267+0000 7fb55eaa7640 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fb558163720 legacy=0x7fb5580c8040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.267+0000 7fb55daa5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb55815f410 0x7fb5581631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.267+0000 7fb55daa5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb55815f410 0x7fb5581631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55298/0 (socket says 172.21.15.123:55298) 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.267+0000 7fb55daa5640 1 -- 172.21.15.123:0/1601872939 learned_addr learned my addr 172.21.15.123:0/1601872939 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.268+0000 7fb55e2a6640 1 --2- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558159730 0x7fb5580c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.270+0000 7fb55daa5640 1 -- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558159730 msgr2=0x7fb5580c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.270+0000 7fb55daa5640 1 --2- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558159730 0x7fb5580c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.270+0000 7fb55daa5640 1 -- 172.21.15.123:0/1601872939 >> v1:172.21.15.123:6789/0 conn(0x7fb558163720 legacy=0x7fb5580c8040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.270+0000 7fb55daa5640 1 -- 172.21.15.123:0/1601872939 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb558160260 con 0x7fb55815f410 2024-09-19T09:51:44.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.271+0000 7fb55daa5640 1 --2- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb5581631e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb548009870 tx=0x7fb54802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b75a60283f69839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:44.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.272+0000 7fb55d2a4640 1 -- 172.21.15.123:0/1601872939 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548037070 con 0x7fb55815f410 2024-09-19T09:51:44.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.272+0000 7fb55d2a4640 1 -- 172.21.15.123:0/1601872939 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb548032440 con 0x7fb55815f410 2024-09-19T09:51:44.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.272+0000 7fb55d2a4640 1 -- 172.21.15.123:0/1601872939 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548032850 con 0x7fb55815f410 2024-09-19T09:51:44.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.273+0000 7fb56050a640 1 -- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 msgr2=0x7fb5581631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:44.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.273+0000 7fb56050a640 1 --2- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb5581631e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb548009870 tx=0x7fb54802a2c0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.279+0000 7fb56050a640 1 -- 172.21.15.123:0/1601872939 shutdown_connections 2024-09-19T09:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.279+0000 7fb56050a640 1 --2- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb5581631e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.279+0000 7fb56050a640 1 --2- 172.21.15.123:0/1601872939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558159730 0x7fb5580c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.279+0000 7fb56050a640 1 -- 172.21.15.123:0/1601872939 >> 172.21.15.123:0/1601872939 conn(0x7fb55806ec90 msgr2=0x7fb55806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.279+0000 7fb56050a640 1 -- 172.21.15.123:0/1601872939 shutdown_connections 2024-09-19T09:51:44.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.279+0000 7fb56050a640 1 -- 172.21.15.123:0/1601872939 wait complete. 2024-09-19T09:51:44.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.281+0000 7fb56050a640 1 Processor -- start 2024-09-19T09:51:44.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.287+0000 7fb56050a640 1 -- start start 2024-09-19T09:51:44.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.289+0000 7fb56050a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb558159730 0x7fb5581403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:44.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.290+0000 7fb56050a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb558158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:44.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.290+0000 7fb56050a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 0x7fb558139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:44.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.290+0000 7fb56050a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5580715b0 con 0x7fb558159730 2024-09-19T09:51:44.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.290+0000 7fb56050a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb558162cc0 con 0x7fb55815f410 2024-09-19T09:51:44.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.290+0000 7fb56050a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fb558159b10 con 0x7fb558163720 2024-09-19T09:51:44.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.291+0000 7fb55e2a6640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb558159730 msgr2=0x7fb5581403b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:44.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.291+0000 7fb55e2a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb558159730 0x7fb5581403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:44.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.291+0000 7fb55eaa7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 0x7fb558139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:44.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.292+0000 7fb55daa5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb558158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:44.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.292+0000 7fb55daa5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb558158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55306/0 (socket says 172.21.15.123:55306) 2024-09-19T09:51:44.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.292+0000 7fb55eaa7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 0x7fb558139e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:60416/0 (socket says 172.21.15.123:60416) 2024-09-19T09:51:44.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.292+0000 7fb55eaa7640 1 -- 172.21.15.123:0/1979515730 learned_addr learned my addr 172.21.15.123:0/1979515730 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:44.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.295+0000 7fb55daa5640 1 -- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 msgr2=0x7fb558139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:44.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.295+0000 7fb55daa5640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 0x7fb558139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.295+0000 7fb55daa5640 1 -- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb558159730 msgr2=0x7fb5581403b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:44.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.295+0000 7fb55daa5640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb558159730 0x7fb5581403b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.295+0000 7fb55daa5640 1 -- 172.21.15.123:0/1979515730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5580cc0a0 con 0x7fb55815f410 2024-09-19T09:51:44.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.295+0000 7fb55eaa7640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 0x7fb558139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:44.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.296+0000 7fb55daa5640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb558158210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb548031000 tx=0x7fb5480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:44.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.296+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548041020 con 0x7fb55815f410 2024-09-19T09:51:44.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.296+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54803d6e0 con 0x7fb55815f410 2024-09-19T09:51:44.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.297+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548037040 con 0x7fb55815f410 2024-09-19T09:51:44.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.297+0000 7fb56050a640 1 -- 172.21.15.123:0/1979515730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5580cc380 con 0x7fb55815f410 2024-09-19T09:51:44.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.297+0000 7fb56050a640 1 -- 172.21.15.123:0/1979515730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb558141d00 con 0x7fb55815f410 2024-09-19T09:51:44.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.302+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb548044020 con 0x7fb55815f410 2024-09-19T09:51:44.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.302+0000 7fb54effd640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb53c06c260 0x7fb53c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:44.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.303+0000 7fb56050a640 1 -- 172.21.15.123:0/1979515730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5580c3990 con 0x7fb55815f410 2024-09-19T09:51:44.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.303+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb5480ab950 con 0x7fb55815f410 2024-09-19T09:51:44.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.303+0000 7fb55e2a6640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb53c06c260 0x7fb53c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:44.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.304+0000 7fb55e2a6640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb53c06c260 0x7fb53c06e720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb554006fd0 tx=0x7fb5540092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:44.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.317+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb54804b070 con 0x7fb55815f410 2024-09-19T09:51:44.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.843+0000 7fb56050a640 1 -- 172.21.15.123:0/1979515730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb558156ae0 con 0x7fb55815f410 2024-09-19T09:51:44.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.846+0000 7fb54effd640 1 -- 172.21.15.123:0/1979515730 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb548079fc0 con 0x7fb55815f410 2024-09-19T09:51:44.851 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 -- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb53c06c260 msgr2=0x7fb53c06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb53c06c260 0x7fb53c06e720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb554006fd0 tx=0x7fb5540092e0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 -- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 msgr2=0x7fb558158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb558158210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb548031000 tx=0x7fb5480046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 -- 172.21.15.123:0/1979515730 shutdown_connections 2024-09-19T09:51:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fb53c06c260 0x7fb53c06e720 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558163720 0x7fb558139e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb55815f410 0x7fb558158210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 --2- 172.21.15.123:0/1979515730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb558159730 0x7fb5581403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.850+0000 7fb54cff9640 1 -- 172.21.15.123:0/1979515730 >> 172.21.15.123:0/1979515730 conn(0x7fb55806ec90 msgr2=0x7fb5580c7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:44.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.852+0000 7fb54cff9640 1 -- 172.21.15.123:0/1979515730 shutdown_connections 2024-09-19T09:51:44.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:44.853+0000 7fb54cff9640 1 -- 172.21.15.123:0/1979515730 wait complete. 2024-09-19T09:51:47.873 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.052+0000 7f0792e0e640 1 Processor -- start 2024-09-19T09:51:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.052+0000 7f0792e0e640 1 -- start start 2024-09-19T09:51:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0792e0e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f078c0710f0 0x7f078c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0792e0e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f078c0c7a40 0x7f078c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0783fff640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7f078c0c7a40 msgr2=0x7f078c0c7f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0783fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f078c0c7a40 0x7f078c0c7f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f07913ab640 1 -- >> v1:172.21.15.123:6789/0 conn(0x7f078c0c9a80 legacy=0x7f078c0c84d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:51:48.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0792e0e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c0c8be0 con 0x7f078c0c9a80 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0790baa640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f078c0710f0 0x7f078c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0792e0e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f078c15a620 con 0x7f078c0c7a40 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0792e0e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f078c15a870 con 0x7f078c0710f0 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0790baa640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f078c0710f0 0x7f078c1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55312/0 (socket says 172.21.15.123:55312) 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.054+0000 7f0790baa640 1 -- 172.21.15.123:0/3872707450 learned_addr learned my addr 172.21.15.123:0/3872707450 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.055+0000 7f0790baa640 1 -- 172.21.15.123:0/3872707450 >> v2:172.21.15.123:3300/0 conn(0x7f078c0c7a40 msgr2=0x7f078c0c7f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.055+0000 7f0790baa640 1 --2- 172.21.15.123:0/3872707450 >> v2:172.21.15.123:3300/0 conn(0x7f078c0c7a40 0x7f078c0c7f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.055+0000 7f0790baa640 1 -- 172.21.15.123:0/3872707450 >> v1:172.21.15.123:6789/0 conn(0x7f078c0c9a80 legacy=0x7f078c0c84d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.055+0000 7f0790baa640 1 -- 172.21.15.123:0/3872707450 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c15ab50 con 0x7f078c0710f0 2024-09-19T09:51:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.059+0000 7f0790baa640 1 --2- 172.21.15.123:0/3872707450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c1545d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f078c0cd920 tx=0x7f078802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43f32fde95cbfe1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:48.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.059+0000 7f07837fe640 1 -- 172.21.15.123:0/3872707450 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788037070 con 0x7f078c0710f0 2024-09-19T09:51:48.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.059+0000 7f07837fe640 1 -- 172.21.15.123:0/3872707450 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0788032440 con 0x7f078c0710f0 2024-09-19T09:51:48.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.059+0000 7f07837fe640 1 -- 172.21.15.123:0/3872707450 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788037070 con 0x7f078c0710f0 2024-09-19T09:51:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.061+0000 7f0792e0e640 1 -- 172.21.15.123:0/3872707450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 msgr2=0x7f078c1545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.061+0000 7f0792e0e640 1 --2- 172.21.15.123:0/3872707450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c1545d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f078c0cd920 tx=0x7f078802a250 comp rx=0 tx=0).stop 2024-09-19T09:51:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.061+0000 7f0792e0e640 1 -- 172.21.15.123:0/3872707450 shutdown_connections 2024-09-19T09:51:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.061+0000 7f0792e0e640 1 --2- 172.21.15.123:0/3872707450 >> v2:172.21.15.123:3300/0 conn(0x7f078c0c7a40 0x7f078c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.061+0000 7f0792e0e640 1 --2- 172.21.15.123:0/3872707450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c1545d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.061+0000 7f0792e0e640 1 -- 172.21.15.123:0/3872707450 >> 172.21.15.123:0/3872707450 conn(0x7f078c06ec90 msgr2=0x7f078c06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.062+0000 7f0792e0e640 1 -- 172.21.15.123:0/3872707450 shutdown_connections 2024-09-19T09:51:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.062+0000 7f0792e0e640 1 -- 172.21.15.123:0/3872707450 wait complete. 2024-09-19T09:51:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.063+0000 7f0792e0e640 1 Processor -- start 2024-09-19T09:51:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.064+0000 7f0792e0e640 1 -- start start 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0792e0e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0792e0e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f078c0c7a40 0x7f078c0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0792e0e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 0x7f078c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0792e0e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f078c15b3f0 con 0x7f078c0c7a40 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0792e0e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f078c15b110 con 0x7f078c0710f0 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0792e0e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f078c1570b0 con 0x7f078c0c9a80 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0783fff640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f078c0c7a40 msgr2=0x7f078c0c4460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0783fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f078c0c7a40 0x7f078c0c4460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f07913ab640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 0x7f078c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f07913ab640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 0x7f078c0c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:60428/0 (socket says 172.21.15.123:60428) 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f07913ab640 1 -- 172.21.15.123:0/1029746235 learned_addr learned my addr 172.21.15.123:0/1029746235 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.065+0000 7f0790baa640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.066+0000 7f07913ab640 1 -- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 msgr2=0x7f078c159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.066+0000 7f07913ab640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.066+0000 7f07913ab640 1 -- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f078c0c7a40 msgr2=0x7f078c0c4460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.066+0000 7f07913ab640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f078c0c7a40 0x7f078c0c4460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.066+0000 7f07913ab640 1 -- 172.21.15.123:0/1029746235 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c0c6810 con 0x7f078c0c9a80 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.066+0000 7f07913ab640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 0x7f078c0c49a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f078400be60 tx=0x7f078400bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:48.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.067+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784016430 con 0x7f078c0c9a80 2024-09-19T09:51:48.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.067+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0784010030 con 0x7f078c0c9a80 2024-09-19T09:51:48.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.067+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784016850 con 0x7f078c0c9a80 2024-09-19T09:51:48.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.067+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c0c55c0 con 0x7f078c0c9a80 2024-09-19T09:51:48.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.068+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c0cbca0 con 0x7f078c0c9a80 2024-09-19T09:51:48.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.069+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c0699d0 con 0x7f078c0c9a80 2024-09-19T09:51:48.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.070+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f07840356d0 con 0x7f078c0c9a80 2024-09-19T09:51:48.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.071+0000 7f07817fa640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f077806c2b0 0x7f077806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.071+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f078408bab0 con 0x7f078c0c9a80 2024-09-19T09:51:48.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.072+0000 7f0790baa640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f077806c2b0 0x7f077806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.073+0000 7f0790baa640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f077806c2b0 0x7f077806e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0788034000 tx=0x7f078802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.078+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f078c0699d0 con 0x7f078c0c9a80 2024-09-19T09:51:48.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.578+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f078c1545d0 con 0x7f078c0c9a80 2024-09-19T09:51:48.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.578+0000 7f07817fa640 1 -- 172.21.15.123:0/1029746235 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f0784059bc0 con 0x7f078c0c9a80 2024-09-19T09:51:48.581 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.582+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f077806c2b0 msgr2=0x7f077806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.582+0000 7f0792e0e640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f077806c2b0 0x7f077806e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0788034000 tx=0x7f078802e000 comp rx=0 tx=0).stop 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.582+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 msgr2=0x7f078c0c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.582+0000 7f0792e0e640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 0x7f078c0c49a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f078400be60 tx=0x7f078400bf50 comp rx=0 tx=0).stop 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.584+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 shutdown_connections 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.584+0000 7f0792e0e640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f077806c2b0 0x7f077806e770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.584+0000 7f0792e0e640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f078c0c9a80 0x7f078c0c49a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.584+0000 7f0792e0e640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f078c0c7a40 0x7f078c0c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.584+0000 7f0792e0e640 1 --2- 172.21.15.123:0/1029746235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f078c0710f0 0x7f078c159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.584+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 >> 172.21.15.123:0/1029746235 conn(0x7f078c06ec90 msgr2=0x7f078c1563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.589+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 shutdown_connections 2024-09-19T09:51:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:48.589+0000 7f0792e0e640 1 -- 172.21.15.123:0/1029746235 wait complete. 2024-09-19T09:51:51.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:51.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.822+0000 7faa887b7640 1 Processor -- start 2024-09-19T09:51:51.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.826+0000 7faa887b7640 1 -- start start 2024-09-19T09:51:51.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.827+0000 7faa887b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa80150fd0 0x7faa80157950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.827+0000 7faa887b7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa800c7b70 0x7faa800c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.827+0000 7faa887b7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa80157e90 con 0x7faa801513b0 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.827+0000 7faa887b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7faa8006c880 con 0x7faa80150fd0 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.827+0000 7faa887b7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7faa801583c0 con 0x7faa800c7b70 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.827+0000 7faa86553640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7faa80150fd0 msgr2=0x7faa80157950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.828+0000 7faa86553640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa80150fd0 0x7faa80157950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.828+0000 7faa85d52640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7faa801513b0 0x7faa8006cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:52118/0 (socket says 172.21.15.123:52118) 2024-09-19T09:51:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.828+0000 7faa85d52640 1 -- 172.21.15.123:0/288370509 learned_addr learned my addr 172.21.15.123:0/288370509 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:51.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.833+0000 7faa86d54640 1 --2- 172.21.15.123:0/288370509 >> v2:172.21.15.194:3300/0 conn(0x7faa800c7b70 0x7faa800c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.837+0000 7faa86d54640 1 -- 172.21.15.123:0/288370509 >> v2:172.21.15.123:3300/0 conn(0x7faa80150fd0 msgr2=0x7faa80157950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.837+0000 7faa86d54640 1 --2- 172.21.15.123:0/288370509 >> v2:172.21.15.123:3300/0 conn(0x7faa80150fd0 0x7faa80157950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.837+0000 7faa86d54640 1 -- 172.21.15.123:0/288370509 >> v1:172.21.15.194:6789/0 conn(0x7faa801513b0 legacy=0x7faa8006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.837+0000 7faa86d54640 1 -- 172.21.15.123:0/288370509 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8006bcb0 con 0x7faa800c7b70 2024-09-19T09:51:51.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.838+0000 7faa86d54640 1 --2- 172.21.15.123:0/288370509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa800c7b70 0x7faa800c80e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa800ca250 tx=0x7faa7002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42024c93c1dae771 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.843+0000 7faa85551640 1 -- 172.21.15.123:0/288370509 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70037070 con 0x7faa800c7b70 2024-09-19T09:51:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.843+0000 7faa85551640 1 -- 172.21.15.123:0/288370509 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa70032440 con 0x7faa800c7b70 2024-09-19T09:51:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 -- 172.21.15.123:0/288370509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa800c7b70 msgr2=0x7faa800c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 --2- 172.21.15.123:0/288370509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa800c7b70 0x7faa800c80e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa800ca250 tx=0x7faa7002a1c0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 -- 172.21.15.123:0/288370509 shutdown_connections 2024-09-19T09:51:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 --2- 172.21.15.123:0/288370509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa800c7b70 0x7faa800c80e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 --2- 172.21.15.123:0/288370509 >> v2:172.21.15.123:3300/0 conn(0x7faa80150fd0 0x7faa80157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 -- 172.21.15.123:0/288370509 >> 172.21.15.123:0/288370509 conn(0x7faa800c9200 msgr2=0x7faa800c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 -- 172.21.15.123:0/288370509 shutdown_connections 2024-09-19T09:51:51.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.844+0000 7faa887b7640 1 -- 172.21.15.123:0/288370509 wait complete. 2024-09-19T09:51:51.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.846+0000 7faa887b7640 1 Processor -- start 2024-09-19T09:51:51.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.846+0000 7faa887b7640 1 -- start start 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa887b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa80150fd0 0x7faa801fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa887b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 0x7faa801f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa887b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa80151c80 0x7faa801f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa887b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faa8006c510 con 0x7faa80150fd0 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa887b7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faa8006c230 con 0x7faa801513b0 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa887b7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7faa8006d420 con 0x7faa80151c80 2024-09-19T09:51:51.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa86553640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa80150fd0 msgr2=0x7faa801fd8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:51.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa86553640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa80150fd0 0x7faa801fd8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:51.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa85d52640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 0x7faa801f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa85d52640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 0x7faa801f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55342/0 (socket says 172.21.15.123:55342) 2024-09-19T09:51:51.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa85d52640 1 -- 172.21.15.123:0/3931739327 learned_addr learned my addr 172.21.15.123:0/3931739327 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:51.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.850+0000 7faa86d54640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa80151c80 0x7faa801f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.851+0000 7faa85d52640 1 -- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa80151c80 msgr2=0x7faa801f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.851+0000 7faa85d52640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa80151c80 0x7faa801f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.851+0000 7faa85d52640 1 -- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa80150fd0 msgr2=0x7faa801fd8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:51.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.851+0000 7faa85d52640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa80150fd0 0x7faa801fd8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.851+0000 7faa85d52640 1 -- 172.21.15.123:0/3931739327 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa80071a70 con 0x7faa801513b0 2024-09-19T09:51:51.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.851+0000 7faa85d52640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 0x7faa801f3170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa7800d700 tx=0x7faa7800dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.853+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78018070 con 0x7faa801513b0 2024-09-19T09:51:51.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.853+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa80071d50 con 0x7faa801513b0 2024-09-19T09:51:51.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.853+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa80201260 con 0x7faa801513b0 2024-09-19T09:51:51.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.854+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa780082d0 con 0x7faa801513b0 2024-09-19T09:51:51.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.854+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78001b40 con 0x7faa801513b0 2024-09-19T09:51:51.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.857+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa68005290 con 0x7faa801513b0 2024-09-19T09:51:51.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.859+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa7801b070 con 0x7faa801513b0 2024-09-19T09:51:51.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.859+0000 7faa76ffd640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7faa6406c2b0 0x7faa6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.860+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7faa7808ac80 con 0x7faa801513b0 2024-09-19T09:51:51.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.860+0000 7faa86553640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7faa6406c2b0 0x7faa6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.860+0000 7faa86553640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7faa6406c2b0 0x7faa6406e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa7c003980 tx=0x7faa7c006d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:51.869+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faa80157e90 con 0x7faa801513b0 2024-09-19T09:51:52.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.430+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faa68005580 con 0x7faa801513b0 2024-09-19T09:51:52.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.433+0000 7faa76ffd640 1 -- 172.21.15.123:0/3931739327 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7faa78058d00 con 0x7faa801513b0 2024-09-19T09:51:52.438 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.440+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7faa6406c2b0 msgr2=0x7faa6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.440+0000 7faa887b7640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7faa6406c2b0 0x7faa6406e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa7c003980 tx=0x7faa7c006d30 comp rx=0 tx=0).stop 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.440+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 msgr2=0x7faa801f3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.440+0000 7faa887b7640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 0x7faa801f3170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa7800d700 tx=0x7faa7800dbc0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.440+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 shutdown_connections 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.440+0000 7faa887b7640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7faa6406c2b0 0x7faa6406e770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.441+0000 7faa887b7640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa80151c80 0x7faa801f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.441+0000 7faa887b7640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa801513b0 0x7faa801f3170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.441+0000 7faa887b7640 1 --2- 172.21.15.123:0/3931739327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa80150fd0 0x7faa801fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.441+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 >> 172.21.15.123:0/3931739327 conn(0x7faa800c9200 msgr2=0x7faa800cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.442+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 shutdown_connections 2024-09-19T09:51:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:52.442+0000 7faa887b7640 1 -- 172.21.15.123:0/3931739327 wait complete. 2024-09-19T09:51:55.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:51:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.692+0000 7fcdafc47640 1 Processor -- start 2024-09-19T09:51:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.692+0000 7fcdafc47640 1 -- start start 2024-09-19T09:51:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.693+0000 7fcdafc47640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 0x7fcda8157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.693+0000 7fcdafc47640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.693+0000 7fcdafc47640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda80c77e0 con 0x7fcda8151040 2024-09-19T09:51:55.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.693+0000 7fcdafc47640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcda815b1b0 con 0x7fcda80c7400 2024-09-19T09:51:55.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.694+0000 7fcdafc47640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fcda81581b0 con 0x7fcda8151440 2024-09-19T09:51:55.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.694+0000 7fcdad9e3640 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 msgr2=0x7fcda8157c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:55.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.694+0000 7fcdad9e3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 0x7fcda8157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.694+0000 7fcdad1e2640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fcda8151040 0x7fcda80c9090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:57428/0 (socket says 172.21.15.123:57428) 2024-09-19T09:51:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.696+0000 7fcdad1e2640 1 -- 172.21.15.123:0/482970642 learned_addr learned my addr 172.21.15.123:0/482970642 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:51:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.696+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.698+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:51:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.698+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.698+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.698+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.895+0000 7fcdad9e3640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 msgr2=0x7fcda8157c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.895+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 0x7fcda8157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:51:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.901+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.901+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:51:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.901+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.901+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:55.902+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:51:56.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.296+0000 7fcdad9e3640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 msgr2=0x7fcda8157c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:56.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.296+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 0x7fcda8157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:51:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.303+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.303+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:51:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.303+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.303+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:56.303+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:51:57.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.097+0000 7fcdad9e3640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 msgr2=0x7fcda8157c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:57.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.097+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 0x7fcda8157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:51:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.104+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.104+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:51:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.104+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:51:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.104+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:51:57.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:57.104+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:51:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.110+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025959585 0 0) 0x7fcda80c77e0 con 0x7fcda8151040 2024-09-19T09:51:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.110+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd94003520 con 0x7fcda8151040 2024-09-19T09:51:58.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 402417221 0 0) 0x7fcd94003520 con 0x7fcda8151040 2024-09-19T09:51:58.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 msgr2=0x7fcda8070eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:58.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.194:3300/0 conn(0x7fcda8151440 0x7fcda8070eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 msgr2=0x7fcda8157c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:58.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 --2- 172.21.15.123:0/482970642 >> v2:172.21.15.123:3300/0 conn(0x7fcda80c7400 0x7fcda8157c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda815a880 con 0x7fcda8151040 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fcda00019d0 con 0x7fcda8151040 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 >> v1:172.21.15.194:6789/0 conn(0x7fcda8151040 legacy=0x7fcda80c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd940039b0 0x7fcd94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.114+0000 7fcdac9e1640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd94004800 0x7fcd94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad1e2640 1 -- 172.21.15.123:0/482970642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd94004800 msgr2=0x7fcd94004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad1e2640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd94004800 0x7fcd94004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd940039b0 0x7fcd94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdac9e1640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd940051c0 0x7fcd9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcda815b1b0 con 0x7fcd94004800 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcda81581b0 con 0x7fcd940039b0 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9400c090 con 0x7fcd940051c0 2024-09-19T09:51:58.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd940051c0 0x7fcd9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad9e3640 1 -- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd940051c0 msgr2=0x7fcd9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd940051c0 0x7fcd9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad9e3640 1 -- 172.21.15.123:0/482970642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd94004800 msgr2=0x7fcd94004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.115+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd94004800 0x7fcd94004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.116+0000 7fcdae1e4640 1 -- 172.21.15.123:0/482970642 reap_dead start 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.116+0000 7fcdad9e3640 1 -- 172.21.15.123:0/482970642 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd94003520 con 0x7fcd940039b0 2024-09-19T09:51:58.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.117+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd940039b0 0x7fcd94003dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcda80637b0 tx=0x7fcd94005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ae9722b1d0ab1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.117+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4009a30 con 0x7fcd940039b0 2024-09-19T09:51:58.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.117+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda40335f0 con 0x7fcd940039b0 2024-09-19T09:51:58.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdac9e1640 1 -- 172.21.15.123:0/482970642 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4033a20 con 0x7fcd940039b0 2024-09-19T09:51:58.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 -- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd940039b0 msgr2=0x7fcd94003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd940039b0 0x7fcd94003dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcda80637b0 tx=0x7fcd94005830 comp rx=0 tx=0).stop 2024-09-19T09:51:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 -- 172.21.15.123:0/482970642 shutdown_connections 2024-09-19T09:51:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 --2- 172.21.15.123:0/482970642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd940039b0 0x7fcd94003dd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 -- 172.21.15.123:0/482970642 >> 172.21.15.123:0/482970642 conn(0x7fcda806eaa0 msgr2=0x7fcda806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 -- 172.21.15.123:0/482970642 shutdown_connections 2024-09-19T09:51:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.118+0000 7fcdafc47640 1 -- 172.21.15.123:0/482970642 wait complete. 2024-09-19T09:51:58.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.120+0000 7fcdafc47640 1 Processor -- start 2024-09-19T09:51:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.120+0000 7fcdafc47640 1 -- start start 2024-09-19T09:51:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdafc47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd940039b0 0x7fcda81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdafc47640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 0x7fcda80c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdafc47640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80c22b0 0x7fcda8146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdafc47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcda815b640 con 0x7fcd940039b0 2024-09-19T09:51:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdafc47640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcda815ae40 con 0x7fcda80c22b0 2024-09-19T09:51:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdafc47640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fcda80c7d30 con 0x7fcda80c1e90 2024-09-19T09:51:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdad9e3640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd940039b0 msgr2=0x7fcda81526c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.121+0000 7fcdad9e3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd940039b0 0x7fcda81526c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 0x7fcda80c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 0x7fcda80c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49802/0 (socket says 172.21.15.123:49802) 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 -- 172.21.15.123:0/3728639061 learned_addr learned my addr 172.21.15.123:0/3728639061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdae1e4640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80c22b0 0x7fcda8146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 -- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80c22b0 msgr2=0x7fcda8146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80c22b0 0x7fcda8146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 -- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd940039b0 msgr2=0x7fcda81526c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd940039b0 0x7fcda81526c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.123+0000 7fcdad1e2640 1 -- 172.21.15.123:0/3728639061 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda80c3410 con 0x7fcda80c1e90 2024-09-19T09:51:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.124+0000 7fcdad1e2640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 0x7fcda80c2970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcda000caf0 tx=0x7fcda0001af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.125+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0018070 con 0x7fcda80c1e90 2024-09-19T09:51:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.125+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda000a760 con 0x7fcda80c1e90 2024-09-19T09:51:58.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.125+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda80c04a0 con 0x7fcda80c1e90 2024-09-19T09:51:58.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.125+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda80c0a60 con 0x7fcda80c1e90 2024-09-19T09:51:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.127+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda000ab50 con 0x7fcda80c1e90 2024-09-19T09:51:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.127+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd90005290 con 0x7fcda80c1e90 2024-09-19T09:51:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.128+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcda001b070 con 0x7fcda80c1e90 2024-09-19T09:51:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.129+0000 7fcd9e7fc640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcd8c06c2b0 0x7fcd8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.129+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fcda008ace0 con 0x7fcda80c1e90 2024-09-19T09:51:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.129+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcd8c06c2b0 0x7fcd8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.130+0000 7fcdad9e3640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcd8c06c2b0 0x7fcd8c06e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcda4033000 tx=0x7fcda4005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.136+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcda0059540 con 0x7fcda80c1e90 2024-09-19T09:51:58.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.621+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcd90005850 con 0x7fcda80c1e90 2024-09-19T09:51:58.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.622+0000 7fcd9e7fc640 1 -- 172.21.15.123:0/3728639061 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fcda0058e40 con 0x7fcda80c1e90 2024-09-19T09:51:58.624 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":58,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:51:58.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.625+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcd8c06c2b0 msgr2=0x7fcd8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.625+0000 7fcdafc47640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcd8c06c2b0 0x7fcd8c06e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcda4033000 tx=0x7fcda4005000 comp rx=0 tx=0).stop 2024-09-19T09:51:58.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.625+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 msgr2=0x7fcda80c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.625+0000 7fcdafc47640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 0x7fcda80c2970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcda000caf0 tx=0x7fcda0001af0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 shutdown_connections 2024-09-19T09:51:58.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda80c22b0 0x7fcda8146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fcd8c06c2b0 0x7fcd8c06e770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcda80c1e90 0x7fcda80c2970 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 --2- 172.21.15.123:0/3728639061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd940039b0 0x7fcda81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 >> 172.21.15.123:0/3728639061 conn(0x7fcda806eaa0 msgr2=0x7fcda8150440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:58.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 shutdown_connections 2024-09-19T09:51:58.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.626+0000 7fcdafc47640 1 -- 172.21.15.123:0/3728639061 wait complete. 2024-09-19T09:51:58.646 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:51:58.646 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-19T09:51:58.647 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:51:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.843+0000 7f66e4fbc640 1 Processor -- start 2024-09-19T09:51:58.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.844+0000 7f66e4fbc640 1 -- start start 2024-09-19T09:51:58.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.846+0000 7f66e4fbc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e00c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.846+0000 7f66e4fbc640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00c7440 con 0x7f66e0151080 2024-09-19T09:51:58.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.846+0000 7f66e4fbc640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00c7720 con 0x7f66e0158280 2024-09-19T09:51:58.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.846+0000 7f66e4fbc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f66e00c8d00 con 0x7f66e006cd10 2024-09-19T09:51:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.849+0000 7f66dffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e00c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.849+0000 7f66dffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e00c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49812/0 (socket says 172.21.15.123:49812) 2024-09-19T09:51:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.849+0000 7f66dffff640 1 -- 172.21.15.123:0/137560207 learned_addr learned my addr 172.21.15.123:0/137560207 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:58.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.850+0000 7f66dffff640 1 -- 172.21.15.123:0/137560207 >> v1:172.21.15.194:6789/0 conn(0x7f66e0158280 legacy=0x7f66e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.850+0000 7f66dffff640 1 -- 172.21.15.123:0/137560207 >> v1:172.21.15.123:6789/0 conn(0x7f66e0151080 legacy=0x7f66e0157810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:51:58.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.850+0000 7f66dffff640 1 -- 172.21.15.123:0/137560207 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e00c7a00 con 0x7f66e006cd10 2024-09-19T09:51:58.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.851+0000 7f66dffff640 1 --2- 172.21.15.123:0/137560207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e00c87c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66d800c3a0 tx=0x7f66d802bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73079ae424b47a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.852+0000 7f66de7fc640 1 -- 172.21.15.123:0/137560207 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8033070 con 0x7f66e006cd10 2024-09-19T09:51:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.852+0000 7f66de7fc640 1 -- 172.21.15.123:0/137560207 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d802d8a0 con 0x7f66e006cd10 2024-09-19T09:51:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.853+0000 7f66e4fbc640 1 -- 172.21.15.123:0/137560207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 msgr2=0x7f66e00c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.853+0000 7f66e4fbc640 1 --2- 172.21.15.123:0/137560207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e00c87c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66d800c3a0 tx=0x7f66d802bb80 comp rx=0 tx=0).stop 2024-09-19T09:51:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.853+0000 7f66e4fbc640 1 -- 172.21.15.123:0/137560207 shutdown_connections 2024-09-19T09:51:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.853+0000 7f66e4fbc640 1 --2- 172.21.15.123:0/137560207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e00c87c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.853+0000 7f66e4fbc640 1 -- 172.21.15.123:0/137560207 >> 172.21.15.123:0/137560207 conn(0x7f66e00c9100 msgr2=0x7f66e00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.858+0000 7f66e4fbc640 1 -- 172.21.15.123:0/137560207 shutdown_connections 2024-09-19T09:51:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.860+0000 7f66e4fbc640 1 -- 172.21.15.123:0/137560207 wait complete. 2024-09-19T09:51:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.863+0000 7f66e4fbc640 1 Processor -- start 2024-09-19T09:51:58.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.867+0000 7f66e4fbc640 1 -- start start 2024-09-19T09:51:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.868+0000 7f66e4fbc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e0157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66e4fbc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e0151080 0x7f66e0152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66e4fbc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e0158280 0x7f66e0152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66e4fbc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66e00c7fc0 con 0x7f66e0158280 2024-09-19T09:51:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66e4fbc640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f66e00c8330 con 0x7f66e0151080 2024-09-19T09:51:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66e4fbc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f66e0151460 con 0x7f66e006cd10 2024-09-19T09:51:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66dffff640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e0158280 msgr2=0x7f66e0152ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66dffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e0158280 0x7f66e0152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66df7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e0157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.869+0000 7f66deffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e0151080 0x7f66e0152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.870+0000 7f66df7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e0157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49824/0 (socket says 172.21.15.123:49824) 2024-09-19T09:51:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.870+0000 7f66df7fe640 1 -- 172.21.15.123:0/43464694 learned_addr learned my addr 172.21.15.123:0/43464694 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.871+0000 7f66deffd640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 msgr2=0x7f66e0157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.871+0000 7f66deffd640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e006cd10 0x7f66e0157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.871+0000 7f66deffd640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e0158280 msgr2=0x7f66e0152ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.871+0000 7f66deffd640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e0158280 0x7f66e0152ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.871+0000 7f66deffd640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e01562f0 con 0x7f66e0151080 2024-09-19T09:51:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.876+0000 7f66deffd640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e0151080 0x7f66e0152990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f66d000c390 tx=0x7f66d000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.876+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0005220 con 0x7f66e0151080 2024-09-19T09:51:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.876+0000 7f66e4fbc640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e01565d0 con 0x7f66e0151080 2024-09-19T09:51:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.876+0000 7f66e4fbc640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e0156b90 con 0x7f66e0151080 2024-09-19T09:51:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.876+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d00053c0 con 0x7f66e0151080 2024-09-19T09:51:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.878+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0007230 con 0x7f66e0151080 2024-09-19T09:51:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.879+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f66d0019020 con 0x7f66e0151080 2024-09-19T09:51:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.880+0000 7f66c7fff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f66cc06c290 0x7f66cc06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.880+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f66d008a210 con 0x7f66e0151080 2024-09-19T09:51:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.881+0000 7f66df7fe640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f66cc06c290 0x7f66cc06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.883+0000 7f66df7fe640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f66cc06c290 0x7f66cc06e750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66d4006fd0 tx=0x7f66d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.887+0000 7f66e4fbc640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 0x7f66c0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.887+0000 7f66e4fbc640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0007ec0 con 0x7f66c0002a70 2024-09-19T09:51:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.888+0000 7f66dffff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 0x7f66c0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.888+0000 7f66dffff640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66c00080c0 con 0x7f66c0002a70 2024-09-19T09:51:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.891+0000 7f66dffff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 0x7f66c0004f30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66e00c9e10 tx=0x7f66d8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.896+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8033070 con 0x7f66c0002a70 2024-09-19T09:51:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.896+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f66d802da90 con 0x7f66c0002a70 2024-09-19T09:51:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.896+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 msgr2=0x7f66c0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.896+0000 7f66c7fff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 0x7f66c0004f30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66e00c9e10 tx=0x7f66d8004a40 comp rx=0 tx=0).stop 2024-09-19T09:51:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.896+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 msgr2=0x7f66c0004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.896+0000 7f66c7fff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0002a70 0x7f66c0004f30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.913+0000 7f66e4fbc640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 0x7f66c00073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.913+0000 7f66e4fbc640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f66c000a4a0 con 0x7f66c0006f30 2024-09-19T09:51:58.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.915+0000 7f66dffff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 0x7f66c00073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.918+0000 7f66dffff640 1 -- 172.21.15.123:0/43464694 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f66c0007900 con 0x7f66c0006f30 2024-09-19T09:51:58.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.921+0000 7f66dffff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 0x7f66c00073c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66d8007210 tx=0x7f66d8007760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.925+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8004430 con 0x7f66c0006f30 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.925+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f66d80045d0 con 0x7f66c0006f30 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:51:58.927 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 58, 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 32991, 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:58.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:58.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:58.930 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:58.931 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:58.932 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:58.934 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:58.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:58.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.939 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.940 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:58.941 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.925+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 msgr2=0x7f66c00073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.925+0000 7f66c7fff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 0x7f66c00073c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66d8007210 tx=0x7f66d8007760 comp rx=0 tx=0).stop 2024-09-19T09:51:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.925+0000 7f66c7fff640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 msgr2=0x7f66c00073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.925+0000 7f66c7fff640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c0006f30 0x7f66c00073c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.932+0000 7f66c5ffb640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f66cc06c290 msgr2=0x7f66cc06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.932+0000 7f66c5ffb640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f66cc06c290 0x7f66cc06e750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66d4006fd0 tx=0x7f66d4008040 comp rx=0 tx=0).stop 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.932+0000 7f66dffff640 1 -- 172.21.15.123:0/43464694 reap_dead start 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.932+0000 7f66c5ffb640 1 -- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e0151080 msgr2=0x7f66e0152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.932+0000 7f66c5ffb640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e0151080 0x7f66e0152990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f66d000c390 tx=0x7f66d000c850 comp rx=0 tx=0).stop 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.933+0000 7f66c5ffb640 1 -- 172.21.15.123:0/43464694 shutdown_connections 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.933+0000 7f66c5ffb640 1 --2- 172.21.15.123:0/43464694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e0151080 0x7f66e0152990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.933+0000 7f66c5ffb640 1 -- 172.21.15.123:0/43464694 >> 172.21.15.123:0/43464694 conn(0x7f66e00c9100 msgr2=0x7f66e014eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.935+0000 7f66c5ffb640 1 -- 172.21.15.123:0/43464694 shutdown_connections 2024-09-19T09:51:58.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:58.935+0000 7f66c5ffb640 1 -- 172.21.15.123:0/43464694 wait complete. 2024-09-19T09:51:58.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:51:58.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-19T09:51:58.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:51:59.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.210+0000 7fd8ee6ca640 1 Processor -- start 2024-09-19T09:51:59.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.212+0000 7fd8ee6ca640 1 -- start start 2024-09-19T09:51:59.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.214+0000 7fd8ee6ca640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8e80c9ee0 0x7fd8e80ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.214+0000 7fd8ee6ca640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e8162c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.214+0000 7fd8ee6ca640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8e81631d0 con 0x7fd8e81594d0 2024-09-19T09:51:59.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.214+0000 7fd8ee6ca640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e815f320 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.214+0000 7fd8ee6ca640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e815f5c0 con 0x7fd8e8162800 2024-09-19T09:51:59.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.214+0000 7fd8edec9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e8162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.216+0000 7fd8edec9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e8162c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:49832/0 (socket says 172.21.15.123:49832) 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.216+0000 7fd8edec9640 1 -- 172.21.15.123:0/3989184964 learned_addr learned my addr 172.21.15.123:0/3989184964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.217+0000 7fd8edec9640 1 -- 172.21.15.123:0/3989184964 >> v2:172.21.15.194:3300/0 conn(0x7fd8e80c9ee0 msgr2=0x7fd8e80ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.217+0000 7fd8edec9640 1 --2- 172.21.15.123:0/3989184964 >> v2:172.21.15.194:3300/0 conn(0x7fd8e80c9ee0 0x7fd8e80ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.217+0000 7fd8edec9640 1 -- 172.21.15.123:0/3989184964 >> v1:172.21.15.194:6789/0 conn(0x7fd8e81594d0 legacy=0x7fd8e806dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.217+0000 7fd8edec9640 1 -- 172.21.15.123:0/3989184964 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e815f8a0 con 0x7fd8e8162800 2024-09-19T09:51:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.218+0000 7fd8edec9640 1 --2- 172.21.15.123:0/3989184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e8162c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009870 tx=0x7fd8d802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849eaf9f89bfb62f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.223+0000 7fd8dffff640 1 -- 172.21.15.123:0/3989184964 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8037070 con 0x7fd8e8162800 2024-09-19T09:51:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.223+0000 7fd8dffff640 1 -- 172.21.15.123:0/3989184964 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8032440 con 0x7fd8e8162800 2024-09-19T09:51:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.223+0000 7fd8dffff640 1 -- 172.21.15.123:0/3989184964 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8032810 con 0x7fd8e8162800 2024-09-19T09:51:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.224+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/3989184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 msgr2=0x7fd8e8162c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.224+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/3989184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e8162c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009870 tx=0x7fd8d802a2a0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.225+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/3989184964 shutdown_connections 2024-09-19T09:51:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.225+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/3989184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e8162c90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.225+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/3989184964 >> v2:172.21.15.194:3300/0 conn(0x7fd8e80c9ee0 0x7fd8e80ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.225+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/3989184964 >> 172.21.15.123:0/3989184964 conn(0x7fd8e806f680 msgr2=0x7fd8e806fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.228+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/3989184964 shutdown_connections 2024-09-19T09:51:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.228+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/3989184964 wait complete. 2024-09-19T09:51:59.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.230+0000 7fd8ee6ca640 1 Processor -- start 2024-09-19T09:51:59.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.230+0000 7fd8ee6ca640 1 -- start start 2024-09-19T09:51:59.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.231+0000 7fd8ee6ca640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 0x7fd8e8153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.231+0000 7fd8ee6ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e81594d0 0x7fd8e815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ed6c8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 0x7fd8e8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:59.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ed6c8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 0x7fd8e8153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:60650/0 (socket says 172.21.15.123:60650) 2024-09-19T09:51:59.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ecec7640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e81594d0 msgr2=0x7fd8e815ea90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ecec7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e81594d0 0x7fd8e815ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ed6c8640 1 -- 172.21.15.123:0/4190896290 learned_addr learned my addr 172.21.15.123:0/4190896290 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e80c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e806e6a0 con 0x7fd8e81594d0 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e815fe60 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.232+0000 7fd8edec9640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e80c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.233+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e806eb20 con 0x7fd8e8162800 2024-09-19T09:51:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.235+0000 7fd8ed6c8640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 msgr2=0x7fd8e80c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.235+0000 7fd8ed6c8640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e8162800 0x7fd8e80c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.235+0000 7fd8ed6c8640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e81594d0 msgr2=0x7fd8e815ea90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:51:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.235+0000 7fd8ed6c8640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e81594d0 0x7fd8e815ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.235+0000 7fd8ed6c8640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e8155730 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.240+0000 7fd8ed6c8640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 0x7fd8e8153550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000ba80 tx=0x7fd8e000bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:59.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.240+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0019070 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.240+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e000cc30 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.240+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0014440 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.242+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e81f5650 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.242+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e81f5c10 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.245+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 0x7fd8e81f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.245+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e81f6410 con 0x7fd8e80c6800 2024-09-19T09:51:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.246+0000 7fd8ecec7640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 0x7fd8e81f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.249+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd8e0007370 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.249+0000 7fd8ddffb640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd8cc06c2e0 0x7fd8cc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.250+0000 7fd8edec9640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd8cc06c2e0 0x7fd8cc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.250+0000 7fd8edec9640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd8cc06c2e0 0x7fd8cc06e7a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.251+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fd8e008b090 con 0x7fd8e80c9ee0 2024-09-19T09:51:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.252+0000 7fd8ecec7640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8e81598b0 con 0x7fd8e80c6800 2024-09-19T09:51:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.252+0000 7fd8ecec7640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 0x7fd8e81f89b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8e81f3070 tx=0x7fd8e400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.253+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4017070 con 0x7fd8e80c6800 2024-09-19T09:51:59.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.260+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd8e40074e0 con 0x7fd8e80c6800 2024-09-19T09:51:59.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.260+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 msgr2=0x7fd8e81f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.260+0000 7fd8ddffb640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 0x7fd8e81f89b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8e81f3070 tx=0x7fd8e400c7a0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.260+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 msgr2=0x7fd8e81f89b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.260+0000 7fd8ddffb640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80c6800 0x7fd8e81f89b0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8e81f3070 tx=0x7fd8e400c7a0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.284+0000 7fd8cb7fe640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 0x7fd8e80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:59.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.284+0000 7fd8cb7fe640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e80c4180 con 0x7fd8e80cae20 2024-09-19T09:51:59.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.295+0000 7fd8ecec7640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 0x7fd8e80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.296+0000 7fd8ecec7640 1 -- 172.21.15.123:0/4190896290 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd8e8156a10 con 0x7fd8e80cae20 2024-09-19T09:51:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.297+0000 7fd8ecec7640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 0x7fd8e80cb200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd8e81580e0 tx=0x7fd8e4000f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.297+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4017030 con 0x7fd8e80cae20 2024-09-19T09:51:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.297+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5186 (secure 0 0 0) 0x7fd8e4021370 con 0x7fd8e80cae20 2024-09-19T09:51:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.298+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 msgr2=0x7fd8e80cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.298+0000 7fd8ddffb640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 0x7fd8e80cb200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd8e81580e0 tx=0x7fd8e4000f80 comp rx=0 tx=0).stop 2024-09-19T09:51:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.298+0000 7fd8ddffb640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 msgr2=0x7fd8e80cb200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:51:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.298+0000 7fd8ddffb640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8e80cae20 0x7fd8e80cb200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 58, 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 328615, 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:51:59.301 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:59.302 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:59.303 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:51:59.304 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:51:59.305 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:51:59.306 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.307 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:59.308 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:59.309 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.310 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.311 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:51:59.312 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:51:59.313 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:51:59.314 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd8cc06c2e0 msgr2=0x7fd8cc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fd8cc06c2e0 0x7fd8cc06e7a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d802e000 comp rx=0 tx=0).stop 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8edec9640 1 -- 172.21.15.123:0/4190896290 reap_dead start 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 msgr2=0x7fd8e8153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 0x7fd8e8153550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000ba80 tx=0x7fd8e000bf40 comp rx=0 tx=0).stop 2024-09-19T09:51:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 shutdown_connections 2024-09-19T09:51:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 --2- 172.21.15.123:0/4190896290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8e80c9ee0 0x7fd8e8153550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 >> 172.21.15.123:0/4190896290 conn(0x7fd8e806f680 msgr2=0x7fd8e80c8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 shutdown_connections 2024-09-19T09:51:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:51:59.300+0000 7fd8ee6ca640 1 -- 172.21.15.123:0/4190896290 wait complete. 2024-09-19T09:51:59.332 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:51:59.332 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:52:03.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:52:03.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:52:19.333 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-19T09:52:19.333 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-19T09:52:19.333 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T09:52:19.334 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T09:52:19.337 INFO:tasks.ceph.mon.a:Started 2024-09-19T09:52:19.337 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:52:19.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:19.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.516+0000 7f939edfd640 1 Processor -- start 2024-09-19T09:52:19.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.516+0000 7f939edfd640 1 -- start start 2024-09-19T09:52:19.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.517+0000 7f939edfd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939806c750 0x7f93980c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:19.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.517+0000 7f939edfd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f93980c7400 0x7f93980727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:19.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.517+0000 7f939edfd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93981683c0 con 0x7f93980c3c90 2024-09-19T09:52:19.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.517+0000 7f939edfd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f93980c7870 con 0x7f93980c7400 2024-09-19T09:52:19.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.517+0000 7f939edfd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f93981686a0 con 0x7f939806c750 2024-09-19T09:52:19.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.517+0000 7f9397fff640 1 -- >> v1:172.21.15.123:6789/0 conn(0x7f93980c3c90 legacy=0x7f939806bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2024-09-19T09:52:19.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.518+0000 7f939d39a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f93980c7400 0x7f93980727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:19.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.521+0000 7f939d39a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f93980c7400 0x7f93980727d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:46496/0 (socket says 172.21.15.123:46496) 2024-09-19T09:52:19.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.521+0000 7f939d39a640 1 -- 172.21.15.123:0/3762032789 learned_addr learned my addr 172.21.15.123:0/3762032789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:19.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.521+0000 7f939d39a640 1 -- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939806c750 msgr2=0x7f93980c7c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:52:19.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.521+0000 7f939d39a640 1 --2- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939806c750 0x7f93980c7c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:19.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.521+0000 7f939d39a640 1 -- 172.21.15.123:0/3762032789 >> v1:172.21.15.123:6789/0 conn(0x7f93980c3c90 legacy=0x7f939806bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:19.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.521+0000 7f939d39a640 1 -- 172.21.15.123:0/3762032789 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9398168980 con 0x7f93980c7400 2024-09-19T09:52:19.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.522+0000 7f939d39a640 1 --2- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980727d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f939002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f0dd99a3075d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:19.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.524+0000 7f93977fe640 1 -- 172.21.15.123:0/3762032789 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390037070 con 0x7f93980c7400 2024-09-19T09:52:19.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.524+0000 7f93977fe640 1 -- 172.21.15.123:0/3762032789 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9390032440 con 0x7f93980c7400 2024-09-19T09:52:19.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.525+0000 7f939edfd640 1 -- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 msgr2=0x7f93980727d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:19.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.525+0000 7f939edfd640 1 --2- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980727d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f939002a230 comp rx=0 tx=0).stop 2024-09-19T09:52:19.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.528+0000 7f939edfd640 1 -- 172.21.15.123:0/3762032789 shutdown_connections 2024-09-19T09:52:19.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.528+0000 7f939edfd640 1 --2- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980727d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:19.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.528+0000 7f939edfd640 1 --2- 172.21.15.123:0/3762032789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939806c750 0x7f93980c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:19.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.528+0000 7f939edfd640 1 -- 172.21.15.123:0/3762032789 >> 172.21.15.123:0/3762032789 conn(0x7f939806eaa0 msgr2=0x7f939806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:19.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.533+0000 7f939edfd640 1 -- 172.21.15.123:0/3762032789 shutdown_connections 2024-09-19T09:52:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.535+0000 7f939edfd640 1 -- 172.21.15.123:0/3762032789 wait complete. 2024-09-19T09:52:19.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.536+0000 7f939edfd640 1 Processor -- start 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.537+0000 7f939edfd640 1 -- start start 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.538+0000 7f939edfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939806c750 0x7f939820e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.538+0000 7f939cb99640 1 -- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939806c750 msgr2=0x7f939820e890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:3300/0 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.538+0000 7f939cb99640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939806c750 0x7f939820e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.539+0000 7f939edfd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980c3c90 0x7f9398212850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.539+0000 7f939edfd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.539+0000 7f939edfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f939806c4a0 con 0x7f939806c750 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.539+0000 7f939edfd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f939806c320 con 0x7f93980c7400 2024-09-19T09:52:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.539+0000 7f939edfd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f93980c8a00 con 0x7f93980c3c90 2024-09-19T09:52:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.540+0000 7f939d39a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.540+0000 7f939d39a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980c0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:46504/0 (socket says 172.21.15.123:46504) 2024-09-19T09:52:19.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.540+0000 7f939d39a640 1 -- 172.21.15.123:0/3475064845 learned_addr learned my addr 172.21.15.123:0/3475064845 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:19.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.543+0000 7f939d39a640 1 -- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980c3c90 msgr2=0x7f9398212850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:52:19.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.543+0000 7f939d39a640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980c3c90 0x7f9398212850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:19.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.543+0000 7f939d39a640 1 -- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939806c750 msgr2=0x7f939820e890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:19.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.543+0000 7f939d39a640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939806c750 0x7f939820e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:19.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.543+0000 7f939d39a640 1 -- 172.21.15.123:0/3475064845 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980c06c0 con 0x7f93980c7400 2024-09-19T09:52:19.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.543+0000 7f939d39a640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980c0180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f93900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:19.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.546+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390041020 con 0x7f93980c7400 2024-09-19T09:52:19.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.546+0000 7f939edfd640 1 -- 172.21.15.123:0/3475064845 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9398167650 con 0x7f93980c7400 2024-09-19T09:52:19.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.546+0000 7f939edfd640 1 -- 172.21.15.123:0/3475064845 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9398167c10 con 0x7f93980c7400 2024-09-19T09:52:19.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.547+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9390030bf0 con 0x7f93980c7400 2024-09-19T09:52:19.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.547+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390037040 con 0x7f93980c7400 2024-09-19T09:52:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.551+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9390044020 con 0x7f93980c7400 2024-09-19T09:52:19.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.552+0000 7f93957fa640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938406c2b0 0x7f938406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:19.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.552+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f93900abf10 con 0x7f93980c7400 2024-09-19T09:52:19.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.553+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9378005290 con 0x7f93980c7400 2024-09-19T09:52:19.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.560+0000 7f939cb99640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938406c2b0 0x7f938406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:19.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.561+0000 7f939cb99640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938406c2b0 0x7f938406e770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9388003ba0 tx=0x7f93880092b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:19.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:19.564+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f939004b030 con 0x7f93980c7400 2024-09-19T09:52:20.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.061+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9378005580 con 0x7f93980c7400 2024-09-19T09:52:20.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.061+0000 7f93957fa640 1 -- 172.21.15.123:0/3475064845 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f939007a550 con 0x7f93980c7400 2024-09-19T09:52:20.065 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":58,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:20.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938406c2b0 msgr2=0x7f938406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938406c2b0 0x7f938406e770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9388003ba0 tx=0x7f93880092b0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 msgr2=0x7f93980c0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980c0180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f93900046c0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 shutdown_connections 2024-09-19T09:52:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93980c7400 0x7f93980c0180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938406c2b0 0x7f938406e770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.067+0000 7f937effd640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93980c3c90 0x7f9398212850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.068+0000 7f937effd640 1 --2- 172.21.15.123:0/3475064845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939806c750 0x7f939820e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.068+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 >> 172.21.15.123:0/3475064845 conn(0x7f939806eaa0 msgr2=0x7f93980ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.068+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 shutdown_connections 2024-09-19T09:52:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:20.069+0000 7f937effd640 1 -- 172.21.15.123:0/3475064845 wait complete. 2024-09-19T09:52:23.090 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.261+0000 7fc56e4b7640 1 Processor -- start 2024-09-19T09:52:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.264+0000 7fc56e4b7640 1 -- start start 2024-09-19T09:52:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.265+0000 7fc56e4b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.265+0000 7fc56e4b7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.265+0000 7fc56e4b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.265+0000 7fc56e4b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc56815c440 con 0x7fc568073260 2024-09-19T09:52:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.265+0000 7fc56e4b7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc56815ca00 con 0x7fc56806de20 2024-09-19T09:52:23.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.265+0000 7fc56e4b7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc56815d3d0 con 0x7fc568152e00 2024-09-19T09:52:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:34076/0 (socket says 172.21.15.123:34076) 2024-09-19T09:52:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 learned_addr learned my addr 172.21.15.123:0/733360702 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.266+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:23.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.271+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:23.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.271+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.271+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.271+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:23.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.467+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:52:23.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.472+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.472+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:23.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.472+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.472+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.472+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:52:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:52:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.868+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:52:23.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.873+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:23.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.873+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:23.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.873+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:23.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.873+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:23.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:23.873+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:52:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.669+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.669+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.669+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.669+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.669+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.669+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:52:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.670+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.670+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.670+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.670+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:52:24.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.674+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.676+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:52:24.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.676+0000 7fc567fff640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:24.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.676+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:24.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:24.676+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 msgr2=0x7fc56815ce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc568152e00 0x7fc56815ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 msgr2=0x7fc5681598d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.194:3300/0 conn(0x7fc56806de20 0x7fc5681598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 -- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 msgr2=0x7fc5680736d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 --2- 172.21.15.123:0/733360702 >> v2:172.21.15.123:3300/0 conn(0x7fc568073260 0x7fc5680736d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.265+0000 7fc565ffb640 1 -- 172.21.15.123:0/733360702 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55400b0b0 con 0x7fc554007390 2024-09-19T09:52:26.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.266+0000 7fc565ffb640 1 -- 172.21.15.123:0/733360702 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55400c2d0 con 0x7fc554003650 2024-09-19T09:52:26.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.266+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427631336 0 0) 0x7fc55400c2d0 con 0x7fc554003650 2024-09-19T09:52:26.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.266+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc548003520 con 0x7fc554003650 2024-09-19T09:52:26.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.266+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076628384 0 0) 0x7fc55400b0b0 con 0x7fc554007390 2024-09-19T09:52:26.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.266+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc55400c2d0 con 0x7fc554007390 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 111682068 0 0) 0x7fc55400c2d0 con 0x7fc554007390 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 >> v1:172.21.15.194:6789/0 conn(0x7fc554003650 legacy=0x7fc554005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55400d570 con 0x7fc554007390 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fc55000f040 con 0x7fc554007390 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 >> v1:172.21.15.123:6789/0 conn(0x7fc554007390 legacy=0x7fc554009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc56ca54640 1 -- 172.21.15.123:0/733360702 reap_dead start 2024-09-19T09:52:26.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc548004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.267+0000 7fc566ffd640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc54800be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.268+0000 7fc567fff640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc548004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.268+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.268+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc548014c20 con 0x7fc548009a30 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.268+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc548014dd0 con 0x7fc548003c40 2024-09-19T09:52:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.268+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc548014fd0 con 0x7fc548004800 2024-09-19T09:52:26.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.268+0000 7fc56ca54640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc54800be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.269+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 msgr2=0x7fc548004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:26.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.269+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc548004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.269+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 msgr2=0x7fc54800be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.269+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc54800be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.269+0000 7fc5677fe640 1 -- 172.21.15.123:0/733360702 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55400c2d0 con 0x7fc548004800 2024-09-19T09:52:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.270+0000 7fc5677fe640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc548004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5680cf7e0 tx=0x7fc548005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f54e80a2149eb55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.270+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550038070 con 0x7fc548004800 2024-09-19T09:52:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.270+0000 7fc566ffd640 1 -- 172.21.15.123:0/733360702 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55002b9f0 con 0x7fc548004800 2024-09-19T09:52:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.271+0000 7fc56e4b7640 1 -- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 msgr2=0x7fc548004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.271+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc548004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5680cf7e0 tx=0x7fc548005830 comp rx=0 tx=0).stop 2024-09-19T09:52:26.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.272+0000 7fc56e4b7640 1 -- 172.21.15.123:0/733360702 shutdown_connections 2024-09-19T09:52:26.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.272+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc54800be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.272+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc548004c80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.272+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/733360702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc548004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.272+0000 7fc56e4b7640 1 -- 172.21.15.123:0/733360702 >> 172.21.15.123:0/733360702 conn(0x7fc5680ce9b0 msgr2=0x7fc5680ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.273+0000 7fc56e4b7640 1 -- 172.21.15.123:0/733360702 shutdown_connections 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.273+0000 7fc56e4b7640 1 -- 172.21.15.123:0/733360702 wait complete. 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.275+0000 7fc56e4b7640 1 Processor -- start 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.275+0000 7fc56e4b7640 1 -- start start 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.276+0000 7fc56e4b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc56806d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.276+0000 7fc56e4b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc568156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.276+0000 7fc56e4b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc56815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.276+0000 7fc56e4b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680c8cc0 con 0x7fc548009a30 2024-09-19T09:52:26.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.276+0000 7fc56e4b7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680c89e0 con 0x7fc548003c40 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.276+0000 7fc56e4b7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc56815c690 con 0x7fc548004800 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.277+0000 7fc56ca54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc56815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.277+0000 7fc56ca54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc56815b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55850/0 (socket says 172.21.15.123:55850) 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.277+0000 7fc56ca54640 1 -- 172.21.15.123:0/3365864721 learned_addr learned my addr 172.21.15.123:0/3365864721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc567fff640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc56806d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc56ca54640 1 -- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 msgr2=0x7fc568156a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc56ca54640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc568156a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc56ca54640 1 -- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 msgr2=0x7fc56806d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc56ca54640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc56806d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc56ca54640 1 -- 172.21.15.123:0/3365864721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56820eba0 con 0x7fc548009a30 2024-09-19T09:52:26.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.278+0000 7fc56ca54640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc56815b490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc560009be0 tx=0x7fc560016710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.279+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56001d030 con 0x7fc548009a30 2024-09-19T09:52:26.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.279+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560016e80 con 0x7fc548009a30 2024-09-19T09:52:26.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.279+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560009cd0 con 0x7fc548009a30 2024-09-19T09:52:26.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.279+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56820ee60 con 0x7fc548009a30 2024-09-19T09:52:26.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.279+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc568159bd0 con 0x7fc548009a30 2024-09-19T09:52:26.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.281+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5681531e0 con 0x7fc548009a30 2024-09-19T09:52:26.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.282+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc560020030 con 0x7fc548009a30 2024-09-19T09:52:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.283+0000 7fc564ff9640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55406cde0 0x7fc55406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.283+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc56008bef0 con 0x7fc548009a30 2024-09-19T09:52:26.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.284+0000 7fc567fff640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55406cde0 0x7fc55406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.284+0000 7fc567fff640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55406cde0 0x7fc55406f2a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc558006e80 tx=0x7fc558008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.291+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc56005a4b0 con 0x7fc548009a30 2024-09-19T09:52:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.677+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc5680c9470 con 0x7fc548009a30 2024-09-19T09:52:26.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.678+0000 7fc564ff9640 1 -- 172.21.15.123:0/3365864721 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fc560059db0 con 0x7fc548009a30 2024-09-19T09:52:26.680 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55406cde0 msgr2=0x7fc55406f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55406cde0 0x7fc55406f2a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc558006e80 tx=0x7fc558008040 comp rx=0 tx=0).stop 2024-09-19T09:52:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 msgr2=0x7fc56815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc56815b490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc560009be0 tx=0x7fc560016710 comp rx=0 tx=0).stop 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 shutdown_connections 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc548009a30 0x7fc56815b490 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc55406cde0 0x7fc55406f2a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc548004800 0x7fc568156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 --2- 172.21.15.123:0/3365864721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc548003c40 0x7fc56806d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.682+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 >> 172.21.15.123:0/3365864721 conn(0x7fc5680ce9b0 msgr2=0x7fc568150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.683+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 shutdown_connections 2024-09-19T09:52:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.683+0000 7fc56e4b7640 1 -- 172.21.15.123:0/3365864721 wait complete. 2024-09-19T09:52:26.703 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:52:26.703 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:52:26.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:52:26.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.860+0000 7f2dd1c77640 1 Processor -- start 2024-09-19T09:52:26.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.860+0000 7f2dd1c77640 1 -- start start 2024-09-19T09:52:26.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dd1c77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2dcc06f830 0x7f2dcc162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dd1c77640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc15f590 con 0x7f2dcc0cb010 2024-09-19T09:52:26.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dd1c77640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc15f810 con 0x7f2dcc06f450 2024-09-19T09:52:26.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dd1c77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2dcc15faf0 con 0x7f2dcc06f830 2024-09-19T09:52:26.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dc3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2dcc06f830 0x7f2dcc162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dc3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2dcc06f830 0x7f2dcc162cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55858/0 (socket says 172.21.15.123:55858) 2024-09-19T09:52:26.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.861+0000 7f2dc3fff640 1 -- 172.21.15.123:0/3714163179 learned_addr learned my addr 172.21.15.123:0/3714163179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.862+0000 7f2dc3fff640 1 -- 172.21.15.123:0/3714163179 >> v1:172.21.15.194:6789/0 conn(0x7f2dcc06f450 legacy=0x7f2dcc0c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.862+0000 7f2dc3fff640 1 -- 172.21.15.123:0/3714163179 >> v1:172.21.15.123:6789/0 conn(0x7f2dcc0cb010 legacy=0x7f2dcc1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.862+0000 7f2dc3fff640 1 -- 172.21.15.123:0/3714163179 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc15fdd0 con 0x7f2dcc06f830 2024-09-19T09:52:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.863+0000 7f2dc3fff640 1 --2- 172.21.15.123:0/3714163179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162cb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009870 tx=0x7f2dbc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be41e33ab67706c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.863+0000 7f2dcaffd640 1 -- 172.21.15.123:0/3714163179 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc037070 con 0x7f2dcc06f830 2024-09-19T09:52:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.864+0000 7f2dcaffd640 1 -- 172.21.15.123:0/3714163179 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dbc032640 con 0x7f2dcc06f830 2024-09-19T09:52:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.864+0000 7f2dcaffd640 1 -- 172.21.15.123:0/3714163179 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc032a10 con 0x7f2dcc06f830 2024-09-19T09:52:26.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.868+0000 7f2dd1c77640 1 -- 172.21.15.123:0/3714163179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 msgr2=0x7f2dcc162cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.868+0000 7f2dd1c77640 1 --2- 172.21.15.123:0/3714163179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162cb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009870 tx=0x7f2dbc02a300 comp rx=0 tx=0).stop 2024-09-19T09:52:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.868+0000 7f2dd1c77640 1 -- 172.21.15.123:0/3714163179 shutdown_connections 2024-09-19T09:52:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.868+0000 7f2dd1c77640 1 --2- 172.21.15.123:0/3714163179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162cb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.868+0000 7f2dd1c77640 1 -- 172.21.15.123:0/3714163179 >> 172.21.15.123:0/3714163179 conn(0x7f2dcc0713d0 msgr2=0x7f2dcc0cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.868+0000 7f2dd1c77640 1 -- 172.21.15.123:0/3714163179 shutdown_connections 2024-09-19T09:52:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.869+0000 7f2dd1c77640 1 -- 172.21.15.123:0/3714163179 wait complete. 2024-09-19T09:52:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.871+0000 7f2dd1c77640 1 Processor -- start 2024-09-19T09:52:26.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.873+0000 7f2dd1c77640 1 -- start start 2024-09-19T09:52:26.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.874+0000 7f2dd1c77640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dcc06f450 0x7f2dcc15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.874+0000 7f2dd1c77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.874+0000 7f2dd1c77640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dcc0cb010 0x7f2dcc1ec370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.875+0000 7f2dd1c77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc0c9f00 con 0x7f2dcc06f830 2024-09-19T09:52:26.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.875+0000 7f2dd1c77640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc0c9d80 con 0x7f2dcc0cb010 2024-09-19T09:52:26.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.875+0000 7f2dd1c77640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2dcc153bf0 con 0x7f2dcc06f450 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.875+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.875+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55862/0 (socket says 172.21.15.123:55862) 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.875+0000 7f2dc3fff640 1 -- 172.21.15.123:0/2762539948 learned_addr learned my addr 172.21.15.123:0/2762539948 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.876+0000 7f2dc3fff640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dcc06f450 msgr2=0x7f2dcc15a660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.876+0000 7f2dc3fff640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2dcc06f450 0x7f2dcc15a660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.876+0000 7f2dc3fff640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dcc0cb010 msgr2=0x7f2dcc1ec370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.876+0000 7f2dc3fff640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2dcc0cb010 0x7f2dcc1ec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.876+0000 7f2dc3fff640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc1f9100 con 0x7f2dcc06f830 2024-09-19T09:52:26.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.876+0000 7f2dc3fff640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009870 tx=0x7f2dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.878+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc037040 con 0x7f2dcc06f830 2024-09-19T09:52:26.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.878+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc1f93e0 con 0x7f2dcc06f830 2024-09-19T09:52:26.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.878+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dcc1f99a0 con 0x7f2dcc06f830 2024-09-19T09:52:26.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.879+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dbc004230 con 0x7f2dcc06f830 2024-09-19T09:52:26.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.880+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc03c730 con 0x7f2dcc06f830 2024-09-19T09:52:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.883+0000 7f2dd1c77640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 0x7f2db0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.883+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0007ec0 con 0x7f2db0002a70 2024-09-19T09:52:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.884+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2dbc03a070 con 0x7f2dcc06f830 2024-09-19T09:52:26.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.885+0000 7f2dc8ff9640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dac06c330 0x7f2dac06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.885+0000 7f2dcbfff640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dac06c330 0x7f2dac06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.886+0000 7f2dcbfff640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dac06c330 0x7f2dac06e7f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400ab10 tx=0x7f2dc4009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.886+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f2dbc077200 con 0x7f2dcc06f830 2024-09-19T09:52:26.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.889+0000 7f2dcb7fe640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 0x7f2db0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.893+0000 7f2dcb7fe640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2db00080c0 con 0x7f2db0002a70 2024-09-19T09:52:26.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.893+0000 7f2dcb7fe640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 0x7f2db0004f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c460 tx=0x7f2db400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.899+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4005270 con 0x7f2db0002a70 2024-09-19T09:52:26.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.899+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2db4005410 con 0x7f2db0002a70 2024-09-19T09:52:26.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.899+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 msgr2=0x7f2db0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.899+0000 7f2dc8ff9640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 0x7f2db0004f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c460 tx=0x7f2db400c920 comp rx=0 tx=0).stop 2024-09-19T09:52:26.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.899+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 msgr2=0x7f2db0004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:26.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.899+0000 7f2dc8ff9640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0002a70 0x7f2db0004f30 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c460 tx=0x7f2db400c920 comp rx=0 tx=0).stop 2024-09-19T09:52:26.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.914+0000 7f2dd1c77640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 0x7f2db0007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.915+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2db000a4a0 con 0x7f2db0006f00 2024-09-19T09:52:26.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.915+0000 7f2dcb7fe640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 0x7f2db0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.916+0000 7f2dcb7fe640 1 -- 172.21.15.123:0/2762539948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2db00078d0 con 0x7f2db0006f00 2024-09-19T09:52:26.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.916+0000 7f2dcb7fe640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 0x7f2db0007390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c460 tx=0x7f2db4000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.918+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007260 con 0x7f2db0006f00 2024-09-19T09:52:26.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.918+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f2db4007400 con 0x7f2db0006f00 2024-09-19T09:52:26.920 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:26.920 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:26.920 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 62, 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 7322, 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:52:26.921 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:26.922 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:26.923 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:26.924 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:26.925 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:26.926 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:26.927 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:26.928 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.929 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:26.930 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:26.931 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:26.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:26.933 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:26.934 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:26.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.934 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:26.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:26.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.934 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:26.935 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:26.936 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.918+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 msgr2=0x7f2db0007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.918+0000 7f2dc8ff9640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 0x7f2db0007390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c460 tx=0x7f2db4000fb0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.919+0000 7f2dc8ff9640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 msgr2=0x7f2db0007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.919+0000 7f2dc8ff9640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db0006f00 0x7f2db0007390 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dac06c330 msgr2=0x7f2dac06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2dac06c330 0x7f2dac06e7f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400ab10 tx=0x7f2dc4009230 comp rx=0 tx=0).stop 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 msgr2=0x7f2dcc162360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 --2- 172.21.15.123:0/2762539948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc06f830 0x7f2dcc162360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009870 tx=0x7f2dbc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dcbfff640 1 -- 172.21.15.123:0/2762539948 reap_dead start 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dcbfff640 1 -- 172.21.15.123:0/2762539948 reap_dead start 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 shutdown_connections 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 >> 172.21.15.123:0/2762539948 conn(0x7f2dcc0713d0 msgr2=0x7f2dcc0cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.920+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 shutdown_connections 2024-09-19T09:52:26.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:26.921+0000 7f2dd1c77640 1 -- 172.21.15.123:0/2762539948 wait complete. 2024-09-19T09:52:26.942 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:52:26.942 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:52:26.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:52:27.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.105+0000 7fc3572af640 1 Processor -- start 2024-09-19T09:52:27.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.106+0000 7fc3572af640 1 -- start start 2024-09-19T09:52:27.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.107+0000 7fc3572af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc350155460 0x7fc350072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.107+0000 7fc3572af640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc35015b100 0x7fc35015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.107+0000 7fc3572af640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc35015f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.107+0000 7fc3572af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc350155840 con 0x7fc350155460 2024-09-19T09:52:27.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.107+0000 7fc3572af640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc35015b5b0 con 0x7fc35015b100 2024-09-19T09:52:27.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.107+0000 7fc3572af640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc35015b890 con 0x7fc3500c8a50 2024-09-19T09:52:27.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35584c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc35015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35504b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc350155460 0x7fc350072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35584c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc35015f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:42296/0 (socket says 172.21.15.123:42296) 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35584c640 1 -- 172.21.15.123:0/1842643977 learned_addr learned my addr 172.21.15.123:0/1842643977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35504b640 1 -- 172.21.15.123:0/1842643977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 msgr2=0x7fc35015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35504b640 1 --2- 172.21.15.123:0/1842643977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc35015f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35504b640 1 -- 172.21.15.123:0/1842643977 >> v2:172.21.15.194:3300/0 conn(0x7fc35015b100 msgr2=0x7fc35015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35504b640 1 --2- 172.21.15.123:0/1842643977 >> v2:172.21.15.194:3300/0 conn(0x7fc35015b100 0x7fc35015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.108+0000 7fc35504b640 1 -- 172.21.15.123:0/1842643977 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35015bb70 con 0x7fc350155460 2024-09-19T09:52:27.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.110+0000 7fc35504b640 1 --2- 172.21.15.123:0/1842643977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc350072530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc350071580 tx=0x7fc34802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e03e4ad0c109c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.110+0000 7fc343fff640 1 -- 172.21.15.123:0/1842643977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348037070 con 0x7fc350155460 2024-09-19T09:52:27.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.110+0000 7fc343fff640 1 -- 172.21.15.123:0/1842643977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc348032440 con 0x7fc350155460 2024-09-19T09:52:27.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc343fff640 1 -- 172.21.15.123:0/1842643977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3480327f0 con 0x7fc350155460 2024-09-19T09:52:27.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 -- 172.21.15.123:0/1842643977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 msgr2=0x7fc350072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 --2- 172.21.15.123:0/1842643977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc350072530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc350071580 tx=0x7fc34802a130 comp rx=0 tx=0).stop 2024-09-19T09:52:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 -- 172.21.15.123:0/1842643977 shutdown_connections 2024-09-19T09:52:27.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 --2- 172.21.15.123:0/1842643977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc35015f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 --2- 172.21.15.123:0/1842643977 >> v2:172.21.15.194:3300/0 conn(0x7fc35015b100 0x7fc35015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 --2- 172.21.15.123:0/1842643977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc350072530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.111+0000 7fc3572af640 1 -- 172.21.15.123:0/1842643977 >> 172.21.15.123:0/1842643977 conn(0x7fc35006ed00 msgr2=0x7fc35006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.112+0000 7fc3572af640 1 -- 172.21.15.123:0/1842643977 shutdown_connections 2024-09-19T09:52:27.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.112+0000 7fc3572af640 1 -- 172.21.15.123:0/1842643977 wait complete. 2024-09-19T09:52:27.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.114+0000 7fc3572af640 1 Processor -- start 2024-09-19T09:52:27.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.114+0000 7fc3572af640 1 -- start start 2024-09-19T09:52:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.116+0000 7fc3572af640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc3501453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.116+0000 7fc3572af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc3501f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.116+0000 7fc35504b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc3501453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.116+0000 7fc35484a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc3501f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.116+0000 7fc35484a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc3501f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55900/0 (socket says 172.21.15.123:55900) 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc35504b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc3501453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:42300/0 (socket says 172.21.15.123:42300) 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc35484a640 1 -- 172.21.15.123:0/855107513 learned_addr learned my addr 172.21.15.123:0/855107513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc3572af640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35015b100 0x7fc3501f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500c91c0 con 0x7fc350155460 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc35015e830 con 0x7fc35015b100 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc35584c640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35015b100 0x7fc3501f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.117+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc3500c9340 con 0x7fc3500c8a50 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35484a640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 msgr2=0x7fc3501453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35484a640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc3501453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35484a640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35015b100 msgr2=0x7fc3501f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35484a640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35015b100 0x7fc3501f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35484a640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3500caf80 con 0x7fc350155460 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35504b640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3500c8a50 0x7fc3501453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35484a640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc3501f0f70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00b410 tx=0x7fc34c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.118+0000 7fc35584c640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35015b100 0x7fc3501f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:27.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.119+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c015020 con 0x7fc350155460 2024-09-19T09:52:27.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.119+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c011830 con 0x7fc350155460 2024-09-19T09:52:27.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.119+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c011be0 con 0x7fc350155460 2024-09-19T09:52:27.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.120+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3500cbd00 con 0x7fc350155460 2024-09-19T09:52:27.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.121+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3500caa40 con 0x7fc350155460 2024-09-19T09:52:27.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.122+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc34c018020 con 0x7fc350155460 2024-09-19T09:52:27.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.122+0000 7fc341ffb640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc33406c3b0 0x7fc33406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.123+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc34c08b370 con 0x7fc350155460 2024-09-19T09:52:27.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.123+0000 7fc3572af640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 0x7fc3500cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.123+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500cb6c0 con 0x7fc3500c5470 2024-09-19T09:52:27.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.123+0000 7fc35504b640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc33406c3b0 0x7fc33406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.124+0000 7fc35504b640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc33406c3b0 0x7fc33406e870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc348034000 tx=0x7fc34802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.124+0000 7fc35584c640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 0x7fc3500cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.125+0000 7fc35584c640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3500c9770 con 0x7fc3500c5470 2024-09-19T09:52:27.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.125+0000 7fc35584c640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 0x7fc3500cb180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc344007d30 tx=0x7fc34400f520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.125+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344007e20 con 0x7fc3500c5470 2024-09-19T09:52:27.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.126+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc34401b070 con 0x7fc3500c5470 2024-09-19T09:52:27.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.126+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 msgr2=0x7fc3500cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.126+0000 7fc341ffb640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 0x7fc3500cb180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc344007d30 tx=0x7fc34400f520 comp rx=0 tx=0).stop 2024-09-19T09:52:27.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.126+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 msgr2=0x7fc3500cb180 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:27.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.126+0000 7fc341ffb640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5470 0x7fc3500cb180 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc344007d30 tx=0x7fc34400f520 comp rx=0 tx=0).stop 2024-09-19T09:52:27.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.136+0000 7fc3572af640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 0x7fc35015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.136+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3500cad60 con 0x7fc3500c5890 2024-09-19T09:52:27.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.137+0000 7fc35584c640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 0x7fc35015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.138+0000 7fc35584c640 1 -- 172.21.15.123:0/855107513 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3500c8830 con 0x7fc3500c5890 2024-09-19T09:52:27.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.139+0000 7fc35584c640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 0x7fc35015a200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc344007d30 tx=0x7fc344004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.141+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440209c0 con 0x7fc3500c5890 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.141+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7fc344020b60 con 0x7fc3500c5890 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.141+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 msgr2=0x7fc35015a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.141+0000 7fc341ffb640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 0x7fc35015a200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc344007d30 tx=0x7fc344004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.141+0000 7fc341ffb640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 msgr2=0x7fc35015a200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.141+0000 7fc341ffb640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3500c5890 0x7fc35015a200 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc344007d30 tx=0x7fc344004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:27.145 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 62, 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 61208, 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:27.146 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.147 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.148 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:27.149 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:27.150 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:27.151 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:27.152 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.153 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.154 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.155 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.156 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:27.157 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:27.158 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc33406c3b0 msgr2=0x7fc33406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc33406c3b0 0x7fc33406e870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc348034000 tx=0x7fc34802e000 comp rx=0 tx=0).stop 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc35584c640 1 -- 172.21.15.123:0/855107513 reap_dead start 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 msgr2=0x7fc3501f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc3501f0f70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00b410 tx=0x7fc34c00b8d0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 shutdown_connections 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 --2- 172.21.15.123:0/855107513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc350155460 0x7fc3501f0f70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.144+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 >> 172.21.15.123:0/855107513 conn(0x7fc35006ed00 msgr2=0x7fc35006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.147+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 shutdown_connections 2024-09-19T09:52:27.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.147+0000 7fc3572af640 1 -- 172.21.15.123:0/855107513 wait complete. 2024-09-19T09:52:27.167 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:52:27.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:52:27.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:52:27.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.328+0000 7f1d9db9f640 1 Processor -- start 2024-09-19T09:52:27.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.328+0000 7f1d9db9f640 1 -- start start 2024-09-19T09:52:27.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d9db9f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d98151e90 0x7f1d981588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d9db9f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d980732c0 con 0x7f1d980c8f70 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d9db9f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d980735a0 con 0x7f1d980c5950 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d977fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d98151e90 0x7f1d981588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d977fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d98151e90 0x7f1d981588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:34174/0 (socket says 172.21.15.123:34174) 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d977fe640 1 -- 172.21.15.123:0/3310232685 learned_addr learned my addr 172.21.15.123:0/3310232685 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.330+0000 7f1d9db9f640 1 -- 172.21.15.123:0/3310232685 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f1d980c7c50 con 0x7f1d98151e90 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.331+0000 7f1d96ffd640 1 -- 172.21.15.123:0/3310232685 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885989872 0 0) 0x7f1d980732c0 con 0x7f1d980c8f70 2024-09-19T09:52:27.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.332+0000 7f1d96ffd640 1 -- 172.21.15.123:0/3310232685 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d84003520 con 0x7f1d980c8f70 2024-09-19T09:52:27.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.332+0000 7f1d977fe640 1 -- 172.21.15.123:0/3310232685 >> v1:172.21.15.194:6789/0 conn(0x7f1d980c5950 legacy=0x7f1d980c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.332+0000 7f1d977fe640 1 -- 172.21.15.123:0/3310232685 >> v1:172.21.15.123:6789/0 conn(0x7f1d980c8f70 legacy=0x7f1d98072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.332+0000 7f1d977fe640 1 -- 172.21.15.123:0/3310232685 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d98073880 con 0x7f1d98151e90 2024-09-19T09:52:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.334+0000 7f1d977fe640 1 --2- 172.21.15.123:0/3310232685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98151e90 0x7f1d981588a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009870 tx=0x7f1d8802c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=167789bd2a0a21fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.334+0000 7f1d96ffd640 1 -- 172.21.15.123:0/3310232685 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88038070 con 0x7f1d98151e90 2024-09-19T09:52:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.334+0000 7f1d96ffd640 1 -- 172.21.15.123:0/3310232685 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d88031710 con 0x7f1d98151e90 2024-09-19T09:52:27.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.334+0000 7f1d96ffd640 1 -- 172.21.15.123:0/3310232685 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88031ac0 con 0x7f1d98151e90 2024-09-19T09:52:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.336+0000 7f1d9db9f640 1 -- 172.21.15.123:0/3310232685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98151e90 msgr2=0x7f1d981588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.336+0000 7f1d9db9f640 1 --2- 172.21.15.123:0/3310232685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98151e90 0x7f1d981588a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009870 tx=0x7f1d8802c500 comp rx=0 tx=0).stop 2024-09-19T09:52:27.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.336+0000 7f1d9db9f640 1 -- 172.21.15.123:0/3310232685 shutdown_connections 2024-09-19T09:52:27.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.336+0000 7f1d9db9f640 1 --2- 172.21.15.123:0/3310232685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98151e90 0x7f1d981588a0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009870 tx=0x7f1d8802c500 comp rx=0 tx=0).stop 2024-09-19T09:52:27.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.336+0000 7f1d9db9f640 1 -- 172.21.15.123:0/3310232685 >> 172.21.15.123:0/3310232685 conn(0x7f1d980703e0 msgr2=0x7f1d980cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.337+0000 7f1d9db9f640 1 -- 172.21.15.123:0/3310232685 shutdown_connections 2024-09-19T09:52:27.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.338+0000 7f1d9db9f640 1 -- 172.21.15.123:0/3310232685 wait complete. 2024-09-19T09:52:27.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.339+0000 7f1d9db9f640 1 Processor -- start 2024-09-19T09:52:27.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.340+0000 7f1d9db9f640 1 -- start start 2024-09-19T09:52:27.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d9db9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 0x7f1d98153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d9db9f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d980c8f70 0x7f1d9814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d9db9f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d9814ccd0 0x7f1d981ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 0x7f1d98153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d9db9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1d98073ed0 con 0x7f1d980c5950 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d9db9f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d98073070 con 0x7f1d9814ccd0 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d9db9f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1d98152270 con 0x7f1d980c8f70 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 0x7f1d98153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55914/0 (socket says 172.21.15.123:55914) 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 -- 172.21.15.123:0/334739239 learned_addr learned my addr 172.21.15.123:0/334739239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d980c8f70 msgr2=0x7f1d9814b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d980c8f70 0x7f1d9814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d9814ccd0 msgr2=0x7f1d981ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d9814ccd0 0x7f1d981ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.342+0000 7f1d977fe640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9814c0e0 con 0x7f1d980c5950 2024-09-19T09:52:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.343+0000 7f1d977fe640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 0x7f1d98153970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d88036040 tx=0x7f1d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.343+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88038050 con 0x7f1d980c5950 2024-09-19T09:52:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.343+0000 7f1d9db9f640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d981504c0 con 0x7f1d980c5950 2024-09-19T09:52:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.344+0000 7f1d9db9f640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d9814a100 con 0x7f1d980c5950 2024-09-19T09:52:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.344+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d88044070 con 0x7f1d980c5950 2024-09-19T09:52:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.345+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88003810 con 0x7f1d980c5950 2024-09-19T09:52:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.346+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1d880039b0 con 0x7f1d980c5950 2024-09-19T09:52:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.346+0000 7f1d94ff9640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1d7806c2b0 0x7f1d7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.347+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1d880ae370 con 0x7f1d980c5950 2024-09-19T09:52:27.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.347+0000 7f1d8effd640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1d7806c2b0 0x7f1d7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.347+0000 7f1d8effd640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1d7806c2b0 0x7f1d7806e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1d80000f60 tx=0x7f1d800079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.350+0000 7f1d9db9f640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 0x7f1d7c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.350+0000 7f1d9db9f640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7c007ec0 con 0x7f1d7c002a70 2024-09-19T09:52:27.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.350+0000 7f1d97fff640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 0x7f1d7c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.351+0000 7f1d97fff640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d7c0080c0 con 0x7f1d7c002a70 2024-09-19T09:52:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.351+0000 7f1d97fff640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 0x7f1d7c004f30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d90001560 tx=0x7f1d9000cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.352+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90003b70 con 0x7f1d7c002a70 2024-09-19T09:52:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.352+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1d9000ce50 con 0x7f1d7c002a70 2024-09-19T09:52:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.352+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 msgr2=0x7f1d7c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.352+0000 7f1d94ff9640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 0x7f1d7c004f30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d90001560 tx=0x7f1d9000cb10 comp rx=0 tx=0).stop 2024-09-19T09:52:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.352+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 msgr2=0x7f1d7c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.352+0000 7f1d94ff9640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c002a70 0x7f1d7c004f30 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d90001560 tx=0x7f1d9000cb10 comp rx=0 tx=0).stop 2024-09-19T09:52:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.365+0000 7f1d9db9f640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 0x7f1d7c007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.366+0000 7f1d9db9f640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7c00a4a0 con 0x7f1d7c006eb0 2024-09-19T09:52:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.366+0000 7f1d97fff640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 0x7f1d7c007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.367+0000 7f1d97fff640 1 -- 172.21.15.123:0/334739239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d7c007880 con 0x7f1d7c006eb0 2024-09-19T09:52:27.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.367+0000 7f1d97fff640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 0x7f1d7c007340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d90001560 tx=0x7f1d90001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.368+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d900050d0 con 0x7f1d7c006eb0 2024-09-19T09:52:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.368+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7f1d900050d0 con 0x7f1d7c006eb0 2024-09-19T09:52:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.368+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 msgr2=0x7f1d7c007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 62, 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 356685, 2024-09-19T09:52:27.371 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:27.372 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:27.373 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:27.375 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.376 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.377 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:27.379 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.380 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.381 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.382 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.383 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:27.384 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:27.385 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:27.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.368+0000 7f1d94ff9640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 0x7f1d7c007340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d90001560 tx=0x7f1d90001250 comp rx=0 tx=0).stop 2024-09-19T09:52:27.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.368+0000 7f1d94ff9640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 msgr2=0x7f1d7c007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.368+0000 7f1d94ff9640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d7c006eb0 0x7f1d7c007340 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d90001560 tx=0x7f1d90001250 comp rx=0 tx=0).stop 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1d7806c2b0 msgr2=0x7f1d7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1d7806c2b0 0x7f1d7806e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1d80000f60 tx=0x7f1d800079b0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d97fff640 1 -- 172.21.15.123:0/334739239 reap_dead start 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 -- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 msgr2=0x7f1d98153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 0x7f1d98153970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d88036040 tx=0x7f1d880046c0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 -- 172.21.15.123:0/334739239 shutdown_connections 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 --2- 172.21.15.123:0/334739239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d980c5950 0x7f1d98153970 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 -- 172.21.15.123:0/334739239 >> 172.21.15.123:0/334739239 conn(0x7f1d980703e0 msgr2=0x7f1d98157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 -- 172.21.15.123:0/334739239 shutdown_connections 2024-09-19T09:52:27.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.370+0000 7f1d8dffb640 1 -- 172.21.15.123:0/334739239 wait complete. 2024-09-19T09:52:27.388 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:52:27.388 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:52:27.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:52:27.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.523+0000 7f534f9a1640 1 Processor -- start 2024-09-19T09:52:27.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.523+0000 7f534f9a1640 1 -- start start 2024-09-19T09:52:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534f9a1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f53480ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534f9a1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f53480706b0 0x7f5348073580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534f9a1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53480cd620 con 0x7f53480c4780 2024-09-19T09:52:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534f9a1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f53480723d0 con 0x7f53480706b0 2024-09-19T09:52:27.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534f9a1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f53480726b0 con 0x7f53480cc790 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534df3e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53480c4780 0x7f534815b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53490/0 (socket says 172.21.15.123:53490) 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534df3e640 1 -- 172.21.15.123:0/1684534751 learned_addr learned my addr 172.21.15.123:0/1684534751 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534cf3c640 1 --2- 172.21.15.123:0/1684534751 >> v2:172.21.15.194:3300/0 conn(0x7f53480706b0 0x7f5348073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534d73d640 1 --2- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f53480ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f533ffff640 1 -- 172.21.15.123:0/1684534751 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917216359 0 0) 0x7f53480cd620 con 0x7f53480c4780 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f533ffff640 1 -- 172.21.15.123:0/1684534751 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5334003520 con 0x7f53480c4780 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534cf3c640 1 -- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 msgr2=0x7f53480ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534cf3c640 1 --2- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f53480ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534cf3c640 1 -- 172.21.15.123:0/1684534751 >> v1:172.21.15.123:6789/0 conn(0x7f53480c4780 legacy=0x7f534815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.525+0000 7f534cf3c640 1 -- 172.21.15.123:0/1684534751 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5348072990 con 0x7f53480706b0 2024-09-19T09:52:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.526+0000 7f534cf3c640 1 --2- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f5348073580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53380097a0 tx=0x7f533802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9de5668d07cc3943 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.526+0000 7f533ffff640 1 -- 172.21.15.123:0/1684534751 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338037070 con 0x7f53480706b0 2024-09-19T09:52:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.527+0000 7f533ffff640 1 -- 172.21.15.123:0/1684534751 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338032440 con 0x7f53480706b0 2024-09-19T09:52:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.527+0000 7f533ffff640 1 -- 172.21.15.123:0/1684534751 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338032830 con 0x7f53480706b0 2024-09-19T09:52:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.528+0000 7f534f9a1640 1 -- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 msgr2=0x7f5348073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.528+0000 7f534f9a1640 1 --2- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f5348073580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53380097a0 tx=0x7f533802a230 comp rx=0 tx=0).stop 2024-09-19T09:52:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.528+0000 7f534f9a1640 1 -- 172.21.15.123:0/1684534751 shutdown_connections 2024-09-19T09:52:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.528+0000 7f534f9a1640 1 --2- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f5348073580 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.528+0000 7f534f9a1640 1 --2- 172.21.15.123:0/1684534751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f53480ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.528+0000 7f534f9a1640 1 -- 172.21.15.123:0/1684534751 >> 172.21.15.123:0/1684534751 conn(0x7f534806fb90 msgr2=0x7f534806ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.529+0000 7f534f9a1640 1 -- 172.21.15.123:0/1684534751 shutdown_connections 2024-09-19T09:52:27.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.529+0000 7f534f9a1640 1 -- 172.21.15.123:0/1684534751 wait complete. 2024-09-19T09:52:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.530+0000 7f534f9a1640 1 Processor -- start 2024-09-19T09:52:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.530+0000 7f534f9a1640 1 -- start start 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534f9a1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f534814b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534f9a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 0x7f5348152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534f9a1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f5348153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534f9a1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5348152490 con 0x7f53480c4780 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534f9a1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5348158930 con 0x7f53480706b0 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534f9a1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f5348152a80 con 0x7f53480cc790 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 0x7f5348152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 0x7f5348152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55922/0 (socket says 172.21.15.123:55922) 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 -- 172.21.15.123:0/3768032258 learned_addr learned my addr 172.21.15.123:0/3768032258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534d73d640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f534814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534df3e640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f5348153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 -- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 msgr2=0x7f5348153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f5348153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 -- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 msgr2=0x7f534814b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f534814b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534cf3c640 1 -- 172.21.15.123:0/3768032258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5348155c20 con 0x7f53480c4780 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.531+0000 7f534df3e640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f5348153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.532+0000 7f534cf3c640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 0x7f5348152f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5338000c00 tx=0x7f53380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.532+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338037040 con 0x7f53480c4780 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.532+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338042070 con 0x7f53480c4780 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.532+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338032a30 con 0x7f53480c4780 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.532+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5348155f00 con 0x7f53480c4780 2024-09-19T09:52:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.532+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53481554a0 con 0x7f53480c4780 2024-09-19T09:52:27.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.533+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5348068a60 con 0x7f53480c4780 2024-09-19T09:52:27.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.534+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5338032bd0 con 0x7f53480c4780 2024-09-19T09:52:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.535+0000 7f533dffb640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f532c06c2b0 0x7f532c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.535+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f53380abe70 con 0x7f53480c4780 2024-09-19T09:52:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.535+0000 7f534d73d640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f532c06c2b0 0x7f532c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.535+0000 7f534d73d640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f532c06c2b0 0x7f532c06e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5344009aa0 tx=0x7f5344009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.539+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f533807a670 con 0x7f53480c4780 2024-09-19T09:52:27.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.885+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f53480c4350 con 0x7f53480c4780 2024-09-19T09:52:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.886+0000 7f533dffb640 1 -- 172.21.15.123:0/3768032258 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f53380044a0 con 0x7f53480c4780 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f532c06c2b0 msgr2=0x7f532c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f532c06c2b0 0x7f532c06e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5344009aa0 tx=0x7f5344009190 comp rx=0 tx=0).stop 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 msgr2=0x7f5348152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 0x7f5348152f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5338000c00 tx=0x7f53380046c0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 shutdown_connections 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f532c06c2b0 0x7f532c06e770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53480cc790 0x7f5348153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53480c4780 0x7f5348152f10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 --2- 172.21.15.123:0/3768032258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53480706b0 0x7f534814b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 >> 172.21.15.123:0/3768032258 conn(0x7f534806fb90 msgr2=0x7f5348151770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 shutdown_connections 2024-09-19T09:52:27.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:27.889+0000 7f534f9a1640 1 -- 172.21.15.123:0/3768032258 wait complete. 2024-09-19T09:52:27.904 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:52:33.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:52:33.823 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:52:34.470 INFO:tasks.workunit.client.0.smithi123.stdout:Syncing()...35 sec 2024-09-19T09:52:34.470 INFO:tasks.workunit.client.0.smithi123.stdout:FFSB benchmark finished at: Thu Sep 19 09:52:34 2024 2024-09-19T09:52:34.470 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:Results: 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:Benchmark took 341.52 sec 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:Total Results 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:=============== 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout: ======= ============ ========= ======= =========== ========== 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout: write : 28938240 84733.75 100.000% 100.000% 331MB/sec 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:- 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:84733.75 Transactions per Second 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:Throughput Results 2024-09-19T09:52:34.471 INFO:tasks.workunit.client.0.smithi123.stdout:=================== 2024-09-19T09:52:34.472 INFO:tasks.workunit.client.0.smithi123.stdout:Write Throughput: 331MB/sec 2024-09-19T09:52:34.564 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.564 INFO:tasks.workunit.client.0.smithi123.stdout:System Call Latency statistics in millisecs 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout:===== 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: Min Avg Max Total Calls 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: ======== ======== ======== ============ 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout:[ open] 0.004000 0.034183 31.150999 22608 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T09:52:34.565 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[8] 10.000000 - 20.000000 : 14 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[9] 5.000000 - 10.000000 : 11 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[10] 2.000000 - 5.000000 : 15 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[11] 1.000000 - 2.000000 : 11 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[12] 0.500000 - 1.000000 : 10 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[13] 0.200000 - 0.500000 : 7 2024-09-19T09:52:34.566 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[14] 0.100000 - 0.200000 : 33 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[15] 0.050000 - 0.100000 : 75 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[16] 0.020000 - 0.050000 : 2985 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[17] 0.010000 - 0.020000 : 18539 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[18] 0.000000 - 0.010000 : 907 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout:[ write] 0.001000 0.333368 7206.710938 28938240 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[0] 5000.000000 - 10000.000000 : 109 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[1] 2000.000000 - 5000.000000 : 1219 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[2] 1000.000000 - 2000.000000 : 876 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[3] 500.000000 - 1000.000000 : 792 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[4] 200.000000 - 500.000000 : 1159 2024-09-19T09:52:34.567 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[5] 100.000000 - 200.000000 : 2411 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[6] 50.000000 - 100.000000 : 20718 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[7] 20.000000 - 50.000000 : 31527 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[8] 10.000000 - 20.000000 : 2654 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[9] 5.000000 - 10.000000 : 1512 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[10] 2.000000 - 5.000000 : 2332 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[11] 1.000000 - 2.000000 : 1817 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[12] 0.500000 - 1.000000 : 1885 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[13] 0.200000 - 0.500000 : 2592 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[14] 0.100000 - 0.200000 : 3097 2024-09-19T09:52:34.568 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[15] 0.050000 - 0.100000 : 6832 2024-09-19T09:52:34.569 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[16] 0.020000 - 0.050000 : 32626 2024-09-19T09:52:34.569 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[17] 0.010000 - 0.020000 : 104793 2024-09-19T09:52:34.569 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[18] 0.000000 - 0.010000 : 28719289 2024-09-19T09:52:34.569 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.569 INFO:tasks.workunit.client.0.smithi123.stdout:[ lseek] 0.000000 0.000470 65.639999 28938240 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[7] 20.000000 - 50.000000 : 13 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[8] 10.000000 - 20.000000 : 29 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[9] 5.000000 - 10.000000 : 87 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[10] 2.000000 - 5.000000 : 172 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[11] 1.000000 - 2.000000 : 127 2024-09-19T09:52:34.570 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[12] 0.500000 - 1.000000 : 140 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[13] 0.200000 - 0.500000 : 260 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[14] 0.100000 - 0.200000 : 300 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[15] 0.050000 - 0.100000 : 593 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[16] 0.020000 - 0.050000 : 3117 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[17] 0.010000 - 0.020000 : 6653 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[18] 0.000000 - 0.010000 : 28926747 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout:[ close] 0.001000 0.005616 2.463000 22608 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:52:34.571 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[10] 2.000000 - 5.000000 : 3 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[13] 0.200000 - 0.500000 : 3 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[14] 0.100000 - 0.200000 : 6 2024-09-19T09:52:34.572 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[15] 0.050000 - 0.100000 : 4 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[16] 0.020000 - 0.050000 : 57 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[17] 0.010000 - 0.020000 : 125 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: msec_range[18] 0.000000 - 0.010000 : 22407 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout: 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout:4.0% User Time 2024-09-19T09:52:34.573 INFO:tasks.workunit.client.0.smithi123.stdout:25.5% System Time 2024-09-19T09:52:34.574 INFO:tasks.workunit.client.0.smithi123.stdout:29.5% CPU Utilization 2024-09-19T09:52:34.588 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd .. 2024-09-19T09:52:34.589 INFO:tasks.workunit.client.0.smithi123.stderr:+ rm -r tmp ffsb 2024-09-19T09:52:37.905 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:52:37.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:38.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.005+0000 7fc8d99d6640 1 Processor -- start 2024-09-19T09:52:38.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.005+0000 7fc8d99d6640 1 -- start start 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d99d6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8d40c7f40 0x7fc8d40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d99d6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d99d6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d415c240 con 0x7fc8d4155650 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d99d6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d4155a30 con 0x7fc8d40c7f40 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d99d6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d415b3e0 con 0x7fc8d40c8400 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d40cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41932/0 (socket says 172.21.15.123:41932) 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d37fe640 1 -- 172.21.15.123:0/939598864 learned_addr learned my addr 172.21.15.123:0/939598864 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d27fc640 1 --2- 172.21.15.123:0/939598864 >> v2:172.21.15.194:3300/0 conn(0x7fc8d40c7f40 0x7fc8d40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d27fc640 1 -- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 msgr2=0x7fc8d40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d27fc640 1 --2- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d40cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d27fc640 1 -- 172.21.15.123:0/939598864 >> v1:172.21.15.194:6789/0 conn(0x7fc8d4155650 legacy=0x7fc8d40cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d27fc640 1 -- 172.21.15.123:0/939598864 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d415b6c0 con 0x7fc8d40c7f40 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.006+0000 7fc8d37fe640 1 --2- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d40cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.007+0000 7fc8d27fc640 1 --2- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d40c7f40 0x7fc8d40cb7f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80097a0 tx=0x7fc8c802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecb3949e50f9d640 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.007+0000 7fc8d1ffb640 1 -- 172.21.15.123:0/939598864 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8037070 con 0x7fc8d40c7f40 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.007+0000 7fc8d1ffb640 1 -- 172.21.15.123:0/939598864 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c8032440 con 0x7fc8d40c7f40 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.007+0000 7fc8d1ffb640 1 -- 172.21.15.123:0/939598864 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8032810 con 0x7fc8d40c7f40 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 -- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d40c7f40 msgr2=0x7fc8d40cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d40c7f40 0x7fc8d40cb7f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80097a0 tx=0x7fc8c802a180 comp rx=0 tx=0).stop 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 -- 172.21.15.123:0/939598864 shutdown_connections 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d40cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/939598864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d40c7f40 0x7fc8d40cb7f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 -- 172.21.15.123:0/939598864 >> 172.21.15.123:0/939598864 conn(0x7fc8d40cd5c0 msgr2=0x7fc8d40cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 -- 172.21.15.123:0/939598864 shutdown_connections 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.008+0000 7fc8d99d6640 1 -- 172.21.15.123:0/939598864 wait complete. 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.009+0000 7fc8d99d6640 1 Processor -- start 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.010+0000 7fc8d99d6640 1 -- start start 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d99d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 0x7fc8d4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d99d6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d99d6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d4155650 0x7fc8d41f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d99d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415bf60 con 0x7fc8d40c7f40 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d99d6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415bc80 con 0x7fc8d4155650 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d99d6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d40ce430 con 0x7fc8d40c8400 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 0x7fc8d4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 0x7fc8d4156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50702/0 (socket says 172.21.15.123:50702) 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 -- 172.21.15.123:0/404699504 learned_addr learned my addr 172.21.15.123:0/404699504 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d37fe640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d4155650 0x7fc8d41f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d27fc640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 -- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 msgr2=0x7fc8d414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d414cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 -- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d4155650 msgr2=0x7fc8d41f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d4155650 0x7fc8d41f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 -- 172.21.15.123:0/404699504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d41518f0 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.011+0000 7fc8d2ffd640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 0x7fc8d4156c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400c430 tx=0x7fc8c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.012+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c40052d0 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.012+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c4005490 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.012+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4007260 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.012+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d4155de0 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.012+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41510f0 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.013+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d40cce30 con 0x7fc8d40c7f40 2024-09-19T09:52:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.013+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc8c4007400 con 0x7fc8d40c7f40 2024-09-19T09:52:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.014+0000 7fc8bbfff640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc8c006c2b0 0x7fc8c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.014+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc8c408a920 con 0x7fc8d40c7f40 2024-09-19T09:52:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.014+0000 7fc8d27fc640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc8c006c2b0 0x7fc8c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.014+0000 7fc8d27fc640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc8c006c2b0 0x7fc8c006e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8034000 tx=0x7fc8c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.019+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc8d40cce30 con 0x7fc8d40c7f40 2024-09-19T09:52:38.119 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:52:38.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:52:38.202 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-19T09:52:38.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:52:38.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.362+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc8d40c9570 con 0x7fc8d40c7f40 2024-09-19T09:52:38.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.362+0000 7fc8bbfff640 1 -- 172.21.15.123:0/404699504 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fc8d40c9570 con 0x7fc8d40c7f40 2024-09-19T09:52:38.364 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc8c006c2b0 msgr2=0x7fc8c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc8c006c2b0 0x7fc8c006e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8034000 tx=0x7fc8c802e000 comp rx=0 tx=0).stop 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 msgr2=0x7fc8d4156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 0x7fc8d4156c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400c430 tx=0x7fc8c400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 shutdown_connections 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8d4155650 0x7fc8d41f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc8c006c2b0 0x7fc8c006e770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8d40c8400 0x7fc8d414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 --2- 172.21.15.123:0/404699504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d40c7f40 0x7fc8d4156c30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 >> 172.21.15.123:0/404699504 conn(0x7fc8d40cd5c0 msgr2=0x7fc8d40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 shutdown_connections 2024-09-19T09:52:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.364+0000 7fc8d99d6640 1 -- 172.21.15.123:0/404699504 wait complete. 2024-09-19T09:52:38.378 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:52:38.378 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-19T09:52:38.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:52:38.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:52:38.454 DEBUG:teuthology.parallel:result is None 2024-09-19T09:52:38.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:52:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.491+0000 7f93a4677640 1 Processor -- start 2024-09-19T09:52:38.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.492+0000 7f93a4677640 1 -- start start 2024-09-19T09:52:38.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a4677640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f939c152dc0 0x7f939c0c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a4677640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 0x7f939c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a4677640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939c0c7ca0 con 0x7f939c0c7540 2024-09-19T09:52:38.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a4677640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f939c0c5d50 con 0x7f939c152dc0 2024-09-19T09:52:38.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a4677640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f939c159230 con 0x7f939c0c6100 2024-09-19T09:52:38.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a1c12640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f939c0c7540 0x7f939c1596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42842/0 (socket says 172.21.15.123:42842) 2024-09-19T09:52:38.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a1c12640 1 -- 172.21.15.123:0/2345004642 learned_addr learned my addr 172.21.15.123:0/2345004642 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:38.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.494+0000 7f93a2c14640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 0x7f939c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.495+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561683437 0 0) 0x7f939c0c7ca0 con 0x7f939c0c7540 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.495+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9388003520 con 0x7f939c0c7540 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.495+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3769228592 0 0) 0x7f9388003520 con 0x7f939c0c7540 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.495+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 msgr2=0x7f939c0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.495+0000 7f93a1411640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 0x7f939c0c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 >> v2:172.21.15.123:3300/0 conn(0x7f939c152dc0 msgr2=0x7f939c0c4680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 --2- 172.21.15.123:0/2345004642 >> v2:172.21.15.123:3300/0 conn(0x7f939c152dc0 0x7f939c0c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c073490 con 0x7f939c0c7540 2024-09-19T09:52:38.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f9398001670 con 0x7f939c0c7540 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a2c14640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 0x7f939c0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 >> v1:172.21.15.123:6789/0 conn(0x7f939c0c7540 legacy=0x7f939c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93880039b0 0x7f9388003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 0x7f9388004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9388004d40 0x7f93880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f939c159230 con 0x7f93880039b0 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f938800ba70 con 0x7f9388004d40 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.496+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f938800bc20 con 0x7f939c0c6100 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.497+0000 7f93a2c14640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9388004d40 0x7f93880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.498+0000 7f93a2413640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93880039b0 0x7f9388003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.498+0000 7f93a2413640 1 -- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 msgr2=0x7f9388004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.498+0000 7f93a2413640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0c6100 0x7f9388004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.498+0000 7f93a2413640 1 -- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9388004d40 msgr2=0x7f93880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.498+0000 7f93a2413640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9388004d40 0x7f93880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.498+0000 7f93a2413640 1 -- 172.21.15.123:0/2345004642 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388003520 con 0x7f93880039b0 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.499+0000 7f93a2413640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93880039b0 0x7f9388003dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f938c009880 tx=0x7f9388005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111e3c1d6b80cc3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.500+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c037070 con 0x7f93880039b0 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.500+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c02aaa0 con 0x7f93880039b0 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.500+0000 7f93a1411640 1 -- 172.21.15.123:0/2345004642 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c009480 con 0x7f93880039b0 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.501+0000 7f93a4677640 1 -- 172.21.15.123:0/2345004642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93880039b0 msgr2=0x7f9388003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.501+0000 7f93a4677640 1 --2- 172.21.15.123:0/2345004642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93880039b0 0x7f9388003dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f938c009880 tx=0x7f9388005830 comp rx=0 tx=0).stop 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.501+0000 7f93a2c14640 1 -- 172.21.15.123:0/2345004642 reap_dead start 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.501+0000 7f93a4677640 1 -- 172.21.15.123:0/2345004642 shutdown_connections 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.501+0000 7f93a4677640 1 -- 172.21.15.123:0/2345004642 >> 172.21.15.123:0/2345004642 conn(0x7f939c06ed00 msgr2=0x7f939c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.501+0000 7f93a4677640 1 -- 172.21.15.123:0/2345004642 shutdown_connections 2024-09-19T09:52:38.505 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:52:38.505 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-19T09:52:38.523 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-19T09:52:38.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.502+0000 7f93a4677640 1 -- 172.21.15.123:0/2345004642 wait complete. 2024-09-19T09:52:38.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.503+0000 7f93a4677640 1 Processor -- start 2024-09-19T09:52:38.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.504+0000 7f93a4677640 1 -- start start 2024-09-19T09:52:38.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a4677640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0cb830 0x7f939c1fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a4677640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939c14f6a0 0x7f939c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a4677640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939c0cc150 0x7f939c1fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a4677640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f939c073a10 con 0x7f939c14f6a0 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a4677640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f939c073730 con 0x7f939c0cc150 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a4677640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f939c0c79b0 con 0x7f939c0cb830 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939c14f6a0 0x7f939c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a2413640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0cb830 0x7f939c1fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a2413640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0cb830 0x7f939c1fe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:41980/0 (socket says 172.21.15.123:41980) 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939c14f6a0 0x7f939c0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50736/0 (socket says 172.21.15.123:50736) 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a2413640 1 -- 172.21.15.123:0/3866421003 learned_addr learned my addr 172.21.15.123:0/3866421003 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:38.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0cb830 msgr2=0x7f939c1fe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f939c0cb830 0x7f939c1fe6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939c0cc150 msgr2=0x7f939c1fadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f939c0cc150 0x7f939c1fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.505+0000 7f93a1c12640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c1febf0 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.506+0000 7f93a1c12640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939c14f6a0 0x7f939c0cbc10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f939800c760 tx=0x7f939800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.506+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9398018070 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.506+0000 7f93a4677640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c1520f0 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.506+0000 7f93a4677640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c158b70 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.506+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9398004aa0 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.507+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980070d0 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.509+0000 7f9390ff9640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 0x7f9378004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.509+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f939801b070 con 0x7f939c14f6a0 2024-09-19T09:52:38.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.509+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9378007ec0 con 0x7f9378002a70 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.509+0000 7f93a2413640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 0x7f9378004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.510+0000 7f93a2413640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93780080c0 con 0x7f9378002a70 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.510+0000 7f93a2413640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 0x7f9378004f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f938c02a4d0 tx=0x7f938c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.510+0000 7f9392ffd640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938006c380 0x7f938006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.510+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f939808a9d0 con 0x7f939c14f6a0 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.511+0000 7f93a2c14640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938006c380 0x7f938006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.511+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c043070 con 0x7f9378002a70 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.511+0000 7f93a2c14640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938006c380 0x7f938006e840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f939c0c7920 tx=0x7f9394004ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.512+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f938c02ae50 con 0x7f9378002a70 2024-09-19T09:52:38.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.512+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 msgr2=0x7f9378004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.512+0000 7f9392ffd640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 0x7f9378004f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f938c02a4d0 tx=0x7f938c0047d0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.512+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 msgr2=0x7f9378004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.512+0000 7f9392ffd640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378002a70 0x7f9378004f30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.523+0000 7f9390ff9640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 0x7f9378007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.523+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f937800a4a0 con 0x7f9378006ee0 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.523+0000 7f93a2413640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 0x7f9378007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.524+0000 7f93a2413640 1 -- 172.21.15.123:0/3866421003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f93780078b0 con 0x7f9378006ee0 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.524+0000 7f93a2413640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 0x7f9378007370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9378008090 tx=0x7f938c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.524+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c037040 con 0x7f9378006ee0 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f938c038040 con 0x7f9378006ee0 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 msgr2=0x7f9378007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9392ffd640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 0x7f9378007370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9378008090 tx=0x7f938c008030 comp rx=0 tx=0).stop 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9392ffd640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 msgr2=0x7f9378007370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 62, 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 18929, 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:38.534 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 12, 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.535 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.536 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.538 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.539 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.540 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:38.541 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.542 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.543 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:38.546 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9392ffd640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9378006ee0 0x7f9378007370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938006c380 msgr2=0x7f938006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f938006c380 0x7f938006e840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f939c0c7920 tx=0x7f9394004ab0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939c14f6a0 msgr2=0x7f939c0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 --2- 172.21.15.123:0/3866421003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f939c14f6a0 0x7f939c0cbc10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f939800c760 tx=0x7f939800cc20 comp rx=0 tx=0).stop 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f93a2c14640 1 -- 172.21.15.123:0/3866421003 reap_dead start 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f93a2c14640 1 -- 172.21.15.123:0/3866421003 reap_dead start 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 shutdown_connections 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 >> 172.21.15.123:0/3866421003 conn(0x7f939c06ed00 msgr2=0x7f939c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 shutdown_connections 2024-09-19T09:52:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.525+0000 7f9390ff9640 1 -- 172.21.15.123:0/3866421003 wait complete. 2024-09-19T09:52:38.549 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:52:38.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:52:38.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:52:38.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.686+0000 7f4e7559f640 1 Processor -- start 2024-09-19T09:52:38.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.686+0000 7f4e7559f640 1 -- start start 2024-09-19T09:52:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e7559f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e70152b10 0x7f4e70158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e7559f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4e70152ef0 0x7f4e700c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e7559f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e7006de20 0x7f4e7006e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e7559f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4e700c8310 con 0x7f4e70152ef0 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e7559f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f4e700cc130 con 0x7f4e7006de20 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e7559f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700c5f80 con 0x7f4e70152b10 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4e70152ef0 0x7f4e700c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4e70152ef0 0x7f4e700c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50770/0 (socket says 172.21.15.123:50770) 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 -- 172.21.15.123:0/1995405032 learned_addr learned my addr 172.21.15.123:0/1995405032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6ffff640 1 --2- 172.21.15.123:0/1995405032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e70152b10 0x7f4e70158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e74d9e640 1 --2- 172.21.15.123:0/1995405032 >> v2:172.21.15.194:3300/0 conn(0x7f4e7006de20 0x7f4e7006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 -- 172.21.15.123:0/1995405032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e70152b10 msgr2=0x7f4e70158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 --2- 172.21.15.123:0/1995405032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e70152b10 0x7f4e70158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 -- 172.21.15.123:0/1995405032 >> v2:172.21.15.194:3300/0 conn(0x7f4e7006de20 msgr2=0x7f4e7006e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 --2- 172.21.15.123:0/1995405032 >> v2:172.21.15.194:3300/0 conn(0x7f4e7006de20 0x7f4e7006e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e6f7fe640 1 -- 172.21.15.123:0/1995405032 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700c6260 con 0x7f4e70152ef0 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.687+0000 7f4e74d9e640 1 --2- 172.21.15.123:0/1995405032 >> v2:172.21.15.194:3300/0 conn(0x7f4e7006de20 0x7f4e7006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.688+0000 7f4e6f7fe640 1 --2- 172.21.15.123:0/1995405032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e700c87a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e7006ecc0 tx=0x7f4e6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d4e672e377cb36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.688+0000 7f4e6effd640 1 -- 172.21.15.123:0/1995405032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64037070 con 0x7f4e70152ef0 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.688+0000 7f4e6effd640 1 -- 172.21.15.123:0/1995405032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e64032440 con 0x7f4e70152ef0 2024-09-19T09:52:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.688+0000 7f4e6effd640 1 -- 172.21.15.123:0/1995405032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64032810 con 0x7f4e70152ef0 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.688+0000 7f4e7559f640 1 -- 172.21.15.123:0/1995405032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 msgr2=0x7f4e700c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.688+0000 7f4e7559f640 1 --2- 172.21.15.123:0/1995405032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e700c87a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e7006ecc0 tx=0x7f4e6402a270 comp rx=0 tx=0).stop 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 -- 172.21.15.123:0/1995405032 shutdown_connections 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 --2- 172.21.15.123:0/1995405032 >> v2:172.21.15.194:3300/0 conn(0x7f4e7006de20 0x7f4e7006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 --2- 172.21.15.123:0/1995405032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e700c87a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 --2- 172.21.15.123:0/1995405032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e70152b10 0x7f4e70158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 -- 172.21.15.123:0/1995405032 >> 172.21.15.123:0/1995405032 conn(0x7f4e70067d70 msgr2=0x7f4e70070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 -- 172.21.15.123:0/1995405032 shutdown_connections 2024-09-19T09:52:38.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.689+0000 7f4e7559f640 1 -- 172.21.15.123:0/1995405032 wait complete. 2024-09-19T09:52:38.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.690+0000 7f4e7559f640 1 Processor -- start 2024-09-19T09:52:38.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.690+0000 7f4e7559f640 1 -- start start 2024-09-19T09:52:38.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.690+0000 7f4e7559f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7006de20 0x7f4e7014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.690+0000 7f4e7559f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70152b10 0x7f4e70148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e7559f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e70149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e7559f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700c7fa0 con 0x7f4e70152ef0 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e7559f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700c6820 con 0x7f4e70152b10 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e7559f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700c5c20 con 0x7f4e7006de20 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e70149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e70149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50780/0 (socket says 172.21.15.123:50780) 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 -- 172.21.15.123:0/3345559118 learned_addr learned my addr 172.21.15.123:0/3345559118 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e6f7fe640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70152b10 0x7f4e70148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e6ffff640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7006de20 0x7f4e7014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7006de20 msgr2=0x7f4e7014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7006de20 0x7f4e7014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70152b10 msgr2=0x7f4e70148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70152b10 0x7f4e70148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e70147970 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e74d9e640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e70149150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800cef0 tx=0x7f4e6800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6801a070 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6800d840 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e70149e90 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800dc30 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.691+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7014e5b0 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.692+0000 7f4e7559f640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 0x7f4e70155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.692+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701477d0 con 0x7f4e70149690 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.692+0000 7f4e6ffff640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 0x7f4e70155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e6801d070 con 0x7f4e70152ef0 2024-09-19T09:52:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6ffff640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e701f2440 con 0x7f4e70149690 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6ffff640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 0x7f4e70155560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e60010780 tx=0x7f4e60010c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4e5c06c2e0 0x7f4e5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f4e6808bbf0 con 0x7f4e70152ef0 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6f7fe640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4e5c06c2e0 0x7f4e5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60018020 con 0x7f4e70149690 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4e60004240 con 0x7f4e70149690 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 msgr2=0x7f4e70155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 0x7f4e70155560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e60010780 tx=0x7f4e60010c40 comp rx=0 tx=0).stop 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 msgr2=0x7f4e70155560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6f7fe640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4e5c06c2e0 0x7f4e5c06e7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e64034000 tx=0x7f4e6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.693+0000 7f4e6cff9640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70149690 0x7f4e70155560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.699+0000 7f4e7559f640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 0x7f4e70155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.699+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70147e50 con 0x7f4e70156310 2024-09-19T09:52:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.700+0000 7f4e6ffff640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 0x7f4e70155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.700+0000 7f4e6ffff640 1 -- 172.21.15.123:0/3345559118 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e70158c50 con 0x7f4e70156310 2024-09-19T09:52:38.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.700+0000 7f4e6ffff640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 0x7f4e70155aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e60010780 tx=0x7f4e600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.700+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60018030 con 0x7f4e70156310 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4720 (secure 0 0 0) 0x7f4e6000eb70 con 0x7f4e70156310 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 msgr2=0x7f4e70155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e6cff9640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 0x7f4e70155aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e60010780 tx=0x7f4e600046c0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e6cff9640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 msgr2=0x7f4e70155aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e6cff9640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e70156310 0x7f4e70155aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.705 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 62, 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 72769, 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 12, 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:38.706 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.707 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.708 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:38.709 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.710 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:38.711 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.713 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.714 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.715 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.716 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:52:38.717 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.718 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:38.719 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:38.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4e5c06c2e0 msgr2=0x7f4e5c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4e5c06c2e0 0x7f4e5c06e7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e64034000 tx=0x7f4e6402e000 comp rx=0 tx=0).stop 2024-09-19T09:52:38.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 msgr2=0x7f4e70149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 --2- 172.21.15.123:0/3345559118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e70152ef0 0x7f4e70149150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800cef0 tx=0x7f4e6800a710 comp rx=0 tx=0).stop 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e74d9e640 1 -- 172.21.15.123:0/3345559118 reap_dead start 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e74d9e640 1 -- 172.21.15.123:0/3345559118 reap_dead start 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 shutdown_connections 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 >> 172.21.15.123:0/3345559118 conn(0x7f4e70067d70 msgr2=0x7f4e700c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 shutdown_connections 2024-09-19T09:52:38.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.701+0000 7f4e7559f640 1 -- 172.21.15.123:0/3345559118 wait complete. 2024-09-19T09:52:38.721 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:52:38.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:52:38.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:52:38.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.865+0000 7f497dd66640 1 Processor -- start 2024-09-19T09:52:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.865+0000 7f497dd66640 1 -- start start 2024-09-19T09:52:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f497dd66640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f49781551d0 0x7f497815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f497dd66640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f49780ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f497dd66640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497815e620 con 0x7f497815f300 2024-09-19T09:52:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f497dd66640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f49780c5c50 con 0x7f49781551d0 2024-09-19T09:52:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f497dd66640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f497815b5f0 con 0x7f49781555b0 2024-09-19T09:52:38.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f4977fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f497815f300 0x7f497806c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42846/0 (socket says 172.21.15.123:42846) 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f4977fff640 1 -- 172.21.15.123:0/2936907921 learned_addr learned my addr 172.21.15.123:0/2936907921 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f49777fe640 1 --2- 172.21.15.123:0/2936907921 >> v2:172.21.15.194:3300/0 conn(0x7f49781551d0 0x7f497815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.866+0000 7f4976ffd640 1 --2- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f49780ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.867+0000 7f49767fc640 1 -- 172.21.15.123:0/2936907921 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620753799 0 0) 0x7f4970001110 con 0x7f497815f300 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.867+0000 7f49767fc640 1 -- 172.21.15.123:0/2936907921 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4964003520 con 0x7f497815f300 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.867+0000 7f49777fe640 1 -- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 msgr2=0x7f49780ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.867+0000 7f49777fe640 1 --2- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f49780ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.867+0000 7f49777fe640 1 -- 172.21.15.123:0/2936907921 >> v1:172.21.15.123:6789/0 conn(0x7f497815f300 legacy=0x7f497806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.867+0000 7f49777fe640 1 -- 172.21.15.123:0/2936907921 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497815b8d0 con 0x7f49781551d0 2024-09-19T09:52:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f49777fe640 1 --2- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f497815edc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4968009d90 tx=0x7f496802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ca8712e5aa7df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f49767fc640 1 -- 172.21.15.123:0/2936907921 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968007740 con 0x7f49781551d0 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f49767fc640 1 -- 172.21.15.123:0/2936907921 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49680078e0 con 0x7f49781551d0 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f49767fc640 1 -- 172.21.15.123:0/2936907921 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968007cb0 con 0x7f49781551d0 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 -- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 msgr2=0x7f497815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 --2- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f497815edc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4968009d90 tx=0x7f496802a6f0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 -- 172.21.15.123:0/2936907921 shutdown_connections 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 --2- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f49780ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 --2- 172.21.15.123:0/2936907921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f497815edc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 -- 172.21.15.123:0/2936907921 >> 172.21.15.123:0/2936907921 conn(0x7f49780d0e10 msgr2=0x7f49780d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 -- 172.21.15.123:0/2936907921 shutdown_connections 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.868+0000 7f497dd66640 1 -- 172.21.15.123:0/2936907921 wait complete. 2024-09-19T09:52:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.870+0000 7f497dd66640 1 Processor -- start 2024-09-19T09:52:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.870+0000 7f497dd66640 1 -- start start 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f497dd66640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f4978156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f497dd66640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f4978156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f497dd66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497815f300 0x7f49781582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f497dd66640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f497815e8a0 con 0x7f497815f300 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f497dd66640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f497815be90 con 0x7f49781551d0 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f497dd66640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f497806cde0 con 0x7f49781555b0 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497815f300 0x7f49781582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f49777fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f4978156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4976ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f4978156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497815f300 0x7f49781582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50784/0 (socket says 172.21.15.123:50784) 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f49777fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f4978156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:40808/0 (socket says 172.21.15.123:40808) 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 -- 172.21.15.123:0/1320944979 learned_addr learned my addr 172.21.15.123:0/1320944979 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4976ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f4978156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:42010/0 (socket says 172.21.15.123:42010) 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 msgr2=0x7f4978156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781555b0 0x7f4978156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 msgr2=0x7f4978156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49781551d0 0x7f4978156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497814fa60 con 0x7f497815f300 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.871+0000 7f4977fff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497815f300 0x7f49781582a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f497000c3c0 tx=0x7f497000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.872+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970017070 con 0x7f497815f300 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.872+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970005ce0 con 0x7f497815f300 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.872+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700072d0 con 0x7f497815f300 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.872+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4978155e80 con 0x7f497815f300 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.872+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497814f780 con 0x7f497815f300 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.873+0000 7f497dd66640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 0x7f49781f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.873+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f497814f250 con 0x7f49781f10d0 2024-09-19T09:52:38.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.873+0000 7f49777fe640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 0x7f49781f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.873+0000 7f49777fe640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49781f14b0 con 0x7f49781f10d0 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.873+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f497001a070 con 0x7f497815f300 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.873+0000 7f49777fe640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 0x7f49781f1800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f497808e7c0 tx=0x7f4968004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f495806c330 0x7f495806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f497008a560 con 0x7f497815f300 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f4976ffd640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f495806c330 0x7f495806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968009450 con 0x7f49781f10d0 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f496803c830 con 0x7f49781f10d0 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 msgr2=0x7f49781f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 0x7f49781f1800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f497808e7c0 tx=0x7f4968004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 msgr2=0x7f49781f1800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:38.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f496ffff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f10d0 0x7f49781f1800 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f497808e7c0 tx=0x7f4968004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.874+0000 7f4976ffd640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f495806c330 0x7f495806e7f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49780c6510 tx=0x7f4960009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.880+0000 7f497dd66640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 0x7f497814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.880+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f49780c5f80 con 0x7f49781f1d40 2024-09-19T09:52:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.881+0000 7f49777fe640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 0x7f497814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.881+0000 7f49777fe640 1 -- 172.21.15.123:0/1320944979 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f497815a320 con 0x7f49781f1d40 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.881+0000 7f49777fe640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 0x7f497814e540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f497814f3d0 tx=0x7f4968030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496804a040 con 0x7f49781f1d40 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5198 (secure 0 0 0) 0x7f496804ba20 con 0x7f49781f1d40 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 msgr2=0x7f497814e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f496ffff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 0x7f497814e540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f497814f3d0 tx=0x7f4968030000 comp rx=0 tx=0).stop 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f496ffff640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 msgr2=0x7f497814e540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f496ffff640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f49781f1d40 0x7f497814e540 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 62, 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 368198, 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 13, 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:38.902 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f495806c330 msgr2=0x7f495806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f495806c330 0x7f495806e7f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49780c6510 tx=0x7f4960009190 comp rx=0 tx=0).stop 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497815f300 msgr2=0x7f49781582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 --2- 172.21.15.123:0/1320944979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497815f300 0x7f49781582a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f497000c3c0 tx=0x7f497000c880 comp rx=0 tx=0).stop 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f4977fff640 1 -- 172.21.15.123:0/1320944979 reap_dead start 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f4977fff640 1 -- 172.21.15.123:0/1320944979 reap_dead start 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 shutdown_connections 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 >> 172.21.15.123:0/1320944979 conn(0x7f49780d0e10 msgr2=0x7f49780cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 shutdown_connections 2024-09-19T09:52:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:38.882+0000 7f497dd66640 1 -- 172.21.15.123:0/1320944979 wait complete. 2024-09-19T09:52:38.905 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:52:38.905 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-19T09:52:38.905 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-19T09:52:38.905 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-19T09:52:38.905 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-19T09:52:38.905 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T09:52:38.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:52:38.919 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T09:52:38.919 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-19T09:52:38.919 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:39.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.013+0000 7f498375f640 1 Processor -- start 2024-09-19T09:52:39.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.014+0000 7f498375f640 1 -- start start 2024-09-19T09:52:39.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.014+0000 7f498375f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c151fc0 0x7f497c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:39.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.014+0000 7f498375f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f497c1523a0 0x7f497c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:39.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.014+0000 7f498375f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c157e20 con 0x7f497c072770 2024-09-19T09:52:39.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.014+0000 7f498375f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f497c158e20 con 0x7f497c1523a0 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.014+0000 7f498375f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f497c072100 con 0x7f497c151fc0 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f49814fb640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c151fc0 msgr2=0x7f497c0c88b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f49814fb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c151fc0 0x7f497c0c88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4981cfc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f497c072770 0x7f497c0710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42852/0 (socket says 172.21.15.123:42852) 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4981cfc640 1 -- 172.21.15.123:0/4061109743 learned_addr learned my addr 172.21.15.123:0/4061109743 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4980cfa640 1 --2- 172.21.15.123:0/4061109743 >> v2:172.21.15.194:3300/0 conn(0x7f497c1523a0 0x7f497c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f497bfff640 1 -- 172.21.15.123:0/4061109743 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779664632 0 0) 0x7f497c157e20 con 0x7f497c072770 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f497bfff640 1 -- 172.21.15.123:0/4061109743 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4964003520 con 0x7f497c072770 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4980cfa640 1 -- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c151fc0 msgr2=0x7f497c0c88b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4980cfa640 1 --2- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c151fc0 0x7f497c0c88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4980cfa640 1 -- 172.21.15.123:0/4061109743 >> v1:172.21.15.123:6789/0 conn(0x7f497c072770 legacy=0x7f497c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f497bfff640 1 -- 172.21.15.123:0/4061109743 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 543167484 0 0) 0x7f4964003520 con 0x7f497c072770 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.015+0000 7f4980cfa640 1 -- 172.21.15.123:0/4061109743 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c0723e0 con 0x7f497c1523a0 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.016+0000 7f4980cfa640 1 --2- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c1523a0 0x7f497c1588e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4970009d90 tx=0x7f497002a570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e50aeee14d69ed1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.016+0000 7f497bfff640 1 -- 172.21.15.123:0/4061109743 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c001670 con 0x7f497c1523a0 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.016+0000 7f497bfff640 1 -- 172.21.15.123:0/4061109743 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970007540 con 0x7f497c1523a0 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.016+0000 7f497bfff640 1 -- 172.21.15.123:0/4061109743 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700078f0 con 0x7f497c1523a0 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 -- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c1523a0 msgr2=0x7f497c1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 --2- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c1523a0 0x7f497c1588e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4970009d90 tx=0x7f497002a570 comp rx=0 tx=0).stop 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 -- 172.21.15.123:0/4061109743 shutdown_connections 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 --2- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c1523a0 0x7f497c1588e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 --2- 172.21.15.123:0/4061109743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c151fc0 0x7f497c0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 -- 172.21.15.123:0/4061109743 >> 172.21.15.123:0/4061109743 conn(0x7f497c06ec90 msgr2=0x7f497c06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 -- 172.21.15.123:0/4061109743 shutdown_connections 2024-09-19T09:52:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.017+0000 7f498375f640 1 -- 172.21.15.123:0/4061109743 wait complete. 2024-09-19T09:52:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.018+0000 7f498375f640 1 Processor -- start 2024-09-19T09:52:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.018+0000 7f498375f640 1 -- start start 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.018+0000 7f498375f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 0x7f497c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.018+0000 7f498375f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c151fc0 0x7f497c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.018+0000 7f498375f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c06f320 0x7f497c1eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f498375f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f497c071800 con 0x7f497c072770 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f498375f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1583c0 con 0x7f497c151fc0 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f498375f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f497c071980 con 0x7f497c06f320 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 0x7f497c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f4981cfc640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c06f320 msgr2=0x7f497c1eea20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 0x7f497c0cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50912/0 (socket says 172.21.15.123:50912) 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 -- 172.21.15.123:0/16004810 learned_addr learned my addr 172.21.15.123:0/16004810 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f4981cfc640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c06f320 0x7f497c1eea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f4980cfa640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c151fc0 0x7f497c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 -- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c06f320 msgr2=0x7f497c1eea20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c06f320 0x7f497c1eea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 -- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c151fc0 msgr2=0x7f497c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c151fc0 0x7f497c0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 -- 172.21.15.123:0/16004810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c14dc00 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f49814fb640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 0x7f497c0cce60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f497400b550 tx=0x7f497400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974013020 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974003de0 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c0cc050 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740052b0 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.019+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c0cb0c0 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.020+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c15b3d0 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.021+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4974016020 con 0x7f497c072770 2024-09-19T09:52:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.021+0000 7f4979ffb640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f496806c260 0x7f496806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.021+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f497408b100 con 0x7f497c072770 2024-09-19T09:52:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.021+0000 7f4980cfa640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f496806c260 0x7f496806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.022+0000 7f4980cfa640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f496806c260 0x7f496806e720 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4970034000 tx=0x7f497002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.026+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f497401d020 con 0x7f497c072770 2024-09-19T09:52:39.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.341+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f497c158a10 con 0x7f497c072770 2024-09-19T09:52:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.342+0000 7f4979ffb640 1 -- 172.21.15.123:0/16004810 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f4974059880 con 0x7f497c072770 2024-09-19T09:52:39.344 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f496806c260 msgr2=0x7f496806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f496806c260 0x7f496806e720 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4970034000 tx=0x7f497002f000 comp rx=0 tx=0).stop 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 msgr2=0x7f497c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 0x7f497c0cce60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f497400b550 tx=0x7f497400ba10 comp rx=0 tx=0).stop 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 shutdown_connections 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f496806c260 0x7f496806e720 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4970034000 tx=0x7f497002f000 comp rx=0 tx=0).stop 2024-09-19T09:52:39.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c06f320 0x7f497c1eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c151fc0 0x7f497c0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 --2- 172.21.15.123:0/16004810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f497c072770 0x7f497c0cce60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.345+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 >> 172.21.15.123:0/16004810 conn(0x7f497c06ec90 msgr2=0x7f497c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.346+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 shutdown_connections 2024-09-19T09:52:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:39.346+0000 7f498375f640 1 -- 172.21.15.123:0/16004810 wait complete. 2024-09-19T09:52:42.362 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.461+0000 7f3c75b1f640 1 Processor -- start 2024-09-19T09:52:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c75b1f640 1 -- start start 2024-09-19T09:52:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c75b1f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 0x7f3c701647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c75b1f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c700c8700 con 0x7f3c70152e00 2024-09-19T09:52:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c75b1f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c700c89e0 con 0x7f3c7006de20 2024-09-19T09:52:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c75b1f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7015c440 con 0x7f3c7015ce90 2024-09-19T09:52:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c6ffff640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 msgr2=0x7f3c701647e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c6f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c70152e00 0x7f3c701598d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42866/0 (socket says 172.21.15.123:42866) 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c6f7fe640 1 -- 172.21.15.123:0/3768321139 learned_addr learned my addr 172.21.15.123:0/3768321139 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.462+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 0x7f3c701647e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374328444 0 0) 0x7f3c700c8700 con 0x7f3c70152e00 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c5c003520 con 0x7f3c70152e00 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2121537453 0 0) 0x7f3c5c003520 con 0x7f3c70152e00 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 msgr2=0x7f3c701647e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 0x7f3c701647e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 >> v1:172.21.15.194:6789/0 conn(0x7f3c7006de20 legacy=0x7f3c70073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c700c8cc0 con 0x7f3c70152e00 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f3c60001a10 con 0x7f3c70152e00 2024-09-19T09:52:42.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 >> v1:172.21.15.123:6789/0 conn(0x7f3c70152e00 legacy=0x7f3c701598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0039e0 0x7f3c5c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 0x7f3c5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c004d90 0x7f3c5c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7015c440 con 0x7f3c5c004d90 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c00bc30 con 0x7f3c5c0039e0 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c00be30 con 0x7f3c7015ce90 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6effd640 1 -- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 msgr2=0x7f3c5c004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c004d90 0x7f3c5c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6effd640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 0x7f3c5c004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6f7fe640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0039e0 0x7f3c5c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6ffff640 1 -- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 msgr2=0x7f3c5c004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c7015ce90 0x7f3c5c004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6ffff640 1 -- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0039e0 msgr2=0x7f3c5c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c0039e0 0x7f3c5c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.463+0000 7f3c6ffff640 1 -- 172.21.15.123:0/3768321139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c003520 con 0x7f3c5c004d90 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.464+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c004d90 0x7f3c5c005210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009900 tx=0x7f3c5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414ccd31ad34ee63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.464+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68009500 con 0x7f3c5c004d90 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.464+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c6802e070 con 0x7f3c5c004d90 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.464+0000 7f3c6e7fc640 1 -- 172.21.15.123:0/3768321139 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68003df0 con 0x7f3c5c004d90 2024-09-19T09:52:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c75b1f640 1 -- 172.21.15.123:0/3768321139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c004d90 msgr2=0x7f3c5c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/3768321139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c5c004d90 0x7f3c5c005210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009900 tx=0x7f3c5c005830 comp rx=0 tx=0).stop 2024-09-19T09:52:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c6ffff640 1 -- 172.21.15.123:0/3768321139 reap_dead start 2024-09-19T09:52:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c75b1f640 1 -- 172.21.15.123:0/3768321139 shutdown_connections 2024-09-19T09:52:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c75b1f640 1 -- 172.21.15.123:0/3768321139 >> 172.21.15.123:0/3768321139 conn(0x7f3c700ce9b0 msgr2=0x7f3c700ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c75b1f640 1 -- 172.21.15.123:0/3768321139 shutdown_connections 2024-09-19T09:52:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.465+0000 7f3c75b1f640 1 -- 172.21.15.123:0/3768321139 wait complete. 2024-09-19T09:52:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.466+0000 7f3c75b1f640 1 Processor -- start 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.466+0000 7f3c75b1f640 1 -- start start 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c75b1f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c004d90 0x7f3c7014b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c75b1f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c701e4f80 0x7f3c70146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c75b1f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 0x7f3c70142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c75b1f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7015d320 con 0x7f3c70146d50 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c75b1f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7015ca00 con 0x7f3c5c004d90 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c75b1f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3c701531e0 con 0x7f3c701e4f80 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 0x7f3c70142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6effd640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c701e4f80 msgr2=0x7f3c70146810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 0x7f3c70142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50932/0 (socket says 172.21.15.123:50932) 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 -- 172.21.15.123:0/743090129 learned_addr learned my addr 172.21.15.123:0/743090129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6effd640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c701e4f80 0x7f3c70146810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6f7fe640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c004d90 0x7f3c7014b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 -- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c701e4f80 msgr2=0x7f3c70146810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c701e4f80 0x7f3c70146810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 -- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c004d90 msgr2=0x7f3c7014b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c004d90 0x7f3c7014b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 -- 172.21.15.123:0/743090129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7014eb80 con 0x7f3c70146d50 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c6ffff640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 0x7f3c70142390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009900 tx=0x7f3c68005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.467+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68043070 con 0x7f3c70146d50 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.468+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c68039070 con 0x7f3c70146d50 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.468+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68006dd0 con 0x7f3c70146d50 2024-09-19T09:52:42.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.468+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7014e8e0 con 0x7f3c70146d50 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.468+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c701f1c00 con 0x7f3c70146d50 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.469+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c700c5990 con 0x7f3c70146d50 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.469+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3c68046070 con 0x7f3c70146d50 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.469+0000 7f3c67fff640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3c5006c260 0x7f3c5006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.469+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f3c680aa9f0 con 0x7f3c70146d50 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.469+0000 7f3c6f7fe640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3c5006c260 0x7f3c5006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.470+0000 7f3c6f7fe640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3c5006c260 0x7f3c5006e720 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3c60000f80 tx=0x7f3c60006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.474+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3c680790e0 con 0x7f3c70146d50 2024-09-19T09:52:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.824+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c701f1dd0 con 0x7f3c70146d50 2024-09-19T09:52:42.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.826+0000 7f3c67fff640 1 -- 172.21.15.123:0/743090129 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f3c680789e0 con 0x7f3c70146d50 2024-09-19T09:52:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:42.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.828+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3c5006c260 msgr2=0x7f3c5006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.828+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3c5006c260 0x7f3c5006e720 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3c60000f80 tx=0x7f3c60006040 comp rx=0 tx=0).stop 2024-09-19T09:52:42.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 msgr2=0x7f3c70142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 0x7f3c70142390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009900 tx=0x7f3c68005a10 comp rx=0 tx=0).stop 2024-09-19T09:52:42.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 shutdown_connections 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c70146d50 0x7f3c70142390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3c5006c260 0x7f3c5006e720 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c701e4f80 0x7f3c70146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 --2- 172.21.15.123:0/743090129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c5c004d90 0x7f3c7014b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 >> 172.21.15.123:0/743090129 conn(0x7f3c700ce9b0 msgr2=0x7f3c700c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 shutdown_connections 2024-09-19T09:52:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:42.829+0000 7f3c75b1f640 1 -- 172.21.15.123:0/743090129 wait complete. 2024-09-19T09:52:45.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:45.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.940+0000 7f19d1827640 1 Processor -- start 2024-09-19T09:52:45.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.940+0000 7f19d1827640 1 -- start start 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19d1827640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19d1827640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f19cc0cbf00 0x7f19cc0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19d1827640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc15c240 con 0x7f19cc0c7f40 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19d1827640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f19cc155a30 con 0x7f19cc0cbf00 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19d1827640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f19cc15b3e0 con 0x7f19cc155650 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19caffd640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 msgr2=0x7f19cc0cc850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19caffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc0cc850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19cb7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f19cc0cbf00 0x7f19cc0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19ca7fc640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f19cc0c7f40 0x7f19cc0cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:49854/0 (socket says 172.21.15.123:49854) 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19cb7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f19cc0cbf00 0x7f19cc0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55912/0 (socket says 172.21.15.123:55912) 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.941+0000 7f19ca7fc640 1 -- 172.21.15.123:0/2947308200 learned_addr learned my addr 172.21.15.123:0/2947308200 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.942+0000 7f19cb7fe640 1 -- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 msgr2=0x7f19cc0cc850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.942+0000 7f19cb7fe640 1 --2- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc0cc850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.942+0000 7f19cb7fe640 1 -- 172.21.15.123:0/2947308200 >> v1:172.21.15.194:6789/0 conn(0x7f19cc0c7f40 legacy=0x7f19cc0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.942+0000 7f19cb7fe640 1 -- 172.21.15.123:0/2947308200 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc15b6c0 con 0x7f19cc0cbf00 2024-09-19T09:52:45.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.942+0000 7f19cb7fe640 1 --2- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc0ccd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009d90 tx=0x7f19c402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e4d33184377b5e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:45.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.942+0000 7f19c9ffb640 1 -- 172.21.15.123:0/2947308200 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4007740 con 0x7f19cc0cbf00 2024-09-19T09:52:45.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19c9ffb640 1 -- 172.21.15.123:0/2947308200 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c40078e0 con 0x7f19cc0cbf00 2024-09-19T09:52:45.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19c9ffb640 1 -- 172.21.15.123:0/2947308200 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4007cb0 con 0x7f19cc0cbf00 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 -- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 msgr2=0x7f19cc0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 --2- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc0ccd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009d90 tx=0x7f19c402a680 comp rx=0 tx=0).stop 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 -- 172.21.15.123:0/2947308200 shutdown_connections 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 --2- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc0ccd90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 --2- 172.21.15.123:0/2947308200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 -- 172.21.15.123:0/2947308200 >> 172.21.15.123:0/2947308200 conn(0x7f19cc0cd5c0 msgr2=0x7f19cc0cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 -- 172.21.15.123:0/2947308200 shutdown_connections 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.943+0000 7f19d1827640 1 -- 172.21.15.123:0/2947308200 wait complete. 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.944+0000 7f19d1827640 1 Processor -- start 2024-09-19T09:52:45.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.944+0000 7f19d1827640 1 -- start start 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19d1827640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 0x7f19cc1e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19d1827640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc1e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19d1827640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19d1827640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc15bf60 con 0x7f19cc0c7f40 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19d1827640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc15bc80 con 0x7f19cc0cbf00 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19d1827640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f19cc0ce430 con 0x7f19cc155650 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19caffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 0x7f19cc1e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19caffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 0x7f19cc1e5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55088/0 (socket says 172.21.15.123:55088) 2024-09-19T09:52:45.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19caffd640 1 -- 172.21.15.123:0/264196927 learned_addr learned my addr 172.21.15.123:0/264196927 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19cb7fe640 1 -- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 msgr2=0x7f19cc150ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19cb7fe640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc150ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.945+0000 7f19ca7fc640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc1e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19caffd640 1 -- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 msgr2=0x7f19cc150ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19caffd640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc150ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19caffd640 1 -- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 msgr2=0x7f19cc1e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19caffd640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc1e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19caffd640 1 -- 172.21.15.123:0/264196927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc1e4970 con 0x7f19cc0c7f40 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19ca7fc640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc1e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19caffd640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 0x7f19cc1e5250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00b550 tx=0x7f19bc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc013020 con 0x7f19cc0c7f40 2024-09-19T09:52:45.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc003de0 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc1e5790 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0052b0 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.946+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19cc1e4690 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.947+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19cc0d0460 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.947+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f19bc016020 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.948+0000 7f19b3fff640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19b806c260 0x7f19b806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.948+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f19bc08b180 con 0x7f19cc0c7f40 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.948+0000 7f19ca7fc640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19b806c260 0x7f19b806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:45.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.948+0000 7f19ca7fc640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19b806c260 0x7f19b806e720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19cc150ad0 tx=0x7f19c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:45.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:45.952+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f19bc01d020 con 0x7f19cc0c7f40 2024-09-19T09:52:46.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.184+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f19cc0d07f0 con 0x7f19cc0c7f40 2024-09-19T09:52:46.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.185+0000 7f19b3fff640 1 -- 172.21.15.123:0/264196927 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f19bc059900 con 0x7f19cc0c7f40 2024-09-19T09:52:46.189 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19b806c260 msgr2=0x7f19b806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19b806c260 0x7f19b806e720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19cc150ad0 tx=0x7f19c0009040 comp rx=0 tx=0).stop 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 msgr2=0x7f19cc1e5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 0x7f19cc1e5250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00b550 tx=0x7f19bc00ba10 comp rx=0 tx=0).stop 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 shutdown_connections 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f19b806c260 0x7f19b806e720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19cc155650 0x7f19cc150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc0cbf00 0x7f19cc1e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 --2- 172.21.15.123:0/264196927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19cc0c7f40 0x7f19cc1e5250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 >> 172.21.15.123:0/264196927 conn(0x7f19cc0cd5c0 msgr2=0x7f19cc0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 shutdown_connections 2024-09-19T09:52:46.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:46.187+0000 7f19d1827640 1 -- 172.21.15.123:0/264196927 wait complete. 2024-09-19T09:52:49.201 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:52:49.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 Processor -- start 2024-09-19T09:52:49.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 -- start start 2024-09-19T09:52:49.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 0x7fe3e80cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e815c240 con 0x7fe3e8155650 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e8155a30 con 0x7fe3e80c8400 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.308+0000 7fe3ed54b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e815b3e0 con 0x7fe3e80c7f40 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3de7fc640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 msgr2=0x7fe3e80cb7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3de7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 0x7fe3e80cb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55926/0 (socket says 172.21.15.123:55926) 2024-09-19T09:52:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 learned_addr learned my addr 172.21.15.123:0/3244874015 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e6ffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe3e8155650 0x7fe3e80cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:49860/0 (socket says 172.21.15.123:49860) 2024-09-19T09:52:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:52:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.309+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 msgr2=0x7fe3e80cb7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 0x7fe3e80cb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.510+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:52:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 msgr2=0x7fe3e80cb7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 0x7fe3e80cb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:52:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T09:52:49.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:49.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:49.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:49.911+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:52:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 msgr2=0x7fe3e80cb7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:50.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 0x7fe3e80cb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:52:50.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:50.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:50.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:50.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:50.712+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:52:52.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 msgr2=0x7fe3e80cb7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3e80c7f40 0x7fe3e80cb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 msgr2=0x7fe3e80cbd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.194:3300/0 conn(0x7fe3e80c8400 0x7fe3e80cbd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 -- 172.21.15.123:0/3244874015 >> v1:172.21.15.194:6789/0 conn(0x7fe3e8155650 legacy=0x7fe3e80cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 -- 172.21.15.123:0/3244874015 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e815b6c0 con 0x7fe3c80036e0 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3e57fa640 1 -- 172.21.15.123:0/3244874015 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e8155a30 con 0x7fe3c8007370 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:52.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.309+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:52.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.510+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.510+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:52.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.510+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:52.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.510+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:52.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.510+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:52:52.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.911+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.911+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:52:52.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.911+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:52:52.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.911+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:52:52.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.911+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:52:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.976+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414895362 0 0) 0x7fe3e815b6c0 con 0x7fe3c80036e0 2024-09-19T09:52:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.976+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3d4003520 con 0x7fe3c80036e0 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1030652146 0 0) 0x7fe3d4003520 con 0x7fe3c80036e0 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 msgr2=0x7fe3c8009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 --2- 172.21.15.123:0/3244874015 >> v2:172.21.15.123:3300/0 conn(0x7fe3c8007370 0x7fe3c8009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c800af30 con 0x7fe3c80036e0 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fe3d80016b0 con 0x7fe3c80036e0 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 >> v1:172.21.15.123:6789/0 conn(0x7fe3c80036e0 legacy=0x7fe3c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 reap_dead start 2024-09-19T09:52:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 0x7fe3d4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e8155a30 con 0x7fe3d40039b0 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d400c140 con 0x7fe3d4005210 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d400c340 con 0x7fe3d4004800 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3de7fc640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 msgr2=0x7fe3d4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3de7fc640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3d4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 msgr2=0x7fe3d4004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3d4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 msgr2=0x7fe3d4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 0x7fe3d4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.978+0000 7fe3e77fe640 1 -- 172.21.15.123:0/3244874015 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d4003520 con 0x7fe3d4005210 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.979+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3d400b9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8158f00 tx=0x7fe3d4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a97762af1404ce9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.980+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0031070 con 0x7fe3d4005210 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.980+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e002b510 con 0x7fe3d4005210 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.980+0000 7fe3e67fc640 1 -- 172.21.15.123:0/3244874015 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009700 con 0x7fe3d4005210 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.980+0000 7fe3ed54b640 1 -- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 msgr2=0x7fe3d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.980+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3d400b9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8158f00 tx=0x7fe3d4005830 comp rx=0 tx=0).stop 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 -- 172.21.15.123:0/3244874015 shutdown_connections 2024-09-19T09:52:52.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3d400b9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3d4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/3244874015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 0x7fe3d4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 -- 172.21.15.123:0/3244874015 >> 172.21.15.123:0/3244874015 conn(0x7fe3e80cd5c0 msgr2=0x7fe3e80cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 -- 172.21.15.123:0/3244874015 shutdown_connections 2024-09-19T09:52:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.981+0000 7fe3ed54b640 1 -- 172.21.15.123:0/3244874015 wait complete. 2024-09-19T09:52:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.982+0000 7fe3ed54b640 1 Processor -- start 2024-09-19T09:52:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.982+0000 7fe3ed54b640 1 -- start start 2024-09-19T09:52:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3ed54b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 0x7fe3e80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3ed54b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3e80c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3ed54b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3e81e3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3ed54b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e815bf60 con 0x7fe3d40039b0 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3ed54b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e815bc80 con 0x7fe3d4005210 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3ed54b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80ce430 con 0x7fe3d4004800 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3de7fc640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 msgr2=0x7fe3e80c6a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.983+0000 7fe3de7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3e80c6a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3e81e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3e81e3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.123:55972/0 (socket says 172.21.15.123:55972) 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 -- 172.21.15.123:0/1099200754 learned_addr learned my addr 172.21.15.123:0/1099200754 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 -- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 msgr2=0x7fe3e80c6a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3e80c6a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 -- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 msgr2=0x7fe3e80c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 0x7fe3e80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 -- 172.21.15.123:0/1099200754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e81f1730 con 0x7fe3d4005210 2024-09-19T09:52:52.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.984+0000 7fe3e77fe640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3e81e3790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3e002b200 tx=0x7fe3e0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.985+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009700 con 0x7fe3d4005210 2024-09-19T09:52:52.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.985+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0046070 con 0x7fe3d4005210 2024-09-19T09:52:52.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.985+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00130b0 con 0x7fe3d4005210 2024-09-19T09:52:52.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.985+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e8158430 con 0x7fe3d4005210 2024-09-19T09:52:52.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.985+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e80c4a10 con 0x7fe3d4005210 2024-09-19T09:52:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.986+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e80c4c10 con 0x7fe3d4005210 2024-09-19T09:52:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.986+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe3e0040a80 con 0x7fe3d4005210 2024-09-19T09:52:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.987+0000 7fe3dffff640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe3c806cab0 0x7fe3c806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.987+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fe3e00ac550 con 0x7fe3d4005210 2024-09-19T09:52:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.987+0000 7fe3e6ffd640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe3c806cab0 0x7fe3c806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.988+0000 7fe3e6ffd640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe3c806cab0 0x7fe3c806ef70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001240 tx=0x7fe3d8001580 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:52.993+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe3e80c4c10 con 0x7fe3d4005210 2024-09-19T09:52:53.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.227+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe3e80cb190 con 0x7fe3d4005210 2024-09-19T09:52:53.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.227+0000 7fe3dffff640 1 -- 172.21.15.123:0/1099200754 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fe3e007ac20 con 0x7fe3d4005210 2024-09-19T09:52:53.229 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":66,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe3c806cab0 msgr2=0x7fe3c806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe3c806cab0 0x7fe3c806ef70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001240 tx=0x7fe3d8001580 comp rx=0 tx=0).stop 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 msgr2=0x7fe3e81e3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3e81e3790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3e002b200 tx=0x7fe3e0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 shutdown_connections 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3d4005210 0x7fe3e81e3790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe3c806cab0 0x7fe3c806ef70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3d4004800 0x7fe3e80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 --2- 172.21.15.123:0/1099200754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3d40039b0 0x7fe3e80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 >> 172.21.15.123:0/1099200754 conn(0x7fe3e80cd5c0 msgr2=0x7fe3e80cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.229+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 shutdown_connections 2024-09-19T09:52:53.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.230+0000 7fe3ed54b640 1 -- 172.21.15.123:0/1099200754 wait complete. 2024-09-19T09:52:53.243 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-19T09:52:53.243 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-19T09:52:53.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:52:53.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.342+0000 7fe5a2918640 1 Processor -- start 2024-09-19T09:52:53.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.342+0000 7fe5a2918640 1 -- start start 2024-09-19T09:52:53.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe5a2918640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe59c14edd0 0x7fe59c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe5a2918640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59c0720d0 con 0x7fe59c0c9a30 2024-09-19T09:52:53.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe5a2918640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59c157e10 con 0x7fe59c0724a0 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe5a2918640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe59c071110 con 0x7fe59c14edd0 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe59c14edd0 0x7fe59c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe59c14edd0 0x7fe59c15b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41418/0 (socket says 172.21.15.123:41418) 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59bfff640 1 -- 172.21.15.123:0/1459752533 learned_addr learned my addr 172.21.15.123:0/1459752533 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59b7fe640 1 --1- 172.21.15.123:0/1459752533 >> v1:172.21.15.123:6789/0 conn(0x7fe59c0c9a30 0x7fe59c0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51912/0 (socket says 172.21.15.123:51912) 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59bfff640 1 -- 172.21.15.123:0/1459752533 >> v1:172.21.15.194:6789/0 conn(0x7fe59c0724a0 legacy=0x7fe59c1626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59bfff640 1 -- 172.21.15.123:0/1459752533 >> v1:172.21.15.123:6789/0 conn(0x7fe59c0c9a30 legacy=0x7fe59c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59bfff640 1 -- 172.21.15.123:0/1459752533 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59c071360 con 0x7fe59c14edd0 2024-09-19T09:52:53.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.343+0000 7fe59affd640 1 -- 172.21.15.123:0/1459752533 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173769221 0 0) 0x7fe59c0720d0 con 0x7fe59c0c9a30 2024-09-19T09:52:53.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe59bfff640 1 --2- 172.21.15.123:0/1459752533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c14edd0 0x7fe59c15b380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00bb40 tx=0x7fe58c02c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e364185373657e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe59affd640 1 -- 172.21.15.123:0/1459752533 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c034620 con 0x7fe59c14edd0 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe59affd640 1 -- 172.21.15.123:0/1459752533 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c0347c0 con 0x7fe59c14edd0 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe59affd640 1 -- 172.21.15.123:0/1459752533 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c034b90 con 0x7fe59c14edd0 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 -- 172.21.15.123:0/1459752533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c14edd0 msgr2=0x7fe59c15b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 --2- 172.21.15.123:0/1459752533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c14edd0 0x7fe59c15b380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00bb40 tx=0x7fe58c02c870 comp rx=0 tx=0).stop 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 -- 172.21.15.123:0/1459752533 shutdown_connections 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 --2- 172.21.15.123:0/1459752533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c14edd0 0x7fe59c15b380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 -- 172.21.15.123:0/1459752533 >> 172.21.15.123:0/1459752533 conn(0x7fe59c06ed00 msgr2=0x7fe59c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 -- 172.21.15.123:0/1459752533 shutdown_connections 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.344+0000 7fe5a2918640 1 -- 172.21.15.123:0/1459752533 wait complete. 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 Processor -- start 2024-09-19T09:52:53.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 -- start start 2024-09-19T09:52:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0724a0 0x7fe59c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe59c0c9a30 0x7fe59c0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe59c14edd0 0x7fe59c1f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c1583b0 con 0x7fe59c0724a0 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c1580d0 con 0x7fe59c0c9a30 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.346+0000 7fe5a2918640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fe59c071c80 con 0x7fe59c14edd0 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0724a0 0x7fe59c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0724a0 0x7fe59c154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41426/0 (socket says 172.21.15.123:41426) 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 -- 172.21.15.123:0/476812189 learned_addr learned my addr 172.21.15.123:0/476812189 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe5a0eb5640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe59c14edd0 msgr2=0x7fe59c1f4dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe5a0eb5640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe59c14edd0 0x7fe59c1f4dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59b7fe640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe59c0c9a30 0x7fe59c0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe59c14edd0 msgr2=0x7fe59c1f4dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe59c14edd0 0x7fe59c1f4dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe59c0c9a30 msgr2=0x7fe59c0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe59c0c9a30 0x7fe59c0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59c15b0f0 con 0x7fe59c0724a0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59b7fe640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe59c0c9a30 0x7fe59c0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe59bfff640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0724a0 0x7fe59c154050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe58c000c00 tx=0x7fe58c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c033c00 con 0x7fe59c0724a0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c033dc0 con 0x7fe59c0724a0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59c158bb0 con 0x7fe59c0724a0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c004270 con 0x7fe59c0724a0 2024-09-19T09:52:53.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.347+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59c154a10 con 0x7fe59c0724a0 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.348+0000 7fe5a2918640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 0x7fe59c1f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.348+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c0c4380 con 0x7fe59c0c3440 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.348+0000 7fe59b7fe640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 0x7fe59c1f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.348+0000 7fe59b7fe640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe59c15b380 con 0x7fe59c0c3440 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe59b7fe640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 0x7fe59c1f4660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe59c157b60 tx=0x7fe59000d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe58c003610 con 0x7fe59c0724a0 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe58806c260 0x7fe58806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fe58c0acd50 con 0x7fe59c0724a0 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe5a0eb5640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe58806c260 0x7fe58806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590018070 con 0x7fe59c0c3440 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe5900074e0 con 0x7fe59c0c3440 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 msgr2=0x7fe59c1f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 0x7fe59c1f4660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe59c157b60 tx=0x7fe59000d950 comp rx=0 tx=0).stop 2024-09-19T09:52:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 msgr2=0x7fe59c1f4660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.349+0000 7fe598ff9640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0c3440 0x7fe59c1f4660 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.350+0000 7fe5a0eb5640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe58806c260 0x7fe58806e720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe59c157de0 tx=0x7fe594007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.355+0000 7fe5a2918640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 0x7fe59c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.355+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c14cf50 con 0x7fe59c1552e0 2024-09-19T09:52:53.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.355+0000 7fe59b7fe640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 0x7fe59c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe59b7fe640 1 -- 172.21.15.123:0/476812189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe59c14cc70 con 0x7fe59c1552e0 2024-09-19T09:52:53.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe59b7fe640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 0x7fe59c1430d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe59c157b60 tx=0x7fe590001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590018050 con 0x7fe59c1552e0 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4877 (secure 0 0 0) 0x7fe590019040 con 0x7fe59c1552e0 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 msgr2=0x7fe59c1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe598ff9640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 0x7fe59c1430d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe59c157b60 tx=0x7fe590001080 comp rx=0 tx=0).stop 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe598ff9640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 msgr2=0x7fe59c1430d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe598ff9640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c1552e0 0x7fe59c1430d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:53.359 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 66, 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 33761, 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: 1 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:53.360 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:53.361 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:53.361 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:53.361 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:53.361 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:53.363 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:53.364 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:53.365 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:53.366 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.367 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:53.368 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:53.369 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:53.370 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.372 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:52:53.373 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:52:53.374 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.375 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.375 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:53.375 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe58806c260 msgr2=0x7fe58806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe5a2918640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fe58806c260 0x7fe58806e720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe59c157de0 tx=0x7fe594007d10 comp rx=0 tx=0).stop 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0724a0 msgr2=0x7fe59c154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe5a2918640 1 --2- 172.21.15.123:0/476812189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe59c0724a0 0x7fe59c154050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe58c000c00 tx=0x7fe58c004730 comp rx=0 tx=0).stop 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe5a0eb5640 1 -- 172.21.15.123:0/476812189 reap_dead start 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.356+0000 7fe5a0eb5640 1 -- 172.21.15.123:0/476812189 reap_dead start 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.357+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 shutdown_connections 2024-09-19T09:52:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.357+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 >> 172.21.15.123:0/476812189 conn(0x7fe59c06ed00 msgr2=0x7fe59c14d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.357+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 shutdown_connections 2024-09-19T09:52:53.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.357+0000 7fe5a2918640 1 -- 172.21.15.123:0/476812189 wait complete. 2024-09-19T09:52:53.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:52:53.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-19T09:52:53.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:52:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.474+0000 7f53f8b6d640 1 Processor -- start 2024-09-19T09:52:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.474+0000 7f53f8b6d640 1 -- start start 2024-09-19T09:52:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f8b6d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f53f40727e0 0x7f53f40c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f8b6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 0x7f53f40c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f8b6d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f40c8850 con 0x7f53f40c91c0 2024-09-19T09:52:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f8b6d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f53f4071ab0 con 0x7f53f40727e0 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f8b6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f53f40ca170 con 0x7f53f4071110 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53f40c91c0 0x7f53f416b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51918/0 (socket says 172.21.15.123:51918) 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f259c640 1 -- 172.21.15.123:0/361151270 learned_addr learned my addr 172.21.15.123:0/361151270 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f2d9d640 1 -- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 msgr2=0x7f53f40c6130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f2d9d640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 0x7f53f40c6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f1d9b640 1 --2- 172.21.15.123:0/361151270 >> v2:172.21.15.194:3300/0 conn(0x7f53f40727e0 0x7f53f40c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.475+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179859845 0 0) 0x7f53f40c8850 con 0x7f53f40c91c0 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.484+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53dc003500 con 0x7f53f40c91c0 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3521760348 0 0) 0x7f53dc003500 con 0x7f53f40c91c0 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 msgr2=0x7f53f40c6130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 0x7f53f40c6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 >> v2:172.21.15.194:3300/0 conn(0x7f53f40727e0 msgr2=0x7f53f40c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 --2- 172.21.15.123:0/361151270 >> v2:172.21.15.194:3300/0 conn(0x7f53f40727e0 0x7f53f40c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f40c8b10 con 0x7f53f40c91c0 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f53e4001670 con 0x7f53f40c91c0 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 >> v1:172.21.15.123:6789/0 conn(0x7f53f40c91c0 legacy=0x7f53f416b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53dc004110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53dc004650 0x7f53dc008e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 0x7f53dc00b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4071ab0 con 0x7f53dc003cd0 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53f40ca170 con 0x7f53dc004650 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f53dc00baa0 con 0x7f53f4071110 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f2d9d640 1 -- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 msgr2=0x7f53dc00b350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f259c640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53dc004110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f2d9d640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 0x7f53dc00b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f1d9b640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53dc004650 0x7f53dc008e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f259c640 1 -- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 msgr2=0x7f53dc00b350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f259c640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f4071110 0x7f53dc00b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f259c640 1 -- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53dc004650 msgr2=0x7f53dc008e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f259c640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53dc004650 0x7f53dc008e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.485+0000 7f53f259c640 1 -- 172.21.15.123:0/361151270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc003500 con 0x7f53dc003cd0 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.486+0000 7f53f259c640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53dc004110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53e400c240 tx=0x7f53dc004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4514e993abc0b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.486+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4007d10 con 0x7f53dc003cd0 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.486+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e4005ad0 con 0x7f53dc003cd0 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.486+0000 7f53f159a640 1 -- 172.21.15.123:0/361151270 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4007070 con 0x7f53dc003cd0 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f8b6d640 1 -- 172.21.15.123:0/361151270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 msgr2=0x7f53dc004110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f8b6d640 1 --2- 172.21.15.123:0/361151270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53dc004110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53e400c240 tx=0x7f53dc004d50 comp rx=0 tx=0).stop 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f2d9d640 1 -- 172.21.15.123:0/361151270 reap_dead start 2024-09-19T09:52:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f8b6d640 1 -- 172.21.15.123:0/361151270 shutdown_connections 2024-09-19T09:52:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f8b6d640 1 -- 172.21.15.123:0/361151270 >> 172.21.15.123:0/361151270 conn(0x7f53f406ed00 msgr2=0x7f53f406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f8b6d640 1 -- 172.21.15.123:0/361151270 shutdown_connections 2024-09-19T09:52:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.487+0000 7f53f8b6d640 1 -- 172.21.15.123:0/361151270 wait complete. 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.488+0000 7f53f8b6d640 1 Processor -- start 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.488+0000 7f53f8b6d640 1 -- start start 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53f41fe220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f41620d0 0x7f53f415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41ee000 0x7f53f415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4071fe0 con 0x7f53dc003cd0 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4071d00 con 0x7f53f41ee000 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f53f40722c0 con 0x7f53f41620d0 2024-09-19T09:52:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53f41fe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f1d9b640 1 -- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f41620d0 msgr2=0x7f53f415d7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.194:3301/0 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f1d9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f41620d0 0x7f53f415d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53f41fe220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41458/0 (socket says 172.21.15.123:41458) 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 -- 172.21.15.123:0/2033785351 learned_addr learned my addr 172.21.15.123:0/2033785351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f2d9d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41ee000 0x7f53f415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f41620d0 msgr2=0x7f53f415d7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53f41620d0 0x7f53f415d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41ee000 msgr2=0x7f53f415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41ee000 0x7f53f415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f41fe760 con 0x7f53dc003cd0 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f259c640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53f41fe220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f53e4001970 tx=0x7f53f4071710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4042070 con 0x7f53dc003cd0 2024-09-19T09:52:53.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e4007480 con 0x7f53dc003cd0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4001c50 con 0x7f53dc003cd0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f4162980 con 0x7f53dc003cd0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.489+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f41632f0 con 0x7f53dc003cd0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.490+0000 7f53f8b6d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 0x7f53f41ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.490+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53f40c8460 con 0x7f53f41624b0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.490+0000 7f53f1d9b640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 0x7f53f41ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.491+0000 7f53f1d9b640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53f40c56c0 con 0x7f53f41624b0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.491+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f53e4045070 con 0x7f53dc003cd0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.491+0000 7f53f1d9b640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 0x7f53f41ee3e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53e800efa0 tx=0x7f53e80075c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.491+0000 7f53e2ffd640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f53d406c290 0x7f53d406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.491+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f53e40ac060 con 0x7f53dc003cd0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.491+0000 7f53f2d9d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f53d406c290 0x7f53d406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e801e020 con 0x7f53f41624b0 2024-09-19T09:52:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f53e800e310 con 0x7f53f41624b0 2024-09-19T09:52:53.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 msgr2=0x7f53f41ee3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53e2ffd640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 0x7f53f41ee3e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53e800efa0 tx=0x7f53e80075c0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 msgr2=0x7f53f41ee3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:53.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53e2ffd640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f41624b0 0x7f53f41ee3e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.492+0000 7f53f2d9d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f53d406c290 0x7f53d406e750 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f53f40760d0 tx=0x7f53ec006f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.498+0000 7f53f8b6d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 0x7f53f41634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.498+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4163a00 con 0x7f53f415b9f0 2024-09-19T09:52:53.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.498+0000 7f53f1d9b640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 0x7f53f41634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.498+0000 7f53f1d9b640 1 -- 172.21.15.123:0/2033785351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53f40c53e0 con 0x7f53f415b9f0 2024-09-19T09:52:53.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f1d9b640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 0x7f53f41634c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53e801f000 tx=0x7f53e8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e801e040 con 0x7f53f415b9f0 2024-09-19T09:52:53.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5185 (secure 0 0 0) 0x7f53e800e4c0 con 0x7f53f415b9f0 2024-09-19T09:52:53.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 msgr2=0x7f53f41634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53e2ffd640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 0x7f53f41634c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53e801f000 tx=0x7f53e8004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53e2ffd640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 msgr2=0x7f53f41634c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53e2ffd640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53f415b9f0 0x7f53f41634c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 66, 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 87569, 2024-09-19T09:52:53.502 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: 1 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 0, 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:53.503 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:53.504 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:52:53.505 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:52:53.506 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.507 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:52:53.508 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:52:53.509 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.510 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.511 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:52:53.512 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:52:53.513 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.514 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.515 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:52:53.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:52:53.517 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:52:53.517 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f53d406c290 msgr2=0x7f53d406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f53d406c290 0x7f53d406e750 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f53f40760d0 tx=0x7f53ec006f00 comp rx=0 tx=0).stop 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 msgr2=0x7f53f41fe220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 --2- 172.21.15.123:0/2033785351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53dc003cd0 0x7f53f41fe220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f53e4001970 tx=0x7f53f4071710 comp rx=0 tx=0).stop 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f2d9d640 1 -- 172.21.15.123:0/2033785351 reap_dead start 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f2d9d640 1 -- 172.21.15.123:0/2033785351 reap_dead start 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 shutdown_connections 2024-09-19T09:52:53.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 >> 172.21.15.123:0/2033785351 conn(0x7f53f406ed00 msgr2=0x7f53f406f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 shutdown_connections 2024-09-19T09:52:53.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:52:53.499+0000 7f53f8b6d640 1 -- 172.21.15.123:0/2033785351 wait complete. 2024-09-19T09:52:53.519 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-19T09:52:53.519 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-19T09:53:03.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:53:03.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:53:13.520 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-19T09:53:13.520 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-19T09:53:13.520 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T09:53:13.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T09:53:13.524 INFO:tasks.ceph.mon.c:Started 2024-09-19T09:53:13.524 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:53:13.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:53:13.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.630+0000 7fa5cea3c640 1 Processor -- start 2024-09-19T09:53:13.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.630+0000 7fa5cea3c640 1 -- start start 2024-09-19T09:53:13.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5cea3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5c806be80 0x7fa5c8158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:13.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5cea3c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa5c806c260 0x7fa5c8072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:13.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5cea3c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80716d0 con 0x7fa5c80720a0 2024-09-19T09:53:13.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5cea3c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c8072b00 con 0x7fa5c806be80 2024-09-19T09:53:13.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5cea3c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80719b0 con 0x7fa5c806c260 2024-09-19T09:53:13.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5c806be80 0x7fa5c8158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5ccfd9640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa5c80720a0 0x7fa5c81514c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56332/0 (socket says 172.21.15.123:56332) 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5ccfd9640 1 -- 172.21.15.123:0/814316132 learned_addr learned my addr 172.21.15.123:0/814316132 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c77fe640 1 --2- 172.21.15.123:0/814316132 >> v2:172.21.15.194:3300/0 conn(0x7fa5c806c260 0x7fa5c8072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c7fff640 1 -- 172.21.15.123:0/814316132 >> v2:172.21.15.194:3300/0 conn(0x7fa5c806c260 msgr2=0x7fa5c8072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/814316132 >> v2:172.21.15.194:3300/0 conn(0x7fa5c806c260 0x7fa5c8072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c7fff640 1 -- 172.21.15.123:0/814316132 >> v1:172.21.15.123:6789/0 conn(0x7fa5c80720a0 legacy=0x7fa5c81514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c6ffd640 1 -- 172.21.15.123:0/814316132 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17891700 0 0) 0x7fa5c80716d0 con 0x7fa5c80720a0 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.631+0000 7fa5c7fff640 1 -- 172.21.15.123:0/814316132 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c8071c90 con 0x7fa5c806be80 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/814316132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806be80 0x7fa5c8158070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806d1e0 tx=0x7fa5b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6459baa46c738e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5c6ffd640 1 -- 172.21.15.123:0/814316132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8037070 con 0x7fa5c806be80 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5c6ffd640 1 -- 172.21.15.123:0/814316132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8032440 con 0x7fa5c806be80 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5c6ffd640 1 -- 172.21.15.123:0/814316132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8032810 con 0x7fa5c806be80 2024-09-19T09:53:13.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5cea3c640 1 -- 172.21.15.123:0/814316132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806be80 msgr2=0x7fa5c8158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/814316132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806be80 0x7fa5c8158070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806d1e0 tx=0x7fa5b802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5cea3c640 1 -- 172.21.15.123:0/814316132 shutdown_connections 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.632+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/814316132 >> v2:172.21.15.194:3300/0 conn(0x7fa5c806c260 0x7fa5c8072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.633+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/814316132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806be80 0x7fa5c8158070 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.633+0000 7fa5cea3c640 1 -- 172.21.15.123:0/814316132 >> 172.21.15.123:0/814316132 conn(0x7fa5c806ec90 msgr2=0x7fa5c806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.633+0000 7fa5cea3c640 1 -- 172.21.15.123:0/814316132 shutdown_connections 2024-09-19T09:53:13.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.633+0000 7fa5cea3c640 1 -- 172.21.15.123:0/814316132 wait complete. 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.634+0000 7fa5cea3c640 1 Processor -- start 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.634+0000 7fa5cea3c640 1 -- start start 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 0x7fa5c8148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 0x7fa5c80bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5c80720a0 0x7fa5c8163110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8151bd0 con 0x7fa5c806c260 2024-09-19T09:53:13.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80c4890 con 0x7fa5c80720a0 2024-09-19T09:53:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c8151d50 con 0x7fa5c806be80 2024-09-19T09:53:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 0x7fa5c80bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 0x7fa5c80bb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46538/0 (socket says 172.21.15.123:46538) 2024-09-19T09:53:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 -- 172.21.15.123:0/1669158648 learned_addr learned my addr 172.21.15.123:0/1669158648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 0x7fa5c8148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5ccfd9640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5c80720a0 0x7fa5c8163110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c7fff640 1 -- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 msgr2=0x7fa5c8148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c7fff640 1 -- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 msgr2=0x7fa5c8148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 0x7fa5c8148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 0x7fa5c8148de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 -- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 msgr2=0x7fa5c8148de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 0x7fa5c8148de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 -- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5c80720a0 msgr2=0x7fa5c8163110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5c80720a0 0x7fa5c8163110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 -- 172.21.15.123:0/1669158648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80cacd0 con 0x7fa5c806c260 2024-09-19T09:53:13.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c77fe640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 0x7fa5c80bb4b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00e9e0 tx=0x7fa5bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc017070 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00c9d0 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c80cafb0 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00cdc0 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.635+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c80cb570 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.636+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c8151620 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.637+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5bc01a070 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.637+0000 7fa5c4ff9640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5b406c2e0 0x7fa5b406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.637+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa5bc08b780 con 0x7fa5c806c260 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.637+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5b406c2e0 0x7fa5b406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:13.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.638+0000 7fa5c7fff640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5b406c2e0 0x7fa5b406e7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034000 tx=0x7fa5b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:13.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.642+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa5bc059820 con 0x7fa5c806c260 2024-09-19T09:53:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.874+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa5c8071510 con 0x7fa5c806c260 2024-09-19T09:53:13.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.874+0000 7fa5c4ff9640 1 -- 172.21.15.123:0/1669158648 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fa5bc05db20 con 0x7fa5c806c260 2024-09-19T09:53:13.876 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":66,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5b406c2e0 msgr2=0x7fa5b406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5b406c2e0 0x7fa5b406e7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034000 tx=0x7fa5b802e000 comp rx=0 tx=0).stop 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 msgr2=0x7fa5c80bb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 0x7fa5c80bb4b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00e9e0 tx=0x7fa5bc00eea0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 shutdown_connections 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5c80720a0 0x7fa5c8163110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5c806c260 0x7fa5c80bb4b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa5b406c2e0 0x7fa5b406e7a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 --2- 172.21.15.123:0/1669158648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5c806be80 0x7fa5c8148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:13.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 >> 172.21.15.123:0/1669158648 conn(0x7fa5c806ec90 msgr2=0x7fa5c814f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:13.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 shutdown_connections 2024-09-19T09:53:13.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:13.876+0000 7fa5cea3c640 1 -- 172.21.15.123:0/1669158648 wait complete. 2024-09-19T09:53:16.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:53:16.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.996+0000 7f1bc32a6640 1 Processor -- start 2024-09-19T09:53:16.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.996+0000 7f1bc32a6640 1 -- start start 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc32a6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bbc1523a0 0x7f1bbc0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc32a6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bbc157e20 con 0x7f1bbc151fc0 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc32a6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bbc072100 con 0x7f1bbc072770 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc32a6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f1bbc0723e0 con 0x7f1bbc1523a0 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc1042640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1bbc151fc0 0x7f1bbc0710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56334/0 (socket says 172.21.15.123:56334) 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc1042640 1 -- 172.21.15.123:0/328052752 learned_addr learned my addr 172.21.15.123:0/328052752 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bc0841640 1 --2- 172.21.15.123:0/328052752 >> v2:172.21.15.194:3300/0 conn(0x7f1bbc1523a0 0x7f1bbc0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.997+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398684918 0 0) 0x7f1bbc157e20 con 0x7f1bbc151fc0 2024-09-19T09:53:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ba8005730 con 0x7f1bbc151fc0 2024-09-19T09:53:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 45561592 0 0) 0x7f1ba8005730 con 0x7f1bbc151fc0 2024-09-19T09:53:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 >> v2:172.21.15.194:3300/0 conn(0x7f1bbc1523a0 msgr2=0x7f1bbc0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 --2- 172.21.15.123:0/328052752 >> v2:172.21.15.194:3300/0 conn(0x7f1bbc1523a0 0x7f1bbc0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 >> v1:172.21.15.194:6789/0 conn(0x7f1bbc072770 legacy=0x7f1bbc162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc1580e0 con 0x7f1bbc151fc0 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f1bb8001670 con 0x7f1bbc151fc0 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 >> v1:172.21.15.123:6789/0 conn(0x7f1bbc151fc0 legacy=0x7f1bbc0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1ba8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba8006a10 0x7f1ba8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba80073d0 0x7f1ba800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0723e0 con 0x7f1ba8005bc0 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba800e370 con 0x7f1ba80073d0 2024-09-19T09:53:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba800e570 con 0x7f1ba8006a10 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1042640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1ba8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1843640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba80073d0 0x7f1ba800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc0841640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba8006a10 0x7f1ba8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1042640 1 -- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba8006a10 msgr2=0x7f1ba8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1042640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba8006a10 0x7f1ba8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1042640 1 -- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba80073d0 msgr2=0x7f1ba800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1042640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba80073d0 0x7f1ba800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1042640 1 -- 172.21.15.123:0/328052752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba8005730 con 0x7f1ba8005bc0 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.998+0000 7f1bc1843640 1 -- 172.21.15.123:0/328052752 reap_dead start 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.999+0000 7f1bc1042640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1ba8005fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c240 tx=0x7f1ba8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4914971ea980be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.999+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8007cf0 con 0x7f1ba8005bc0 2024-09-19T09:53:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.999+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb80058d0 con 0x7f1ba8005bc0 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:16.999+0000 7f1bb3fff640 1 -- 172.21.15.123:0/328052752 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8005ca0 con 0x7f1ba8005bc0 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 -- 172.21.15.123:0/328052752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 msgr2=0x7f1ba8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1ba8005fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c240 tx=0x7f1ba8007a40 comp rx=0 tx=0).stop 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 -- 172.21.15.123:0/328052752 shutdown_connections 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/328052752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1ba8005fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 -- 172.21.15.123:0/328052752 >> 172.21.15.123:0/328052752 conn(0x7f1bbc06ec90 msgr2=0x7f1bbc06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 -- 172.21.15.123:0/328052752 shutdown_connections 2024-09-19T09:53:17.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.000+0000 7f1bc32a6640 1 -- 172.21.15.123:0/328052752 wait complete. 2024-09-19T09:53:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.001+0000 7f1bc32a6640 1 Processor -- start 2024-09-19T09:53:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.001+0000 7f1bc32a6640 1 -- start start 2024-09-19T09:53:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc32a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1bbc1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc32a6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1f0270 0x7f1bbc1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc32a6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 0x7f1bbc14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc32a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc15b550 con 0x7f1ba8005bc0 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc32a6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc15b3d0 con 0x7f1bbc1f0270 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc32a6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc15b6d0 con 0x7f1bbc153910 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1bbc1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1bbc1509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46558/0 (socket says 172.21.15.123:46558) 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 -- 172.21.15.123:0/4028104310 learned_addr learned my addr 172.21.15.123:0/4028104310 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc0841640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1f0270 0x7f1bbc1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1843640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 0x7f1bbc14e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1843640 1 -- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 msgr2=0x7f1bbc14e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1843640 1 -- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 msgr2=0x7f1bbc14e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1843640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 0x7f1bbc14e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1843640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 0x7f1bbc14e360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 -- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 msgr2=0x7f1bbc14e360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 0x7f1bbc14e360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 -- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1f0270 msgr2=0x7f1bbc1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1f0270 0x7f1bbc1533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 -- 172.21.15.123:0/4028104310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc15a0e0 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bc1042640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1bbc1509d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bb802adf0 tx=0x7f1bbc0c5090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8038040 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.002+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8042070 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.003+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc15b140 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.003+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8001c30 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.003+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc15a660 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.004+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc0c3800 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.004+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1bb80049e0 con 0x7f1ba8005bc0 2024-09-19T09:53:17.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.004+0000 7f1bb1ffb640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba006c2b0 0x7f1ba006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:17.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.005+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1bb80ab430 con 0x7f1ba8005bc0 2024-09-19T09:53:17.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.005+0000 7f1bc0841640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba006c2b0 0x7f1ba006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:17.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.005+0000 7f1bc0841640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba006c2b0 0x7f1ba006e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc1597a0 tx=0x7f1bac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:17.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.009+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1bb8079b20 con 0x7f1ba8005bc0 2024-09-19T09:53:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.239+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1bbc0c7250 con 0x7f1ba8005bc0 2024-09-19T09:53:17.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.239+0000 7f1bb1ffb640 1 -- 172.21.15.123:0/4028104310 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f1bb8079420 con 0x7f1ba8005bc0 2024-09-19T09:53:17.242 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":66,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:53:17.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba006c2b0 msgr2=0x7f1ba006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba006c2b0 0x7f1ba006e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc1597a0 tx=0x7f1bac009190 comp rx=0 tx=0).stop 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 msgr2=0x7f1bbc1509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1bbc1509d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bb802adf0 tx=0x7f1bbc0c5090 comp rx=0 tx=0).stop 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 shutdown_connections 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba006c2b0 0x7f1ba006e770 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc153910 0x7f1bbc14e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1f0270 0x7f1bbc1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 --2- 172.21.15.123:0/4028104310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ba8005bc0 0x7f1bbc1509d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 >> 172.21.15.123:0/4028104310 conn(0x7f1bbc06ec90 msgr2=0x7f1bbc0c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 shutdown_connections 2024-09-19T09:53:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:17.241+0000 7f1bc32a6640 1 -- 172.21.15.123:0/4028104310 wait complete. 2024-09-19T09:53:20.256 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:53:20.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.362+0000 7f8133e1e640 1 Processor -- start 2024-09-19T09:53:20.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.362+0000 7f8133e1e640 1 -- start start 2024-09-19T09:53:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f8133e1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f812c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f8133e1e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c157e20 con 0x7f812c072770 2024-09-19T09:53:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f8133e1e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c072100 con 0x7f812c1523a0 2024-09-19T09:53:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f8133e1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f812c0723e0 con 0x7f812c151fc0 2024-09-19T09:53:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f81323bb640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f812c072770 0x7f812c162760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56340/0 (socket says 172.21.15.123:56340) 2024-09-19T09:53:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f81323bb640 1 -- 172.21.15.123:0/2003493259 learned_addr learned my addr 172.21.15.123:0/2003493259 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.363+0000 7f8131bba640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f812c0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422202785 0 0) 0x7f812c157e20 con 0x7f812c072770 2024-09-19T09:53:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8118005730 con 0x7f812c072770 2024-09-19T09:53:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8131bba640 1 -- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 msgr2=0x7f812c0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:53:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8131bba640 1 -- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 msgr2=0x7f812c0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8131bba640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f812c0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8131bba640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f812c0c88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056617284 0 0) 0x7f812c072100 con 0x7f812c1523a0 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c157e20 con 0x7f812c1523a0 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 508180930 0 0) 0x7f8118005730 con 0x7f812c072770 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 msgr2=0x7f812c0c88b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f812c0c88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 >> v1:172.21.15.194:6789/0 conn(0x7f812c1523a0 legacy=0x7f812c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c1580e0 con 0x7f812c072770 2024-09-19T09:53:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f81240019f0 con 0x7f812c072770 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 >> v1:172.21.15.123:6789/0 conn(0x7f812c072770 legacy=0x7f812c162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f8118005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81180062e0 0x7f8118006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8118006f50 0x7f81180073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0723e0 con 0x7f8118006f50 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f811800dde0 con 0x7f81180062e0 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f811800dfe0 con 0x7f812c151fc0 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81323bb640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8118006f50 0x7f81180073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f8131bba640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f8118005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81313b9640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81180062e0 0x7f8118006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81323bb640 1 -- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 msgr2=0x7f8118005d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81323bb640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f812c151fc0 0x7f8118005d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81323bb640 1 -- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81180062e0 msgr2=0x7f8118006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81323bb640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81180062e0 0x7f8118006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.364+0000 7f81323bb640 1 -- 172.21.15.123:0/2003493259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8118005730 con 0x7f8118006f50 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.365+0000 7f81323bb640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8118006f50 0x7f81180073d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f812400a800 tx=0x7f8118007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bbd4fa3a4b9029 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.365+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400a430 con 0x7f8118006f50 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.365+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812402f070 con 0x7f8118006f50 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.365+0000 7f8130bb8640 1 -- 172.21.15.123:0/2003493259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812402bc90 con 0x7f8118006f50 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f8133e1e640 1 -- 172.21.15.123:0/2003493259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8118006f50 msgr2=0x7f81180073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f8133e1e640 1 --2- 172.21.15.123:0/2003493259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8118006f50 0x7f81180073d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f812400a800 tx=0x7f8118007a40 comp rx=0 tx=0).stop 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f81323bb640 1 -- 172.21.15.123:0/2003493259 reap_dead start 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f8133e1e640 1 -- 172.21.15.123:0/2003493259 shutdown_connections 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f8133e1e640 1 -- 172.21.15.123:0/2003493259 >> 172.21.15.123:0/2003493259 conn(0x7f812c06ec90 msgr2=0x7f812c06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f8133e1e640 1 -- 172.21.15.123:0/2003493259 shutdown_connections 2024-09-19T09:53:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.366+0000 7f8133e1e640 1 -- 172.21.15.123:0/2003493259 wait complete. 2024-09-19T09:53:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.367+0000 7f8133e1e640 1 Processor -- start 2024-09-19T09:53:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.367+0000 7f8133e1e640 1 -- start start 2024-09-19T09:53:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8133e1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8118006f50 0x7f812c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8133e1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 0x7f812c15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8133e1e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f812c1f14a0 0x7f812c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8133e1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f812c071980 con 0x7f812c157880 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8133e1e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f812c071800 con 0x7f812c1f14a0 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8133e1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f812c15b3d0 con 0x7f8118006f50 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 0x7f812c15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 0x7f812c15a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46578/0 (socket says 172.21.15.123:46578) 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 -- 172.21.15.123:0/1956130037 learned_addr learned my addr 172.21.15.123:0/1956130037 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f8131bba640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8118006f50 0x7f812c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81323bb640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f812c1f14a0 0x7f812c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 -- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8118006f50 msgr2=0x7f812c152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8118006f50 0x7f812c152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 -- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f812c1f14a0 msgr2=0x7f812c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f812c1f14a0 0x7f812c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 -- 172.21.15.123:0/1956130037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c159140 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.368+0000 7f81313b9640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 0x7f812c15a480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f811c00f760 tx=0x7f811c00fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.369+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c00fe70 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.369+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c018070 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.369+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c1593e0 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.369+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c00d730 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.369+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c1599a0 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.370+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c0c37e0 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.370+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f811c00d8d0 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.370+0000 7f81227fc640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f811006c2e0 0x7f811006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.371+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f811c08b470 con 0x7f812c157880 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.371+0000 7f8131bba640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f811006c2e0 0x7f811006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.371+0000 7f8131bba640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f811006c2e0 0x7f811006e7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.375+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f811c059b60 con 0x7f812c157880 2024-09-19T09:53:20.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.604+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f812c0c7380 con 0x7f812c157880 2024-09-19T09:53:20.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.604+0000 7f81227fc640 1 -- 172.21.15.123:0/1956130037 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f811c059460 con 0x7f812c157880 2024-09-19T09:53:20.606 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:53:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f811006c2e0 msgr2=0x7f811006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f811006c2e0 0x7f811006e7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128008040 comp rx=0 tx=0).stop 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 msgr2=0x7f812c15a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 0x7f812c15a480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f811c00f760 tx=0x7f811c00fc20 comp rx=0 tx=0).stop 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 shutdown_connections 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f812c1f14a0 0x7f812c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f812c157880 0x7f812c15a480 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f811006c2e0 0x7f811006e7a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 --2- 172.21.15.123:0/1956130037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8118006f50 0x7f812c152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 >> 172.21.15.123:0/1956130037 conn(0x7f812c06ec90 msgr2=0x7f812c0c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 shutdown_connections 2024-09-19T09:53:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.606+0000 7f8133e1e640 1 -- 172.21.15.123:0/1956130037 wait complete. 2024-09-19T09:53:20.619 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:53:20.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-19T09:53:20.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-19T09:53:20.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.717+0000 7f2fea68d640 1 Processor -- start 2024-09-19T09:53:20.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.717+0000 7f2fea68d640 1 -- start start 2024-09-19T09:53:20.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.717+0000 7f2fea68d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2fe41551d0 0x7f2fe415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.717+0000 7f2fea68d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fe415f300 0x7f2fe406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fea68d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe415e620 con 0x7f2fe41555b0 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fea68d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40c5c50 con 0x7f2fe415f300 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fea68d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe415b5f0 con 0x7f2fe41551d0 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe8c2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fe415f300 0x7f2fe406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe37fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2fe41555b0 0x7f2fe40ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56344/0 (socket says 172.21.15.123:56344) 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe37fe640 1 -- 172.21.15.123:0/1312554544 learned_addr learned my addr 172.21.15.123:0/1312554544 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/1312554544 >> v2:172.21.15.194:3300/0 conn(0x7f2fe41551d0 0x7f2fe415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/1312554544 >> v2:172.21.15.194:3300/0 conn(0x7f2fe41551d0 msgr2=0x7f2fe415edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe8c2a640 1 --2- 172.21.15.123:0/1312554544 >> v2:172.21.15.194:3300/0 conn(0x7f2fe41551d0 0x7f2fe415edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/1312554544 >> v1:172.21.15.123:6789/0 conn(0x7f2fe41555b0 legacy=0x7f2fe40ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe2ffd640 1 -- 172.21.15.123:0/1312554544 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305611476 0 0) 0x7f2fd8001110 con 0x7f2fe41555b0 2024-09-19T09:53:20.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.718+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/1312554544 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe415b8d0 con 0x7f2fe415f300 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fe8c2a640 1 --2- 172.21.15.123:0/1312554544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe406c6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406d4c0 tx=0x7f2fdc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cd652a08256ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fe2ffd640 1 -- 172.21.15.123:0/1312554544 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007740 con 0x7f2fe415f300 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fe2ffd640 1 -- 172.21.15.123:0/1312554544 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0078e0 con 0x7f2fe415f300 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fe2ffd640 1 -- 172.21.15.123:0/1312554544 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007cb0 con 0x7f2fe415f300 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 -- 172.21.15.123:0/1312554544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 msgr2=0x7f2fe406c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 --2- 172.21.15.123:0/1312554544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe406c6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406d4c0 tx=0x7f2fdc02a710 comp rx=0 tx=0).stop 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 -- 172.21.15.123:0/1312554544 shutdown_connections 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 --2- 172.21.15.123:0/1312554544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe406c6d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 --2- 172.21.15.123:0/1312554544 >> v2:172.21.15.194:3300/0 conn(0x7f2fe41551d0 0x7f2fe415edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 -- 172.21.15.123:0/1312554544 >> 172.21.15.123:0/1312554544 conn(0x7f2fe40d0e10 msgr2=0x7f2fe40d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 -- 172.21.15.123:0/1312554544 shutdown_connections 2024-09-19T09:53:20.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.719+0000 7f2fea68d640 1 -- 172.21.15.123:0/1312554544 wait complete. 2024-09-19T09:53:20.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.720+0000 7f2fea68d640 1 Processor -- start 2024-09-19T09:53:20.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 -- start start 2024-09-19T09:53:20.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 0x7f2fe4145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fe41555b0 0x7f2fe40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe415e8a0 con 0x7f2fe415f300 2024-09-19T09:53:20.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe415be90 con 0x7f2fe41555b0 2024-09-19T09:53:20.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fea68d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40cd240 con 0x7f2fe41551d0 2024-09-19T09:53:20.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.721+0000 7f2fe8c2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe4153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46592/0 (socket says 172.21.15.123:46592) 2024-09-19T09:53:20.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/2497665417 learned_addr learned my addr 172.21.15.123:0/2497665417 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:20.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 0x7f2fe4145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe37fe640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fe41555b0 0x7f2fe40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe3fff640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 msgr2=0x7f2fe4145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-19T09:53:20.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe3fff640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 msgr2=0x7f2fe4145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:20.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 0x7f2fe4145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:20.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 msgr2=0x7f2fe4145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 0x7f2fe4145a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:20.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fe41551d0 0x7f2fe4145a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fe41555b0 msgr2=0x7f2fe40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fe41555b0 0x7f2fe40c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40cfe10 con 0x7f2fe415f300 2024-09-19T09:53:20.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe37fe640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fe41555b0 0x7f2fe40c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:20.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe8c2a640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe4153410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc02ad00 tx=0x7f2fdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc03f070 con 0x7f2fe415f300 2024-09-19T09:53:20.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc031c40 con 0x7f2fe415f300 2024-09-19T09:53:20.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe415d2a0 con 0x7f2fe415f300 2024-09-19T09:53:20.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc009450 con 0x7f2fe415f300 2024-09-19T09:53:20.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.722+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe40b51e0 con 0x7f2fe415f300 2024-09-19T09:53:20.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.723+0000 7f2fea68d640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 0x7f2fe4153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.723+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe415b080 con 0x7f2fe40cffe0 2024-09-19T09:53:20.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.723+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 0x7f2fe4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.723+0000 7f2fe3fff640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fe40cb3b0 con 0x7f2fe40cffe0 2024-09-19T09:53:20.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 0x7f2fe4153950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4006fd0 tx=0x7f2fd400f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4019020 con 0x7f2fe40cffe0 2024-09-19T09:53:20.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2fdc003990 con 0x7f2fe415f300 2024-09-19T09:53:20.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2fd006c1b0 0x7f2fd006e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f2fdc0ac5c0 con 0x7f2fe415f300 2024-09-19T09:53:20.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe37fe640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2fd006c1b0 0x7f2fd006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2fd4014870 con 0x7f2fe40cffe0 2024-09-19T09:53:20.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 msgr2=0x7f2fe4153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 0x7f2fe4153950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4006fd0 tx=0x7f2fd400f910 comp rx=0 tx=0).stop 2024-09-19T09:53:20.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 msgr2=0x7f2fe4153950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:53:20.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.724+0000 7f2fe0ff9640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40cffe0 0x7f2fe4153950 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.725+0000 7f2fe37fe640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2fd006c1b0 0x7f2fd006e670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40cfc40 tx=0x7f2fd8007a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.730+0000 7f2fea68d640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 0x7f2fe40b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.730+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40d1380 con 0x7f2fe40b5790 2024-09-19T09:53:20.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 0x7f2fe40b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe3fff640 1 -- 172.21.15.123:0/2497665417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fe414e980 con 0x7f2fe40b5790 2024-09-19T09:53:20.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe3fff640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 0x7f2fe40b5ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400feb0 tx=0x7f2fd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd401e8f0 con 0x7f2fe40b5790 2024-09-19T09:53:20.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f2fd402a430 con 0x7f2fe40b5790 2024-09-19T09:53:20.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 msgr2=0x7f2fe40b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe0ff9640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 0x7f2fe40b5ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400feb0 tx=0x7f2fd40046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe0ff9640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 msgr2=0x7f2fe40b5ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:53:20.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.731+0000 7f2fe0ff9640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe40b5790 0x7f2fe40b5ba0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "leader", 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 68, 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 61136, 2024-09-19T09:53:20.741 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:53:20.742 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:53:20.742 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:53:20.742 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:53:20.742 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.742 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:53:20.742 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:20.743 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:20.744 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:53:20.745 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:53:20.746 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:53:20.747 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.748 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.749 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.750 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.751 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:53:20.752 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.753 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:53:20.754 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:53:20.755 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2fd006c1b0 msgr2=0x7f2fd006e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f2fd006c1b0 0x7f2fd006e670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40cfc40 tx=0x7f2fd8007a10 comp rx=0 tx=0).stop 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 msgr2=0x7f2fe4153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe4153410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc02ad00 tx=0x7f2fdc004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fe8c2a640 1 -- 172.21.15.123:0/2497665417 reap_dead start 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 shutdown_connections 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 --2- 172.21.15.123:0/2497665417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe415f300 0x7f2fe4153410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 >> 172.21.15.123:0/2497665417 conn(0x7f2fe40d0e10 msgr2=0x7f2fe406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 shutdown_connections 2024-09-19T09:53:20.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.732+0000 7f2fea68d640 1 -- 172.21.15.123:0/2497665417 wait complete. 2024-09-19T09:53:20.758 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:53:20.758 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-19T09:53:20.758 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-19T09:53:20.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.855+0000 7fc1402f1640 1 Processor -- start 2024-09-19T09:53:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.855+0000 7fc1402f1640 1 -- start start 2024-09-19T09:53:20.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc1402f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1380ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc1402f1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc138073fc0 0x7fc1380c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc1402f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc138067c70 con 0x7fc1380c8850 2024-09-19T09:53:20.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc1402f1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fc138068800 con 0x7fc138073fc0 2024-09-19T09:53:20.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc1402f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc138067f30 con 0x7fc1381531f0 2024-09-19T09:53:20.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e88e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc1380c8850 0x7fc13815c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56356/0 (socket says 172.21.15.123:56356) 2024-09-19T09:53:20.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e88e640 1 -- 172.21.15.123:0/2802228370 learned_addr learned my addr 172.21.15.123:0/2802228370 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:20.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1380ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164044396 0 0) 0x7fc138067c70 con 0x7fc1380c8850 2024-09-19T09:53:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2802228370 >> v2:172.21.15.194:3300/0 conn(0x7fc138073fc0 0x7fc1380c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc124003520 con 0x7fc1380c8850 2024-09-19T09:53:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e08d640 1 -- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 msgr2=0x7fc1380ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:53:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e08d640 1 -- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 msgr2=0x7fc1380ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1380ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1380ccf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2114517841 0 0) 0x7fc124003520 con 0x7fc1380c8850 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 msgr2=0x7fc1380ccf90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1380ccf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 >> v2:172.21.15.194:3300/0 conn(0x7fc138073fc0 msgr2=0x7fc1380c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 --2- 172.21.15.123:0/2802228370 >> v2:172.21.15.194:3300/0 conn(0x7fc138073fc0 0x7fc1380c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc138070820 con 0x7fc1380c8850 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fc1300019f0 con 0x7fc1380c8850 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 >> v1:172.21.15.123:6789/0 conn(0x7fc1380c8850 legacy=0x7fc13815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.856+0000 7fc13d08b640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1240039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d08b640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc124003f50 0x7fc124004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d08b640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc138068800 con 0x7fc124004d40 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc138067f30 con 0x7fc124003f50 2024-09-19T09:53:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc12400bad0 con 0x7fc1381531f0 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e88e640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc124003f50 0x7fc124004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1240039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e88e640 1 -- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 msgr2=0x7fc1240039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e88e640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1381531f0 0x7fc1240039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e88e640 1 -- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc124003f50 msgr2=0x7fc124004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e88e640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc124003f50 0x7fc124004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13e88e640 1 -- 172.21.15.123:0/2802228370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc124003520 con 0x7fc124004d40 2024-09-19T09:53:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.857+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc124003f50 0x7fc124004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc13e88e640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1240051c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc13000a870 tx=0x7fc124005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9cb38d893105e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13000a4c0 con 0x7fc124004d40 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13002f070 con 0x7fc124004d40 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc13d08b640 1 -- 172.21.15.123:0/2802228370 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13002bcc0 con 0x7fc124004d40 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc1402f1640 1 -- 172.21.15.123:0/2802228370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 msgr2=0x7fc1240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc1402f1640 1 --2- 172.21.15.123:0/2802228370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1240051c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc13000a870 tx=0x7fc124005830 comp rx=0 tx=0).stop 2024-09-19T09:53:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc13e88e640 1 -- 172.21.15.123:0/2802228370 reap_dead start 2024-09-19T09:53:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc1402f1640 1 -- 172.21.15.123:0/2802228370 shutdown_connections 2024-09-19T09:53:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc1402f1640 1 -- 172.21.15.123:0/2802228370 >> 172.21.15.123:0/2802228370 conn(0x7fc13806fbb0 msgr2=0x7fc13806ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc1402f1640 1 -- 172.21.15.123:0/2802228370 shutdown_connections 2024-09-19T09:53:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.858+0000 7fc1402f1640 1 -- 172.21.15.123:0/2802228370 wait complete. 2024-09-19T09:53:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.859+0000 7fc1402f1640 1 Processor -- start 2024-09-19T09:53:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 -- start start 2024-09-19T09:53:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1381e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381e3ed0 0x7fc1381e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1380c4d80 0x7fc1381f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380cca70 con 0x7fc124004d40 2024-09-19T09:53:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380cc790 con 0x7fc1381e3ed0 2024-09-19T09:53:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc1402f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc138158d90 con 0x7fc1380c4d80 2024-09-19T09:53:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc13e08d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1381e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc13e08d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1381e23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46640/0 (socket says 172.21.15.123:46640) 2024-09-19T09:53:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.860+0000 7fc13e08d640 1 -- 172.21.15.123:0/2289763547 learned_addr learned my addr 172.21.15.123:0/2289763547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc13e08d640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1380c4d80 msgr2=0x7fc1381f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1380c4d80 0x7fc1381f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc13e08d640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381e3ed0 msgr2=0x7fc1381e28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381e3ed0 0x7fc1381e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc13e08d640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1381e45c0 con 0x7fc124004d40 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc13e08d640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1381e23b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1340108a0 tx=0x7fc134010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13401a020 con 0x7fc124004d40 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13400e940 con 0x7fc124004d40 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1381f4df0 con 0x7fc124004d40 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13400ed30 con 0x7fc124004d40 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.861+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc138150550 con 0x7fc124004d40 2024-09-19T09:53:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.862+0000 7fc1402f1640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 0x7fc138148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.862+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381e2ff0 con 0x7fc1381f1680 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.862+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 0x7fc138148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.862+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc13401d020 con 0x7fc124004d40 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc13d88c640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1381e4aa0 con 0x7fc1381f1680 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc11c06c2e0 0x7fc11c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc13408bd30 con 0x7fc124004d40 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 0x7fc138148e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1381e42b0 tx=0x7fc128011920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc13e88e640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc11c06c2e0 0x7fc11c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128004230 con 0x7fc1381f1680 2024-09-19T09:53:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc13e88e640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc11c06c2e0 0x7fc11c06e7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc13000a870 tx=0x7fc13002d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc128004230 con 0x7fc1381f1680 2024-09-19T09:53:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 msgr2=0x7fc138148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 0x7fc138148e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1381e42b0 tx=0x7fc128011920 comp rx=0 tx=0).stop 2024-09-19T09:53:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 msgr2=0x7fc138148e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:53:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.863+0000 7fc12effd640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1381f1680 0x7fc138148e50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.869+0000 7fc1402f1640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 0x7fc1381569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.869+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc138072810 con 0x7fc138149390 2024-09-19T09:53:20.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.870+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 0x7fc1381569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.870+0000 7fc13d88c640 1 -- 172.21.15.123:0/2289763547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc138073540 con 0x7fc138149390 2024-09-19T09:53:20.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.870+0000 7fc13d88c640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 0x7fc1381569f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc128004000 tx=0x7fc128004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.870+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128003820 con 0x7fc138149390 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 <== mon.1 v2:172.21.15.194:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7fc128003820 con 0x7fc138149390 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 msgr2=0x7fc1381569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc12effd640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 0x7fc1381569f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc128004000 tx=0x7fc128004730 comp rx=0 tx=0).stop 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc12effd640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 msgr2=0x7fc1381569f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc12effd640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc138149390 0x7fc1381569f0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc128004000 tx=0x7fc128004730 comp rx=0 tx=0).stop 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:53:20.884 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 68, 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 114939, 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 1, 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:53:20.885 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:53:20.886 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.887 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:53:20.888 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:20.889 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:53:20.890 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.892 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.893 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.894 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.894 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.894 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:53:20.894 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.895 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:53:20.896 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:53:20.897 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": [ 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": [ 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.898 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "luminous", 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 3 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.899 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": [ 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 2 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:53:20.900 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc11c06c2e0 msgr2=0x7fc11c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc11c06c2e0 0x7fc11c06e7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc13000a870 tx=0x7fc13002d000 comp rx=0 tx=0).stop 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 msgr2=0x7fc1381e23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 --2- 172.21.15.123:0/2289763547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc124004d40 0x7fc1381e23b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1340108a0 tx=0x7fc134010d60 comp rx=0 tx=0).stop 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc13e88e640 1 -- 172.21.15.123:0/2289763547 reap_dead start 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc13e88e640 1 -- 172.21.15.123:0/2289763547 reap_dead start 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 shutdown_connections 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 >> 172.21.15.123:0/2289763547 conn(0x7fc13806fbb0 msgr2=0x7fc1381590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 shutdown_connections 2024-09-19T09:53:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:20.871+0000 7fc1402f1640 1 -- 172.21.15.123:0/2289763547 wait complete. 2024-09-19T09:53:20.903 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:53:20.903 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-19T09:53:20.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-19T09:53:21.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.001+0000 7f3f047e4640 1 Processor -- start 2024-09-19T09:53:21.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.001+0000 7f3f047e4640 1 -- start start 2024-09-19T09:53:21.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f047e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3efc15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f047e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3efc15e620 con 0x7f3efc15f300 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f047e4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3efc15b5f0 con 0x7f3efc1555b0 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f047e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc0c5c50 con 0x7f3efc1551d0 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02d81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3efc15f300 0x7f3efc06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56364/0 (socket says 172.21.15.123:56364) 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02d81640 1 -- 172.21.15.123:0/2110321461 learned_addr learned my addr 172.21.15.123:0/2110321461 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02580640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3efc15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621517142 0 0) 0x7f3ef4001490 con 0x7f3efc15f300 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee8003520 con 0x7f3efc15f300 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02580640 1 -- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 msgr2=0x7f3efc15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02580640 1 -- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 msgr2=0x7f3efc15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02580640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3efc15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02580640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3efc15edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2362340605 0 0) 0x7f3ee8003520 con 0x7f3efc15f300 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 msgr2=0x7f3efc15edc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3efc15edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 >> v1:172.21.15.194:6789/0 conn(0x7f3efc1555b0 legacy=0x7f3efc0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc15b8d0 con 0x7f3efc15f300 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f3ef4001bc0 con 0x7f3efc15f300 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 >> v1:172.21.15.123:6789/0 conn(0x7f3efc15f300 legacy=0x7f3efc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3ee80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8003fd0 0x7f3ee8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ee8004d40 0x7f3ee80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee800baa0 con 0x7f3ee8004d40 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee800bc50 con 0x7f3ee8003fd0 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee800be50 con 0x7f3efc1551d0 2024-09-19T09:53:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ee8004d40 0x7f3ee80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.002+0000 7f3f02580640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3ee80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f01d7f640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8003fd0 0x7f3ee8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f02d81640 1 -- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 msgr2=0x7f3ee80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1551d0 0x7f3ee80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f02d81640 1 -- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8003fd0 msgr2=0x7f3ee8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8003fd0 0x7f3ee8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f02d81640 1 -- 172.21.15.123:0/2110321461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee8003520 con 0x7f3ee8004d40 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f01d7f640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ee8003fd0 0x7f3ee8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ee8004d40 0x7f3ee80051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3efc15f790 tx=0x7f3ee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e85973d8f0f534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.003+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400a5f0 con 0x7f3ee8004d40 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef402f070 con 0x7f3ee8004d40 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f0157e640 1 -- 172.21.15.123:0/2110321461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef402bdf0 con 0x7f3ee8004d40 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f047e4640 1 -- 172.21.15.123:0/2110321461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ee8004d40 msgr2=0x7f3ee80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f047e4640 1 --2- 172.21.15.123:0/2110321461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ee8004d40 0x7f3ee80051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3efc15f790 tx=0x7f3ee8005830 comp rx=0 tx=0).stop 2024-09-19T09:53:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f02d81640 1 -- 172.21.15.123:0/2110321461 reap_dead start 2024-09-19T09:53:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f047e4640 1 -- 172.21.15.123:0/2110321461 shutdown_connections 2024-09-19T09:53:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f047e4640 1 -- 172.21.15.123:0/2110321461 >> 172.21.15.123:0/2110321461 conn(0x7f3efc0d0e10 msgr2=0x7f3efc0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f047e4640 1 -- 172.21.15.123:0/2110321461 shutdown_connections 2024-09-19T09:53:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.004+0000 7f3f047e4640 1 -- 172.21.15.123:0/2110321461 wait complete. 2024-09-19T09:53:21.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.005+0000 7f3f047e4640 1 Processor -- start 2024-09-19T09:53:21.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.005+0000 7f3f047e4640 1 -- start start 2024-09-19T09:53:21.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f047e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8004d40 0x7f3efc06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f047e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc15cbc0 0x7f3efc14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f047e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3efc15d040 0x7f3efc14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f047e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc15e8a0 con 0x7f3efc15d040 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f047e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc15be90 con 0x7f3efc15cbc0 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f047e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc0cd240 con 0x7f3ee8004d40 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3efc15d040 0x7f3efc14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3efc15d040 0x7f3efc14fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46646/0 (socket says 172.21.15.123:46646) 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 -- 172.21.15.123:0/2544254866 learned_addr learned my addr 172.21.15.123:0/2544254866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8004d40 0x7f3efc06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f01d7f640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc15cbc0 0x7f3efc14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8004d40 msgr2=0x7f3efc06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8004d40 0x7f3efc06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc15cbc0 msgr2=0x7f3efc14f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc15cbc0 0x7f3efc14f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc15e0d0 con 0x7f3efc15d040 2024-09-19T09:53:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ee8004d40 0x7f3efc06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.006+0000 7f3f02d81640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3efc15d040 0x7f3efc14fde0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400aa90 tx=0x7f3efc0b34d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4044070 con 0x7f3efc15d040 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef4034670 con 0x7f3efc15d040 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc1f18b0 con 0x7f3efc15d040 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400a5f0 con 0x7f3efc15d040 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc1f1580 con 0x7f3efc15d040 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3f047e4640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.007+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc15c240 con 0x7f3efc14dc60 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.008+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.008+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-19T09:53:21.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.008+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.008+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.008+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.008+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ef4047070 con 0x7f3efc15d040 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.009+0000 7f3ef2ffd640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ee006c2e0 0x7f3ee006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.009+0000 7f3f01d7f640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ee006c2e0 0x7f3ee006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.009+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f3ef40ab370 con 0x7f3efc15d040 2024-09-19T09:53:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.009+0000 7f3f01d7f640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ee006c2e0 0x7f3ee006e7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007b40 tx=0x7f3eec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:21.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.209+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.209+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:53:21.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.209+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:21.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.209+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:21.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.209+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:53:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.610+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.610+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:53:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.610+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.610+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:21.610+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:53:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:22.412+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:22.412+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-19T09:53:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:22.412+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:53:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:22.412+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:53:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:22.412+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:53:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.014+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.014+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3efc15b080 con 0x7f3efc14dc60 2024-09-19T09:53:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019720 tx=0x7f3ef8019be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8017c40 con 0x7f3efc14dc60 2024-09-19T09:53:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3ef8017c40 con 0x7f3efc14dc60 2024-09-19T09:53:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3ef2ffd640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019720 tx=0x7f3ef8019be0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 msgr2=0x7f3efc14e040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:53:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.015+0000 7f3ef2ffd640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc14dc60 0x7f3efc14e040 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019720 tx=0x7f3ef8019be0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.022+0000 7f3f047e4640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 0x7f3efc1f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.022+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc150320 con 0x7f3efc1f40c0 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.022+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 0x7f3efc1f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3f02580640 1 -- 172.21.15.123:0/2544254866 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3efc1f1a80 con 0x7f3efc1f40c0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3f02580640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 0x7f3efc1f44a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019720 tx=0x7f3ef8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8030070 con 0x7f3efc1f40c0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 <== mon.2 v2:172.21.15.194:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f3ef8034410 con 0x7f3efc1f40c0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 msgr2=0x7f3efc1f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3ef2ffd640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 0x7f3efc1f44a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019720 tx=0x7f3ef8004730 comp rx=0 tx=0).stop 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3ef2ffd640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 msgr2=0x7f3efc1f44a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.023+0000 7f3ef2ffd640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc1f40c0 0x7f3efc1f44a0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019720 tx=0x7f3ef8004730 comp rx=0 tx=0).stop 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "peon", 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "election_epoch": 68, 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 10404, 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum": [ 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: 0, 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: 1, 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: 2 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_age": 4, 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "required_con": "2450521708007866372", 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi123.stdout: "required_mon": [ 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_con": "4540701547738038271", 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi123.stdout: "quorum_mon": [ 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.029 INFO:teuthology.orchestra.run.smithi123.stdout: "outside_quorum": [], 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "extra_probe_peers": [], 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "sync_provider": [], 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "monmap": { 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 1, 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "fsid": "837baa2f-03c1-414f-aff3-ae2b21065b15", 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "modified": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "created": "2024-09-19T09:41:32.866122Z", 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release": 19, 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi123.stdout: "min_mon_release_name": "squid", 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi123.stdout: "election_strategy": 1, 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi123.stdout: "disallowed_leaders: ": "", 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false, 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi123.stdout: "tiebreaker_mon": "", 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi123.stdout: "removed_ranks: ": "", 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi123.stdout: "features": { 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "persistent": [ 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "kraken", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "luminous", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "mimic", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap-prune", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "nautilus", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "elector-pinging", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "reef", 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: "squid" 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "optional": [] 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "mons": [ 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 0, 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "a", 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:3300", 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789", 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6789/0", 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.123:6789/0", 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.034 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 1, 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "b", 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3300", 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789", 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6789/0", 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6789/0", 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "rank": 2, 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "c", 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addrs": { 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:3301", 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790", 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 0 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.194:6790/0", 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "public_addr": "172.21.15.194:6790/0", 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi123.stdout: "priority": 0, 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "weight": 0, 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_location": "{}" 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "feature_map": { 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": [ 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi123.stdout: "client": [ 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: "features": "0x3f03cffffffdffff", 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: "release": "squid", 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 1 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout: "stretch_mode": false 2024-09-19T09:53:24.039 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ee006c2e0 msgr2=0x7f3ee006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f3ee006c2e0 0x7f3ee006e7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007b40 tx=0x7f3eec009040 comp rx=0 tx=0).stop 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3efc15d040 msgr2=0x7f3efc14fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 --2- 172.21.15.123:0/2544254866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3efc15d040 0x7f3efc14fde0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400aa90 tx=0x7f3efc0b34d0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f02d81640 1 -- 172.21.15.123:0/2544254866 reap_dead start 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f02d81640 1 -- 172.21.15.123:0/2544254866 reap_dead start 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 shutdown_connections 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 >> 172.21.15.123:0/2544254866 conn(0x7f3efc0d0e10 msgr2=0x7f3efc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 shutdown_connections 2024-09-19T09:53:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.024+0000 7f3f047e4640 1 -- 172.21.15.123:0/2544254866 wait complete. 2024-09-19T09:53:24.041 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-19T09:53:24.042 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-19T09:53:24.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-19T09:53:24.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 Processor -- start 2024-09-19T09:53:24.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 -- start start 2024-09-19T09:53:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f395815e7e0 0x7f39580cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39580cbc90 0x7f39581584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39580b5230 con 0x7f39580cb370 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f395815f6a0 con 0x7f395815e7e0 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.145+0000 7f395df52640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f395815ee00 con 0x7f39580cbc90 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3956ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f395815e7e0 0x7f39580cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f39577fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f39580cb370 0x7f395815bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55196/0 (socket says 172.21.15.123:55196) 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3956ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f395815e7e0 0x7f39580cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57776/0 (socket says 172.21.15.123:57776) 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f39577fe640 1 -- 172.21.15.123:0/2223443220 learned_addr learned my addr 172.21.15.123:0/2223443220 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3957fff640 1 --2- 172.21.15.123:0/2223443220 >> v2:172.21.15.194:3300/0 conn(0x7f39580cbc90 0x7f39581584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3956ffd640 1 -- 172.21.15.123:0/2223443220 >> v2:172.21.15.194:3300/0 conn(0x7f39580cbc90 msgr2=0x7f39581584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3956ffd640 1 --2- 172.21.15.123:0/2223443220 >> v2:172.21.15.194:3300/0 conn(0x7f39580cbc90 0x7f39581584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3956ffd640 1 -- 172.21.15.123:0/2223443220 >> v1:172.21.15.123:6789/0 conn(0x7f39580cb370 legacy=0x7f395815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f39567fc640 1 -- 172.21.15.123:0/2223443220 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726238923 0 0) 0x7f39580b5230 con 0x7f39580cb370 2024-09-19T09:53:24.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3956ffd640 1 -- 172.21.15.123:0/2223443220 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395815f0e0 con 0x7f395815e7e0 2024-09-19T09:53:24.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.146+0000 7f3957fff640 1 --2- 172.21.15.123:0/2223443220 >> v2:172.21.15.194:3300/0 conn(0x7f39580cbc90 0x7f39581584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:24.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f3956ffd640 1 --2- 172.21.15.123:0/2223443220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39580cb750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39580cc9f0 tx=0x7f394c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a549b8ec8205d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f39567fc640 1 -- 172.21.15.123:0/2223443220 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c037070 con 0x7f395815e7e0 2024-09-19T09:53:24.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f39567fc640 1 -- 172.21.15.123:0/2223443220 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c032440 con 0x7f395815e7e0 2024-09-19T09:53:24.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f39567fc640 1 -- 172.21.15.123:0/2223443220 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c032810 con 0x7f395815e7e0 2024-09-19T09:53:24.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 -- 172.21.15.123:0/2223443220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 msgr2=0x7f39580cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 --2- 172.21.15.123:0/2223443220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39580cb750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39580cc9f0 tx=0x7f394c02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 -- 172.21.15.123:0/2223443220 shutdown_connections 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 --2- 172.21.15.123:0/2223443220 >> v2:172.21.15.194:3300/0 conn(0x7f39580cbc90 0x7f39581584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 --2- 172.21.15.123:0/2223443220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39580cb750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 -- 172.21.15.123:0/2223443220 >> 172.21.15.123:0/2223443220 conn(0x7f3958070e90 msgr2=0x7f39580712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 -- 172.21.15.123:0/2223443220 shutdown_connections 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.147+0000 7f395df52640 1 -- 172.21.15.123:0/2223443220 wait complete. 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.149+0000 7f395df52640 1 Processor -- start 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.149+0000 7f395df52640 1 -- start start 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.149+0000 7f395df52640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39580cb370 0x7f395815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39580cbc90 0x7f395815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39581e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f395815b660 con 0x7f395815e7e0 2024-09-19T09:53:24.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f395815b380 con 0x7f39580cb370 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f39580ca770 con 0x7f39580cbc90 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39581e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39581e4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57780/0 (socket says 172.21.15.123:57780) 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 -- 172.21.15.123:0/2880258524 learned_addr learned my addr 172.21.15.123:0/2880258524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3956ffd640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39580cbc90 0x7f395815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f39577fe640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39580cb370 0x7f395815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 -- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39580cbc90 msgr2=0x7f395815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39580cbc90 0x7f395815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 -- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39580cb370 msgr2=0x7f395815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39580cb370 0x7f395815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 -- 172.21.15.123:0/2880258524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39581f1700 con 0x7f395815e7e0 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f39577fe640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39580cb370 0x7f395815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f3957fff640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39581e4f60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3950007ef0 tx=0x7f395000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395001a070 con 0x7f395815e7e0 2024-09-19T09:53:24.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3950003b90 con 0x7f395815e7e0 2024-09-19T09:53:24.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39581f19a0 con 0x7f395815e7e0 2024-09-19T09:53:24.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950004030 con 0x7f395815e7e0 2024-09-19T09:53:24.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.150+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395815c470 con 0x7f395815e7e0 2024-09-19T09:53:24.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.151+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39580c76e0 con 0x7f395815e7e0 2024-09-19T09:53:24.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.152+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f395001d070 con 0x7f395815e7e0 2024-09-19T09:53:24.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.152+0000 7f393ffff640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394406c2e0 0x7f394406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.152+0000 7f39577fe640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394406c2e0 0x7f394406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.152+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f395008b5f0 con 0x7f395815e7e0 2024-09-19T09:53:24.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.153+0000 7f39577fe640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394406c2e0 0x7f394406e7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3948007fd0 tx=0x7f3948009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.156+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3950010070 con 0x7f395815e7e0 2024-09-19T09:53:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.385+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f39580c8ee0 con 0x7f395815e7e0 2024-09-19T09:53:24.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.386+0000 7f393ffff640 1 -- 172.21.15.123:0/2880258524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3950059720 con 0x7f395815e7e0 2024-09-19T09:53:24.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394406c2e0 msgr2=0x7f394406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394406c2e0 0x7f394406e7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3948007fd0 tx=0x7f3948009040 comp rx=0 tx=0).stop 2024-09-19T09:53:24.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 msgr2=0x7f39581e4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39581e4f60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3950007ef0 tx=0x7f395000d4a0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 shutdown_connections 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395815e7e0 0x7f39581e4f60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394406c2e0 0x7f394406e7a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39580cbc90 0x7f395815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 --2- 172.21.15.123:0/2880258524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39580cb370 0x7f395815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 >> 172.21.15.123:0/2880258524 conn(0x7f3958070e90 msgr2=0x7f39580c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 shutdown_connections 2024-09-19T09:53:24.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:24.388+0000 7f395df52640 1 -- 172.21.15.123:0/2880258524 wait complete. 2024-09-19T09:53:24.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-19T09:53:34.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:53:34.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:53:34.403 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:53:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.510+0000 7f33988af640 1 Processor -- start 2024-09-19T09:53:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.510+0000 7f33988af640 1 -- start start 2024-09-19T09:53:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f33988af640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f339406c260 0x7f3394158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f33988af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33940720a0 0x7f33941514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f33988af640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33940736a0 con 0x7f339406be80 2024-09-19T09:53:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f33988af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3394072b00 con 0x7f33940720a0 2024-09-19T09:53:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f33988af640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f33940716d0 con 0x7f339406c260 2024-09-19T09:53:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f3392d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33940720a0 0x7f33941514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f3392d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33940720a0 0x7f33941514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58216/0 (socket says 172.21.15.123:58216) 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f3392d9d640 1 -- 172.21.15.123:0/2114859317 learned_addr learned my addr 172.21.15.123:0/2114859317 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.511+0000 7f339259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f339406be80 0x7f3394072f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59720/0 (socket says 172.21.15.123:59720) 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3391d9b640 1 --2- 172.21.15.123:0/2114859317 >> v2:172.21.15.194:3300/0 conn(0x7f339406c260 0x7f3394158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3392d9d640 1 -- 172.21.15.123:0/2114859317 >> v2:172.21.15.194:3300/0 conn(0x7f339406c260 msgr2=0x7f3394158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3392d9d640 1 --2- 172.21.15.123:0/2114859317 >> v2:172.21.15.194:3300/0 conn(0x7f339406c260 0x7f3394158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3392d9d640 1 -- 172.21.15.123:0/2114859317 >> v1:172.21.15.123:6789/0 conn(0x7f339406be80 legacy=0x7f3394072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3392d9d640 1 -- 172.21.15.123:0/2114859317 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33940719b0 con 0x7f33940720a0 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f339159a640 1 -- 172.21.15.123:0/2114859317 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907360011 0 0) 0x7f33940736a0 con 0x7f339406be80 2024-09-19T09:53:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3391d9b640 1 --2- 172.21.15.123:0/2114859317 >> v2:172.21.15.194:3300/0 conn(0x7f339406c260 0x7f3394158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.512+0000 7f3392d9d640 1 --2- 172.21.15.123:0/2114859317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941514c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f339406d1e0 tx=0x7f338c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd2117551aaee01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f339159a640 1 -- 172.21.15.123:0/2114859317 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c036070 con 0x7f33940720a0 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f339159a640 1 -- 172.21.15.123:0/2114859317 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c031600 con 0x7f33940720a0 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f339159a640 1 -- 172.21.15.123:0/2114859317 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0319d0 con 0x7f33940720a0 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 -- 172.21.15.123:0/2114859317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 msgr2=0x7f33941514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 --2- 172.21.15.123:0/2114859317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941514c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f339406d1e0 tx=0x7f338c02a730 comp rx=0 tx=0).stop 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 -- 172.21.15.123:0/2114859317 shutdown_connections 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 --2- 172.21.15.123:0/2114859317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941514c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 --2- 172.21.15.123:0/2114859317 >> v2:172.21.15.194:3300/0 conn(0x7f339406c260 0x7f3394158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 -- 172.21.15.123:0/2114859317 >> 172.21.15.123:0/2114859317 conn(0x7f339406ec90 msgr2=0x7f339406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 -- 172.21.15.123:0/2114859317 shutdown_connections 2024-09-19T09:53:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.513+0000 7f33988af640 1 -- 172.21.15.123:0/2114859317 wait complete. 2024-09-19T09:53:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 Processor -- start 2024-09-19T09:53:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 -- start start 2024-09-19T09:53:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f339406be80 0x7f339414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f339406c260 0x7f33941f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33940c4890 con 0x7f33940720a0 2024-09-19T09:53:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3394072790 con 0x7f339406be80 2024-09-19T09:53:34.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.515+0000 7f33988af640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f33940710f0 con 0x7f339406c260 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58224/0 (socket says 172.21.15.123:58224) 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 -- 172.21.15.123:0/231374771 learned_addr learned my addr 172.21.15.123:0/231374771 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f339259c640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f339406be80 0x7f339414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3391d9b640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f339406c260 0x7f33941f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 -- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f339406c260 msgr2=0x7f33941f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f339406c260 0x7f33941f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 -- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f339406be80 msgr2=0x7f339414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f339406be80 0x7f339414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 -- 172.21.15.123:0/231374771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33941e33f0 con 0x7f33940720a0 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3392d9d640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941f1f90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f338c009f40 tx=0x7f338c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c036050 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c042070 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33940c8a00 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c009510 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.516+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33940c8fc0 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.517+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3394158070 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.518+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f338c007bf0 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.518+0000 7f3382ffd640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f337406c2b0 0x7f337406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.518+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f338c0ac330 con 0x7f33940720a0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.518+0000 7f339259c640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f337406c2b0 0x7f337406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.519+0000 7f339259c640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f337406c2b0 0x7f337406e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3384000f60 tx=0x7f3384007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.523+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f338c07aab0 con 0x7f33940720a0 2024-09-19T09:53:34.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.723+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3394075770 con 0x7f33940720a0 2024-09-19T09:53:34.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.724+0000 7f3382ffd640 1 -- 172.21.15.123:0/231374771 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f338c07a3b0 con 0x7f33940720a0 2024-09-19T09:53:34.726 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:53:34.727 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:53:34.727 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:53:34.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f337406c2b0 msgr2=0x7f337406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f337406c2b0 0x7f337406e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3384000f60 tx=0x7f3384007b50 comp rx=0 tx=0).stop 2024-09-19T09:53:34.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 msgr2=0x7f33941f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941f1f90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f338c009f40 tx=0x7f338c004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:34.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 shutdown_connections 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33940720a0 0x7f33941f1f90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f337406c2b0 0x7f337406e770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f339406c260 0x7f33941f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 --2- 172.21.15.123:0/231374771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f339406be80 0x7f339414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 >> 172.21.15.123:0/231374771 conn(0x7f339406ec90 msgr2=0x7f3394156670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 shutdown_connections 2024-09-19T09:53:34.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.726+0000 7f33988af640 1 -- 172.21.15.123:0/231374771 wait complete. 2024-09-19T09:53:34.739 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-19T09:53:34.740 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-19T09:53:34.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.836+0000 7fabe5da6640 1 Processor -- start 2024-09-19T09:53:34.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.836+0000 7fabe5da6640 1 -- start start 2024-09-19T09:53:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabe5da6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fabe0151fc0 0x7fabe00c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabe5da6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe0157e20 con 0x7fabe0072770 2024-09-19T09:53:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabe5da6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe0072100 con 0x7fabe01523a0 2024-09-19T09:53:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabe5da6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fabe00723e0 con 0x7fabe0151fc0 2024-09-19T09:53:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabdf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fabe0151fc0 0x7fabe00c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabdffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fabe0072770 0x7fabe0162760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59726/0 (socket says 172.21.15.123:59726) 2024-09-19T09:53:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabdffff640 1 -- 172.21.15.123:0/3872850486 learned_addr learned my addr 172.21.15.123:0/3872850486 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabdf7fe640 1 -- 172.21.15.123:0/3872850486 >> v1:172.21.15.194:6789/0 conn(0x7fabe01523a0 legacy=0x7fabe00710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabdf7fe640 1 -- 172.21.15.123:0/3872850486 >> v1:172.21.15.123:6789/0 conn(0x7fabe0072770 legacy=0x7fabe0162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.837+0000 7fabdf7fe640 1 -- 172.21.15.123:0/3872850486 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe01580e0 con 0x7fabe0151fc0 2024-09-19T09:53:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.838+0000 7fabdf7fe640 1 --2- 172.21.15.123:0/3872850486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe00c88b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fabd00097a0 tx=0x7fabd002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf8f9d3a7d2d460 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.838+0000 7fabde7fc640 1 -- 172.21.15.123:0/3872850486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0037070 con 0x7fabe0151fc0 2024-09-19T09:53:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.838+0000 7fabde7fc640 1 -- 172.21.15.123:0/3872850486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd002ae50 con 0x7fabe0151fc0 2024-09-19T09:53:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.838+0000 7fabde7fc640 1 -- 172.21.15.123:0/3872850486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0032660 con 0x7fabe0151fc0 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 -- 172.21.15.123:0/3872850486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 msgr2=0x7fabe00c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3872850486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe00c88b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fabd00097a0 tx=0x7fabd002a140 comp rx=0 tx=0).stop 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 -- 172.21.15.123:0/3872850486 shutdown_connections 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3872850486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe00c88b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 -- 172.21.15.123:0/3872850486 >> 172.21.15.123:0/3872850486 conn(0x7fabe006ec90 msgr2=0x7fabe006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 -- 172.21.15.123:0/3872850486 shutdown_connections 2024-09-19T09:53:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.839+0000 7fabe5da6640 1 -- 172.21.15.123:0/3872850486 wait complete. 2024-09-19T09:53:34.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.840+0000 7fabe5da6640 1 Processor -- start 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.840+0000 7fabe5da6640 1 -- start start 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe0072770 0x7fabe014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe014e500 0x7fabe0072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fabe0071980 con 0x7fabe0151fc0 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fabe0071800 con 0x7fabe0072770 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fabe015b3d0 con 0x7fabe014e500 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe0159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58232/0 (socket says 172.21.15.123:58232) 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 -- 172.21.15.123:0/3170023747 learned_addr learned my addr 172.21.15.123:0/3170023747 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdf7fe640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe0072770 0x7fabe014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdffff640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe014e500 0x7fabe0072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 -- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe014e500 msgr2=0x7fabe0072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe014e500 0x7fabe0072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 -- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe0072770 msgr2=0x7fabe014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe0072770 0x7fabe014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 -- 172.21.15.123:0/3170023747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe0153e40 con 0x7fabe0151fc0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdf7fe640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe0072770 0x7fabe014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdffff640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe014e500 0x7fabe0072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabdeffd640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe0159d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabd400b420 tx=0x7fabd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011830 con 0x7fabe0151fc0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd4016070 con 0x7fabe0151fc0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe0073870 con 0x7fabe0151fc0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011c10 con 0x7fabe0151fc0 2024-09-19T09:53:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.841+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe0150020 con 0x7fabe0151fc0 2024-09-19T09:53:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.842+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe00c3800 con 0x7fabe0151fc0 2024-09-19T09:53:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.843+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fabd401b460 con 0x7fabe0151fc0 2024-09-19T09:53:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.843+0000 7fabc7fff640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fabcc06c2e0 0x7fabcc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.843+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fabd408aed0 con 0x7fabe0151fc0 2024-09-19T09:53:34.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.843+0000 7fabdf7fe640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fabcc06c2e0 0x7fabcc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.844+0000 7fabdf7fe640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fabcc06c2e0 0x7fabcc06e7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fabd0034000 tx=0x7fabd002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:34.848+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fabd4020020 con 0x7fabe0151fc0 2024-09-19T09:53:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.078+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fabe00c5430 con 0x7fabe0151fc0 2024-09-19T09:53:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.079+0000 7fabc7fff640 1 -- 172.21.15.123:0/3170023747 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fabd40595c0 con 0x7fabe0151fc0 2024-09-19T09:53:35.081 INFO:teuthology.orchestra.run.smithi123.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","modified":"2024-09-19T09:41:32.866122Z","created":"2024-09-19T09:41:32.866122Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-19T09:53:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fabcc06c2e0 msgr2=0x7fabcc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fabcc06c2e0 0x7fabcc06e7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fabd0034000 tx=0x7fabd002e000 comp rx=0 tx=0).stop 2024-09-19T09:53:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 msgr2=0x7fabe0159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe0159d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabd400b420 tx=0x7fabd400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 shutdown_connections 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fabcc06c2e0 0x7fabcc06e7a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe014e500 0x7fabe0072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe0151fc0 0x7fabe0159d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 --2- 172.21.15.123:0/3170023747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe0072770 0x7fabe014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 >> 172.21.15.123:0/3170023747 conn(0x7fabe006ec90 msgr2=0x7fabe00c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 shutdown_connections 2024-09-19T09:53:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.081+0000 7fabe5da6640 1 -- 172.21.15.123:0/3170023747 wait complete. 2024-09-19T09:53:35.094 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-19T09:53:35.094 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:53:35.108 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:53:35.108 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:53:35.108 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:53:35.139 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-19T09:53:35.139 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:53:35.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:53:35.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.333+0000 7f33401d6640 1 Processor -- start 2024-09-19T09:53:35.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.333+0000 7f33401d6640 1 -- start start 2024-09-19T09:53:35.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f33401d6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33380c4680 0x7f33380c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f33401d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33380c6100 0x7f33380c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f33401d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33380c7ca0 con 0x7f3338152dc0 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f33401d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f33380c7a80 con 0x7f33380c6100 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f33401d6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f33380c5d50 con 0x7f33380c4680 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333e773640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33380c6100 0x7f33380c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333e773640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33380c6100 0x7f33380c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58236/0 (socket says 172.21.15.123:58236) 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333df72640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3338152dc0 0x7f33381596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59734/0 (socket says 172.21.15.123:59734) 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333e773640 1 -- 172.21.15.123:0/1757172436 learned_addr learned my addr 172.21.15.123:0/1757172436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333d771640 1 --2- 172.21.15.123:0/1757172436 >> v2:172.21.15.194:3300/0 conn(0x7f33380c4680 0x7f33380c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333e773640 1 -- 172.21.15.123:0/1757172436 >> v2:172.21.15.194:3300/0 conn(0x7f33380c4680 msgr2=0x7f33380c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.334+0000 7f333e773640 1 --2- 172.21.15.123:0/1757172436 >> v2:172.21.15.194:3300/0 conn(0x7f33380c4680 0x7f33380c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.335+0000 7f333e773640 1 -- 172.21.15.123:0/1757172436 >> v1:172.21.15.123:6789/0 conn(0x7f3338152dc0 legacy=0x7f33381596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.335+0000 7f333e773640 1 -- 172.21.15.123:0/1757172436 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3338073490 con 0x7f33380c6100 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.335+0000 7f333e773640 1 --2- 172.21.15.123:0/1757172436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c6100 0x7f33380c6530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f333815d560 tx=0x7f333002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86af687b312d7a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.335+0000 7f333cf70640 1 -- 172.21.15.123:0/1757172436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330037070 con 0x7f33380c6100 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.335+0000 7f333cf70640 1 -- 172.21.15.123:0/1757172436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3330032440 con 0x7f33380c6100 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.335+0000 7f333cf70640 1 -- 172.21.15.123:0/1757172436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330032810 con 0x7f33380c6100 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 -- 172.21.15.123:0/1757172436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c6100 msgr2=0x7f33380c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 --2- 172.21.15.123:0/1757172436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c6100 0x7f33380c6530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f333815d560 tx=0x7f333002a2a0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 -- 172.21.15.123:0/1757172436 shutdown_connections 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 --2- 172.21.15.123:0/1757172436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c6100 0x7f33380c6530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 --2- 172.21.15.123:0/1757172436 >> v2:172.21.15.194:3300/0 conn(0x7f33380c4680 0x7f33380c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 -- 172.21.15.123:0/1757172436 >> 172.21.15.123:0/1757172436 conn(0x7f333806ed00 msgr2=0x7f333806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 -- 172.21.15.123:0/1757172436 shutdown_connections 2024-09-19T09:53:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.336+0000 7f33401d6640 1 -- 172.21.15.123:0/1757172436 wait complete. 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.337+0000 7f33401d6640 1 Processor -- start 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.337+0000 7f33401d6640 1 -- start start 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f33401d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 0x7f33381e8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f33401d6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380c6100 0x7f33380cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f33401d6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338152dc0 0x7f33380cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f33401d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33380c4af0 con 0x7f33380c4680 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f33401d6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3338159230 con 0x7f3338152dc0 2024-09-19T09:53:35.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f33401d6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f3338073730 con 0x7f33380c6100 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 0x7f33381e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 0x7f33381e8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58238/0 (socket says 172.21.15.123:58238) 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 -- 172.21.15.123:0/2838826440 learned_addr learned my addr 172.21.15.123:0/2838826440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333d771640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380c6100 0x7f33380cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333e773640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338152dc0 0x7f33380cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 -- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380c6100 msgr2=0x7f33380cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380c6100 0x7f33380cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 -- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338152dc0 msgr2=0x7f33380cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338152dc0 0x7f33380cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 -- 172.21.15.123:0/2838826440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33381e5750 con 0x7f33380c4680 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.338+0000 7f333df72640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 0x7f33381e8160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f333400c760 tx=0x7f333400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.339+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334017070 con 0x7f33380c4680 2024-09-19T09:53:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.339+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333400a640 con 0x7f33380c4680 2024-09-19T09:53:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.339+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333400aa10 con 0x7f33380c4680 2024-09-19T09:53:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.339+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33381f1a10 con 0x7f33380c4680 2024-09-19T09:53:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.339+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33381e74e0 con 0x7f33380c4680 2024-09-19T09:53:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.340+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33381e76b0 con 0x7f33380c4680 2024-09-19T09:53:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.340+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f333401a070 con 0x7f33380c4680 2024-09-19T09:53:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.341+0000 7f332e7fc640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f331c06c2b0 0x7f331c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.341+0000 7f333d771640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f331c06c2b0 0x7f331c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.341+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f333408aac0 con 0x7f33380c4680 2024-09-19T09:53:35.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.341+0000 7f333d771640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f331c06c2b0 0x7f331c06e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f33381e4420 tx=0x7f3328008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:35.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.345+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3334058ad0 con 0x7f33380c4680 2024-09-19T09:53:35.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.521+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3338073a10 con 0x7f33380c4680 2024-09-19T09:53:35.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.521+0000 7f332e7fc640 1 -- 172.21.15.123:0/2838826440 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f333405cdd0 con 0x7f33380c4680 2024-09-19T09:53:35.524 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f331c06c2b0 msgr2=0x7f331c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f331c06c2b0 0x7f331c06e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f33381e4420 tx=0x7f3328008040 comp rx=0 tx=0).stop 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 msgr2=0x7f33381e8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 0x7f33381e8160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f333400c760 tx=0x7f333400cc20 comp rx=0 tx=0).stop 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 shutdown_connections 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338152dc0 0x7f33380cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f331c06c2b0 0x7f331c06e770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380c6100 0x7f33380cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 --2- 172.21.15.123:0/2838826440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33380c4680 0x7f33381e8160 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.523+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 >> 172.21.15.123:0/2838826440 conn(0x7f333806ed00 msgr2=0x7f333814d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:35.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.524+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 shutdown_connections 2024-09-19T09:53:35.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.524+0000 7f33401d6640 1 -- 172.21.15.123:0/2838826440 wait complete. 2024-09-19T09:53:35.537 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:53:35.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:53:35.537 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:53:35.600 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:53:35.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:53:35.600 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:53:35.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:53:35.630 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-19T09:53:35.746 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:53:35.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:53:35.747 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:53:35.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:53:35.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-19T09:53:35.875 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T09:53:35.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:53:35.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:53:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.983+0000 7f1bcdd1a640 1 Processor -- start 2024-09-19T09:53:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.983+0000 7f1bcdd1a640 1 -- start start 2024-09-19T09:53:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.983+0000 7f1bcdd1a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc81523a0 0x7f1bc80c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.983+0000 7f1bcdd1a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc8157e20 con 0x7f1bc8072770 2024-09-19T09:53:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.983+0000 7f1bcdd1a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc8072100 con 0x7f1bc8151fc0 2024-09-19T09:53:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.983+0000 7f1bcdd1a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc80723e0 con 0x7f1bc81523a0 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1bc8072770 0x7f1bc8162760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59740/0 (socket says 172.21.15.123:59740) 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc7fff640 1 -- 172.21.15.123:0/1579570588 learned_addr learned my addr 172.21.15.123:0/1579570588 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bbffff640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc81523a0 0x7f1bc80c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013726082 0 0) 0x7f1bc8157e20 con 0x7f1bc8072770 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb4003520 con 0x7f1bc8072770 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044766634 0 0) 0x7f1bc8072100 con 0x7f1bc8151fc0 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bc8157e20 con 0x7f1bc8151fc0 2024-09-19T09:53:35.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3939180616 0 0) 0x7f1bb4003520 con 0x7f1bc8072770 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc81523a0 msgr2=0x7f1bc80c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc81523a0 0x7f1bc80c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 >> v1:172.21.15.194:6789/0 conn(0x7f1bc8151fc0 legacy=0x7f1bc80710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc81580e0 con 0x7f1bc8072770 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f1bc00019f0 con 0x7f1bc8072770 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 >> v1:172.21.15.123:6789/0 conn(0x7f1bc8072770 legacy=0x7f1bc8162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bb4003b70 0x7f1bb4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb4004800 0x7f1bb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80723e0 con 0x7f1bb40051c0 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb400bf00 con 0x7f1bb4004800 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.984+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb400c080 con 0x7f1bb4003b70 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc77fe640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bb4003b70 0x7f1bb4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bbffff640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb4004800 0x7f1bb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 -- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bb4003b70 msgr2=0x7f1bb4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bb4003b70 0x7f1bb4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 -- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb4004800 msgr2=0x7f1bb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb4004800 0x7f1bb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 -- 172.21.15.123:0/1579570588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb4003520 con 0x7f1bb40051c0 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc77fe640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bb4003b70 0x7f1bb4003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.985+0000 7f1bc7fff640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bb400b9c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000a3f0 tx=0x7f1bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce577f7a6b89ed0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000a430 con 0x7f1bb40051c0 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc0031070 con 0x7f1bb40051c0 2024-09-19T09:53:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bc6ffd640 1 -- 172.21.15.123:0/1579570588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0036470 con 0x7f1bb40051c0 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/1579570588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 msgr2=0x7f1bb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/1579570588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bb400b9c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000a3f0 tx=0x7f1bb4005830 comp rx=0 tx=0).stop 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bc7fff640 1 -- 172.21.15.123:0/1579570588 reap_dead start 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/1579570588 shutdown_connections 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/1579570588 >> 172.21.15.123:0/1579570588 conn(0x7f1bc806ec90 msgr2=0x7f1bc806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/1579570588 shutdown_connections 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.986+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/1579570588 wait complete. 2024-09-19T09:53:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 Processor -- start 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 -- start start 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bc814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc8158fa0 0x7f1bc81efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc814ca00 0x7f1bc814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8071980 con 0x7f1bb40051c0 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8071800 con 0x7f1bc814ca00 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bcdd1a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc815b3d0 con 0x7f1bc8158fa0 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bc814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bc77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bc814f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58256/0 (socket says 172.21.15.123:58256) 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bc77fe640 1 -- 172.21.15.123:0/3359367601 learned_addr learned my addr 172.21.15.123:0/3359367601 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bbffff640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc8158fa0 0x7f1bc81efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.988+0000 7f1bc7fff640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc814ca00 0x7f1bc814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc77fe640 1 -- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc8158fa0 msgr2=0x7f1bc81efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc77fe640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc8158fa0 0x7f1bc81efd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc77fe640 1 -- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc814ca00 msgr2=0x7f1bc814a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc77fe640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc814ca00 0x7f1bc814a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc77fe640 1 -- 172.21.15.123:0/3359367601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc8152ad0 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc77fe640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bc814f200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800fae0 tx=0x7f1bb800fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80052e0 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8018070 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc81575c0 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800d930 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.989+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc8157880 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.990+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc81523a0 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.990+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1bb800dad0 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.991+0000 7f1bc4ff9640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c2b0 0x7f1ba806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.991+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f1bb808b590 con 0x7f1bb40051c0 2024-09-19T09:53:35.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.991+0000 7f1bbffff640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c2b0 0x7f1ba806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:35.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.992+0000 7f1bbffff640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c2b0 0x7f1ba806e770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1bc815b3a0 tx=0x7f1bb0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:35.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:35.995+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1bb8059bf0 con 0x7f1bb40051c0 2024-09-19T09:53:36.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.162+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bc8071340 con 0x7f1ba806c2b0 2024-09-19T09:53:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.168+0000 7f1bc4ff9640 1 -- 172.21.15.123:0/3359367601 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253910 (secure 0 0 0) 0x7f1bc8071340 con 0x7f1ba806c2b0 2024-09-19T09:53:36.173 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:53:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:53:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c2b0 msgr2=0x7f1ba806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c2b0 0x7f1ba806e770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1bc815b3a0 tx=0x7f1bb0009190 comp rx=0 tx=0).stop 2024-09-19T09:53:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 msgr2=0x7f1bc814f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bc814f200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800fae0 tx=0x7f1bb800fee0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 shutdown_connections 2024-09-19T09:53:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bc814ca00 0x7f1bc814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f1ba806c2b0 0x7f1ba806e770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bc8158fa0 0x7f1bc81efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 --2- 172.21.15.123:0/3359367601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb40051c0 0x7f1bc814f200 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 >> 172.21.15.123:0/3359367601 conn(0x7f1bc806ec90 msgr2=0x7f1bc80c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 shutdown_connections 2024-09-19T09:53:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.171+0000 7f1bcdd1a640 1 -- 172.21.15.123:0/3359367601 wait complete. 2024-09-19T09:53:36.185 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-19T09:53:34.894076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210088267,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":140,"num_read_kb":201,"num_write":6764596,"num_write_kb":83163784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447121,"ondisk_log_size":447121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4642816,"kb_used_data":412416,"kb_used_omap":12,"kb_used_meta":4230259,"kb_avail":750331904,"statfs":{"total":773094113280,"available":768339869696,"internally_reserved":0,"allocated":422313984,"data_stored":420923870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":4331785777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"3.3f","version":"25'5955","reported_seq":5976,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.544765+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:52:45.544765+0000","last_peered":"2024-09-19T09:52:45.544765+0000","last_clean":"2024-09-19T09:52:45.544765+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:52:45.544765+0000","last_undegraded":"2024-09-19T09:52:45.544765+0000","last_fullsized":"2024-09-19T09:52:45.544765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5955,"log_dups_size":0,"ondisk_log_size":5955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90667,"num_write_kb":1126123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'8754","reported_seq":8775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.556938+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:52:45.556938+0000","last_peered":"2024-09-19T09:52:45.556938+0000","last_clean":"2024-09-19T09:52:45.556938+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:52:45.556938+0000","last_undegraded":"2024-09-19T09:52:45.556938+0000","last_fullsized":"2024-09-19T09:52:45.556938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8754,"log_dups_size":0,"ondisk_log_size":8754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133411,"num_write_kb":1655568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7056","reported_seq":7077,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.534391+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:52:45.534391+0000","last_peered":"2024-09-19T09:52:45.534391+0000","last_clean":"2024-09-19T09:52:45.534391+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:52:45.534391+0000","last_undegraded":"2024-09-19T09:52:45.534391+0000","last_fullsized":"2024-09-19T09:52:45.534391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7056,"log_dups_size":0,"ondisk_log_size":7056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107453,"num_write_kb":1318687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'6123","reported_seq":6144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.545508+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:52:44.545508+0000","last_peered":"2024-09-19T09:52:44.545508+0000","last_clean":"2024-09-19T09:52:44.545508+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:52:44.545508+0000","last_undegraded":"2024-09-19T09:52:44.545508+0000","last_fullsized":"2024-09-19T09:52:44.545508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6123,"log_dups_size":0,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93226,"num_write_kb":1192949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'8352","reported_seq":8372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.561761+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:52:45.561761+0000","last_peered":"2024-09-19T09:52:45.561761+0000","last_clean":"2024-09-19T09:52:45.561761+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:52:45.561761+0000","last_undegraded":"2024-09-19T09:52:45.561761+0000","last_fullsized":"2024-09-19T09:52:45.561761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8352,"log_dups_size":0,"ondisk_log_size":8352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127203,"num_write_kb":1494052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6127","reported_seq":6147,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.739185+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:52:44.739185+0000","last_peered":"2024-09-19T09:52:44.739185+0000","last_clean":"2024-09-19T09:52:44.739185+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:52:44.739185+0000","last_undegraded":"2024-09-19T09:52:44.739185+0000","last_fullsized":"2024-09-19T09:52:44.739185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6127,"log_dups_size":0,"ondisk_log_size":6127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93163,"num_write_kb":1116253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'6602","reported_seq":6622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.557090+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:52:45.557090+0000","last_peered":"2024-09-19T09:52:45.557090+0000","last_clean":"2024-09-19T09:52:45.557090+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:52:45.557090+0000","last_undegraded":"2024-09-19T09:52:45.557090+0000","last_fullsized":"2024-09-19T09:52:45.557090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6602,"log_dups_size":0,"ondisk_log_size":6602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100493,"num_write_kb":1261887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'7464","reported_seq":7484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.725996+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:52:44.725996+0000","last_peered":"2024-09-19T09:52:44.725996+0000","last_clean":"2024-09-19T09:52:44.725996+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:52:44.725996+0000","last_undegraded":"2024-09-19T09:52:44.725996+0000","last_fullsized":"2024-09-19T09:52:44.725996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113853,"num_write_kb":1361930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'8241","reported_seq":8261,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.779815+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:52:44.779815+0000","last_peered":"2024-09-19T09:52:44.779815+0000","last_clean":"2024-09-19T09:52:44.779815+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:52:44.779815+0000","last_undegraded":"2024-09-19T09:52:44.779815+0000","last_fullsized":"2024-09-19T09:52:44.779815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8241,"log_dups_size":0,"ondisk_log_size":8241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125203,"num_write_kb":1603079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'7720","reported_seq":7740,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.495424+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:52:45.495424+0000","last_peered":"2024-09-19T09:52:45.495424+0000","last_clean":"2024-09-19T09:52:45.495424+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:52:45.495424+0000","last_undegraded":"2024-09-19T09:52:45.495424+0000","last_fullsized":"2024-09-19T09:52:45.495424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7720,"log_dups_size":0,"ondisk_log_size":7720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117401,"num_write_kb":1489402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'6676","reported_seq":6696,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.736174+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:52:44.736174+0000","last_peered":"2024-09-19T09:52:44.736174+0000","last_clean":"2024-09-19T09:52:44.736174+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:52:44.736174+0000","last_undegraded":"2024-09-19T09:52:44.736174+0000","last_fullsized":"2024-09-19T09:52:44.736174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6676,"log_dups_size":0,"ondisk_log_size":6676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101709,"num_write_kb":1228477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'5916","reported_seq":5936,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.474457+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:52:45.474457+0000","last_peered":"2024-09-19T09:52:45.474457+0000","last_clean":"2024-09-19T09:52:45.474457+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:52:45.474457+0000","last_undegraded":"2024-09-19T09:52:45.474457+0000","last_fullsized":"2024-09-19T09:52:45.474457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5916,"log_dups_size":0,"ondisk_log_size":5916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90039,"num_write_kb":1066111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'6228","reported_seq":6248,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538290+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:52:45.538290+0000","last_peered":"2024-09-19T09:52:45.538290+0000","last_clean":"2024-09-19T09:52:45.538290+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:52:45.538290+0000","last_undegraded":"2024-09-19T09:52:45.538290+0000","last_fullsized":"2024-09-19T09:52:45.538290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6228,"log_dups_size":0,"ondisk_log_size":6228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94800,"num_write_kb":1191870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'7094","reported_seq":7114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.468110+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:52:45.468110+0000","last_peered":"2024-09-19T09:52:45.468110+0000","last_clean":"2024-09-19T09:52:45.468110+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:52:45.468110+0000","last_undegraded":"2024-09-19T09:52:45.468110+0000","last_fullsized":"2024-09-19T09:52:45.468110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7094,"log_dups_size":0,"ondisk_log_size":7094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107699,"num_write_kb":1339564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'7235","reported_seq":7255,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519773+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:52:45.519773+0000","last_peered":"2024-09-19T09:52:45.519773+0000","last_clean":"2024-09-19T09:52:45.519773+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:52:45.519773+0000","last_undegraded":"2024-09-19T09:52:45.519773+0000","last_fullsized":"2024-09-19T09:52:45.519773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109960,"num_write_kb":1298661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'6065","reported_seq":6085,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.479454+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:52:45.479454+0000","last_peered":"2024-09-19T09:52:45.479454+0000","last_clean":"2024-09-19T09:52:45.479454+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:52:45.479454+0000","last_undegraded":"2024-09-19T09:52:45.479454+0000","last_fullsized":"2024-09-19T09:52:45.479454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92239,"num_write_kb":1166043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8309","reported_seq":8329,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.495740+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:52:45.495740+0000","last_peered":"2024-09-19T09:52:45.495740+0000","last_clean":"2024-09-19T09:52:45.495740+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:52:45.495740+0000","last_undegraded":"2024-09-19T09:52:45.495740+0000","last_fullsized":"2024-09-19T09:52:45.495740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8309,"log_dups_size":0,"ondisk_log_size":8309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126488,"num_write_kb":1557261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'5639","reported_seq":5659,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549778+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:52:45.549778+0000","last_peered":"2024-09-19T09:52:45.549778+0000","last_clean":"2024-09-19T09:52:45.549778+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:52:45.549778+0000","last_undegraded":"2024-09-19T09:52:45.549778+0000","last_fullsized":"2024-09-19T09:52:45.549778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5639,"log_dups_size":0,"ondisk_log_size":5639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85570,"num_write_kb":1023683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'6866","reported_seq":6886,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538514+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:52:45.538514+0000","last_peered":"2024-09-19T09:52:45.538514+0000","last_clean":"2024-09-19T09:52:45.538514+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:52:45.538514+0000","last_undegraded":"2024-09-19T09:52:45.538514+0000","last_fullsized":"2024-09-19T09:52:45.538514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6866,"log_dups_size":0,"ondisk_log_size":6866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104491,"num_write_kb":1253325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'6773","reported_seq":6793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.529598+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:52:45.529598+0000","last_peered":"2024-09-19T09:52:45.529598+0000","last_clean":"2024-09-19T09:52:45.529598+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:52:45.529598+0000","last_undegraded":"2024-09-19T09:52:45.529598+0000","last_fullsized":"2024-09-19T09:52:45.529598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6773,"log_dups_size":0,"ondisk_log_size":6773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103096,"num_write_kb":1273163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'7058","reported_seq":7078,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.533572+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:52:45.533572+0000","last_peered":"2024-09-19T09:52:45.533572+0000","last_clean":"2024-09-19T09:52:45.533572+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:52:45.533572+0000","last_undegraded":"2024-09-19T09:52:45.533572+0000","last_fullsized":"2024-09-19T09:52:45.533572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7058,"log_dups_size":0,"ondisk_log_size":7058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107113,"num_write_kb":1305966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'7483","reported_seq":7503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.802426+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:52:44.802426+0000","last_peered":"2024-09-19T09:52:44.802426+0000","last_clean":"2024-09-19T09:52:44.802426+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:52:44.802426+0000","last_undegraded":"2024-09-19T09:52:44.802426+0000","last_fullsized":"2024-09-19T09:52:44.802426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7483,"log_dups_size":0,"ondisk_log_size":7483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113925,"num_write_kb":1408486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'6876","reported_seq":6896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.727578+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:52:44.727578+0000","last_peered":"2024-09-19T09:52:44.727578+0000","last_clean":"2024-09-19T09:52:44.727578+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:52:44.727578+0000","last_undegraded":"2024-09-19T09:52:44.727578+0000","last_fullsized":"2024-09-19T09:52:44.727578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104459,"num_write_kb":1263249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'6113","reported_seq":6133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538211+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:52:45.538211+0000","last_peered":"2024-09-19T09:52:45.538211+0000","last_clean":"2024-09-19T09:52:45.538211+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:52:45.538211+0000","last_undegraded":"2024-09-19T09:52:45.538211+0000","last_fullsized":"2024-09-19T09:52:45.538211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6113,"log_dups_size":0,"ondisk_log_size":6113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93016,"num_write_kb":1127551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'8000","reported_seq":8021,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.550005+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:52:45.550005+0000","last_peered":"2024-09-19T09:52:45.550005+0000","last_clean":"2024-09-19T09:52:45.550005+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:52:45.550005+0000","last_undegraded":"2024-09-19T09:52:45.550005+0000","last_fullsized":"2024-09-19T09:52:45.550005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8000,"log_dups_size":0,"ondisk_log_size":8000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121789,"num_write_kb":1510406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'6207","reported_seq":6228,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.531220+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:52:45.531220+0000","last_peered":"2024-09-19T09:52:45.531220+0000","last_clean":"2024-09-19T09:52:45.531220+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:52:45.531220+0000","last_undegraded":"2024-09-19T09:52:45.531220+0000","last_fullsized":"2024-09-19T09:52:45.531220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6207,"log_dups_size":0,"ondisk_log_size":6207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94313,"num_write_kb":1157877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'7387","reported_seq":7408,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549991+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:52:45.549991+0000","last_peered":"2024-09-19T09:52:45.549991+0000","last_clean":"2024-09-19T09:52:45.549991+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:52:45.549991+0000","last_undegraded":"2024-09-19T09:52:45.549991+0000","last_fullsized":"2024-09-19T09:52:45.549991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7387,"log_dups_size":0,"ondisk_log_size":7387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112469,"num_write_kb":1393395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'6312","reported_seq":6333,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.559946+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:52:45.559946+0000","last_peered":"2024-09-19T09:52:45.559946+0000","last_clean":"2024-09-19T09:52:45.559946+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:52:45.559946+0000","last_undegraded":"2024-09-19T09:52:45.559946+0000","last_fullsized":"2024-09-19T09:52:45.559946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6312,"log_dups_size":0,"ondisk_log_size":6312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96072,"num_write_kb":1169122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'5898","reported_seq":5919,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.523449+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:52:45.523449+0000","last_peered":"2024-09-19T09:52:45.523449+0000","last_clean":"2024-09-19T09:52:45.523449+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:52:45.523449+0000","last_undegraded":"2024-09-19T09:52:45.523449+0000","last_fullsized":"2024-09-19T09:52:45.523449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5898,"log_dups_size":0,"ondisk_log_size":5898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89887,"num_write_kb":1118423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'8484","reported_seq":8505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.555300+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:52:45.555300+0000","last_peered":"2024-09-19T09:52:45.555300+0000","last_clean":"2024-09-19T09:52:45.555300+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:52:45.555300+0000","last_undegraded":"2024-09-19T09:52:45.555300+0000","last_fullsized":"2024-09-19T09:52:45.555300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8484,"log_dups_size":0,"ondisk_log_size":8484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129293,"num_write_kb":1558943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'7295","reported_seq":7316,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.799433+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:52:44.799433+0000","last_peered":"2024-09-19T09:52:44.799433+0000","last_clean":"2024-09-19T09:52:44.799433+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:52:44.799433+0000","last_undegraded":"2024-09-19T09:52:44.799433+0000","last_fullsized":"2024-09-19T09:52:44.799433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7295,"log_dups_size":0,"ondisk_log_size":7295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111025,"num_write_kb":1382740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'8637","reported_seq":8658,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.553761+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:52:45.553761+0000","last_peered":"2024-09-19T09:52:45.553761+0000","last_clean":"2024-09-19T09:52:45.553761+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:52:45.553761+0000","last_undegraded":"2024-09-19T09:52:45.553761+0000","last_fullsized":"2024-09-19T09:52:45.553761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8637,"log_dups_size":0,"ondisk_log_size":8637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131457,"num_write_kb":1608657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'5965","reported_seq":5985,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.511836+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:52:45.511836+0000","last_peered":"2024-09-19T09:52:45.511836+0000","last_clean":"2024-09-19T09:52:45.511836+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:52:45.511836+0000","last_undegraded":"2024-09-19T09:52:45.511836+0000","last_fullsized":"2024-09-19T09:52:45.511836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90903,"num_write_kb":1098126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1242","reported_seq":1264,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:39.669842+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:52:39.669842+0000","last_peered":"2024-09-19T09:52:39.669842+0000","last_clean":"2024-09-19T09:52:39.669842+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:52:39.669842+0000","last_undegraded":"2024-09-19T09:52:39.669842+0000","last_fullsized":"2024-09-19T09:52:39.669842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":5249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5275","reported_seq":5295,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.480284+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:52:45.480284+0000","last_peered":"2024-09-19T09:52:45.480284+0000","last_clean":"2024-09-19T09:52:45.480284+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:52:45.480284+0000","last_undegraded":"2024-09-19T09:52:45.480284+0000","last_fullsized":"2024-09-19T09:52:45.480284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80097,"num_write_kb":999347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'43","reported_seq":65,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506874+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:52:45.506874+0000","last_peered":"2024-09-19T09:52:45.506874+0000","last_clean":"2024-09-19T09:52:45.506874+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:52:45.506874+0000","last_undegraded":"2024-09-19T09:52:45.506874+0000","last_fullsized":"2024-09-19T09:52:45.506874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":16406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:29.642711+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:52:29.642711+0000","last_peered":"2024-09-19T09:52:29.642711+0000","last_clean":"2024-09-19T09:52:29.642711+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:52:29.642711+0000","last_undegraded":"2024-09-19T09:52:29.642711+0000","last_fullsized":"2024-09-19T09:52:29.642711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'6888","reported_seq":6908,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558630+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:52:45.558630+0000","last_peered":"2024-09-19T09:52:45.558630+0000","last_clean":"2024-09-19T09:52:45.558630+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:52:45.558630+0000","last_undegraded":"2024-09-19T09:52:45.558630+0000","last_fullsized":"2024-09-19T09:52:45.558630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6888,"log_dups_size":0,"ondisk_log_size":6888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104648,"num_write_kb":1287559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'31","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.798938+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:52:44.798938+0000","last_peered":"2024-09-19T09:52:44.798938+0000","last_clean":"2024-09-19T09:52:44.798938+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:52:44.798938+0000","last_undegraded":"2024-09-19T09:52:44.798938+0000","last_fullsized":"2024-09-19T09:52:44.798938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'8123","reported_seq":8143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.554490+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:52:45.554490+0000","last_peered":"2024-09-19T09:52:45.554490+0000","last_clean":"2024-09-19T09:52:45.554490+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:52:45.554490+0000","last_undegraded":"2024-09-19T09:52:45.554490+0000","last_fullsized":"2024-09-19T09:52:45.554490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8123,"log_dups_size":0,"ondisk_log_size":8123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123619,"num_write_kb":1504166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:21.261469+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:52:21.261469+0000","last_peered":"2024-09-19T09:52:21.261469+0000","last_clean":"2024-09-19T09:52:21.261469+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:52:21.261469+0000","last_undegraded":"2024-09-19T09:52:21.261469+0000","last_fullsized":"2024-09-19T09:52:21.261469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'6985","reported_seq":7005,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508817+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:52:45.508817+0000","last_peered":"2024-09-19T09:52:45.508817+0000","last_clean":"2024-09-19T09:52:45.508817+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:52:45.508817+0000","last_undegraded":"2024-09-19T09:52:45.508817+0000","last_fullsized":"2024-09-19T09:52:45.508817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6985,"log_dups_size":0,"ondisk_log_size":6985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106286,"num_write_kb":1265589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'27","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.513741+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:52:45.513741+0000","last_peered":"2024-09-19T09:52:45.513741+0000","last_clean":"2024-09-19T09:52:45.513741+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:52:45.513741+0000","last_undegraded":"2024-09-19T09:52:45.513741+0000","last_fullsized":"2024-09-19T09:52:45.513741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'6097","reported_seq":6117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541773+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:52:45.541773+0000","last_peered":"2024-09-19T09:52:45.541773+0000","last_clean":"2024-09-19T09:52:45.541773+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:52:45.541773+0000","last_undegraded":"2024-09-19T09:52:45.541773+0000","last_fullsized":"2024-09-19T09:52:45.541773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6097,"log_dups_size":0,"ondisk_log_size":6097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92578,"num_write_kb":1120610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'145","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.535559+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:52:45.535559+0000","last_peered":"2024-09-19T09:52:45.535559+0000","last_clean":"2024-09-19T09:52:45.535559+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:52:45.535559+0000","last_undegraded":"2024-09-19T09:52:45.535559+0000","last_fullsized":"2024-09-19T09:52:45.535559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8081847,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":7956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9198","reported_seq":9218,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.474144+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:52:45.474144+0000","last_peered":"2024-09-19T09:52:45.474144+0000","last_clean":"2024-09-19T09:52:45.474144+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:52:45.474144+0000","last_undegraded":"2024-09-19T09:52:45.474144+0000","last_fullsized":"2024-09-19T09:52:45.474144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":9198,"log_dups_size":0,"ondisk_log_size":9198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140136,"num_write_kb":1697056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'234","reported_seq":256,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.501129+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:52:45.501129+0000","last_peered":"2024-09-19T09:52:45.501129+0000","last_clean":"2024-09-19T09:52:45.501129+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:52:45.501129+0000","last_undegraded":"2024-09-19T09:52:45.501129+0000","last_fullsized":"2024-09-19T09:52:45.501129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'6637","reported_seq":6657,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.611484+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:52:44.611484+0000","last_peered":"2024-09-19T09:52:44.611484+0000","last_clean":"2024-09-19T09:52:44.611484+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:52:44.611484+0000","last_undegraded":"2024-09-19T09:52:44.611484+0000","last_fullsized":"2024-09-19T09:52:44.611484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6637,"log_dups_size":0,"ondisk_log_size":6637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100932,"num_write_kb":1211662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520510+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:52:45.520510+0000","last_peered":"2024-09-19T09:52:45.520510+0000","last_clean":"2024-09-19T09:52:45.520510+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:52:45.520510+0000","last_undegraded":"2024-09-19T09:52:45.520510+0000","last_fullsized":"2024-09-19T09:52:45.520510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'6594","reported_seq":6614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.726783+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:52:44.726783+0000","last_peered":"2024-09-19T09:52:44.726783+0000","last_clean":"2024-09-19T09:52:44.726783+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:52:44.726783+0000","last_undegraded":"2024-09-19T09:52:44.726783+0000","last_fullsized":"2024-09-19T09:52:44.726783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6594,"log_dups_size":0,"ondisk_log_size":6594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100178,"num_write_kb":1211527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542370+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:52:45.542370+0000","last_peered":"2024-09-19T09:52:45.542370+0000","last_clean":"2024-09-19T09:52:45.542370+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:52:45.542370+0000","last_undegraded":"2024-09-19T09:52:45.542370+0000","last_fullsized":"2024-09-19T09:52:45.542370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'7757","reported_seq":7777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538835+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:52:45.538835+0000","last_peered":"2024-09-19T09:52:45.538835+0000","last_clean":"2024-09-19T09:52:45.538835+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:52:45.538835+0000","last_undegraded":"2024-09-19T09:52:45.538835+0000","last_fullsized":"2024-09-19T09:52:45.538835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7757,"log_dups_size":0,"ondisk_log_size":7757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118022,"num_write_kb":1435104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519810+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:52:45.519810+0000","last_peered":"2024-09-19T09:52:45.519810+0000","last_clean":"2024-09-19T09:52:45.519810+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:52:45.519810+0000","last_undegraded":"2024-09-19T09:52:45.519810+0000","last_fullsized":"2024-09-19T09:52:45.519810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'7341","reported_seq":7361,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.531573+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:52:45.531573+0000","last_peered":"2024-09-19T09:52:45.531573+0000","last_clean":"2024-09-19T09:52:45.531573+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:52:45.531573+0000","last_undegraded":"2024-09-19T09:52:45.531573+0000","last_fullsized":"2024-09-19T09:52:45.531573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7341,"log_dups_size":0,"ondisk_log_size":7341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111551,"num_write_kb":1366296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'36","reported_seq":58,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.490639+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:52:45.490639+0000","last_peered":"2024-09-19T09:52:45.490639+0000","last_clean":"2024-09-19T09:52:45.490639+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:52:45.490639+0000","last_undegraded":"2024-09-19T09:52:45.490639+0000","last_fullsized":"2024-09-19T09:52:45.490639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'6685","reported_seq":6705,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527282+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:52:45.527282+0000","last_peered":"2024-09-19T09:52:45.527282+0000","last_clean":"2024-09-19T09:52:45.527282+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:52:45.527282+0000","last_undegraded":"2024-09-19T09:52:45.527282+0000","last_fullsized":"2024-09-19T09:52:45.527282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6685,"log_dups_size":0,"ondisk_log_size":6685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101427,"num_write_kb":1285780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'17","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520111+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:52:45.520111+0000","last_peered":"2024-09-19T09:52:45.520111+0000","last_clean":"2024-09-19T09:52:45.520111+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:52:45.520111+0000","last_undegraded":"2024-09-19T09:52:45.520111+0000","last_fullsized":"2024-09-19T09:52:45.520111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'6797","reported_seq":6811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.461046+0000","last_change":"2024-09-19T09:43:20.619746+0000","last_active":"2024-09-19T09:52:45.461046+0000","last_peered":"2024-09-19T09:52:45.461046+0000","last_clean":"2024-09-19T09:52:45.461046+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:52:45.461046+0000","last_undegraded":"2024-09-19T09:52:45.461046+0000","last_fullsized":"2024-09-19T09:52:45.461046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6797,"log_dups_size":0,"ondisk_log_size":6797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:39.025798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103611,"num_write_kb":1225908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"25'19","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.525331+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:52:45.525331+0000","last_peered":"2024-09-19T09:52:45.525331+0000","last_clean":"2024-09-19T09:52:45.525331+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:52:45.525331+0000","last_undegraded":"2024-09-19T09:52:45.525331+0000","last_fullsized":"2024-09-19T09:52:45.525331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'8072","reported_seq":8092,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506996+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:52:45.506996+0000","last_peered":"2024-09-19T09:52:45.506996+0000","last_clean":"2024-09-19T09:52:45.506996+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:52:45.506996+0000","last_undegraded":"2024-09-19T09:52:45.506996+0000","last_fullsized":"2024-09-19T09:52:45.506996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8072,"log_dups_size":0,"ondisk_log_size":8072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122842,"num_write_kb":1473778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:39.088249+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:51:39.088249+0000","last_peered":"2024-09-19T09:51:39.088249+0000","last_clean":"2024-09-19T09:51:39.088249+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:51:39.088249+0000","last_undegraded":"2024-09-19T09:51:39.088249+0000","last_fullsized":"2024-09-19T09:51:39.088249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'7124","reported_seq":7138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.546437+0000","last_change":"2024-09-19T09:43:20.619216+0000","last_active":"2024-09-19T09:52:45.546437+0000","last_peered":"2024-09-19T09:52:45.546437+0000","last_clean":"2024-09-19T09:52:45.546437+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:52:45.546437+0000","last_undegraded":"2024-09-19T09:52:45.546437+0000","last_fullsized":"2024-09-19T09:52:45.546437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7124,"log_dups_size":0,"ondisk_log_size":7124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:14.168619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108281,"num_write_kb":1344761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:34.636798+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:51:34.636798+0000","last_peered":"2024-09-19T09:51:34.636798+0000","last_clean":"2024-09-19T09:51:34.636798+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:51:34.636798+0000","last_undegraded":"2024-09-19T09:51:34.636798+0000","last_fullsized":"2024-09-19T09:51:34.636798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'6852","reported_seq":6872,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.546768+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:52:45.546768+0000","last_peered":"2024-09-19T09:52:45.546768+0000","last_clean":"2024-09-19T09:52:45.546768+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:52:45.546768+0000","last_undegraded":"2024-09-19T09:52:45.546768+0000","last_fullsized":"2024-09-19T09:52:45.546768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6852,"log_dups_size":0,"ondisk_log_size":6852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104241,"num_write_kb":1288428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.775818+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:50:37.775818+0000","last_peered":"2024-09-19T09:50:37.775818+0000","last_clean":"2024-09-19T09:50:37.775818+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:50:37.775818+0000","last_undegraded":"2024-09-19T09:50:37.775818+0000","last_fullsized":"2024-09-19T09:50:37.775818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:58.592828+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:50:58.592828+0000","last_peered":"2024-09-19T09:50:58.592828+0000","last_clean":"2024-09-19T09:50:58.592828+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:50:58.592828+0000","last_undegraded":"2024-09-19T09:50:58.592828+0000","last_fullsized":"2024-09-19T09:50:58.592828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'7186","reported_seq":7207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.458691+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:52:45.458691+0000","last_peered":"2024-09-19T09:52:45.458691+0000","last_clean":"2024-09-19T09:52:45.458691+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:52:45.458691+0000","last_undegraded":"2024-09-19T09:52:45.458691+0000","last_fullsized":"2024-09-19T09:52:45.458691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109665,"num_write_kb":1344078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'51","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542830+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:52:45.542830+0000","last_peered":"2024-09-19T09:52:45.542830+0000","last_clean":"2024-09-19T09:52:45.542830+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:52:45.542830+0000","last_undegraded":"2024-09-19T09:52:45.542830+0000","last_fullsized":"2024-09-19T09:52:45.542830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'6521","reported_seq":6542,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.501975+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:52:45.501975+0000","last_peered":"2024-09-19T09:52:45.501975+0000","last_clean":"2024-09-19T09:52:45.501975+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:52:45.501975+0000","last_undegraded":"2024-09-19T09:52:45.501975+0000","last_fullsized":"2024-09-19T09:52:45.501975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6521,"log_dups_size":0,"ondisk_log_size":6521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99242,"num_write_kb":1260349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'26","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541286+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:52:45.541286+0000","last_peered":"2024-09-19T09:52:45.541286+0000","last_clean":"2024-09-19T09:52:45.541286+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:52:45.541286+0000","last_undegraded":"2024-09-19T09:52:45.541286+0000","last_fullsized":"2024-09-19T09:52:45.541286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":24,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'6585","reported_seq":6606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.532296+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:52:45.532296+0000","last_peered":"2024-09-19T09:52:45.532296+0000","last_clean":"2024-09-19T09:52:45.532296+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:52:45.532296+0000","last_undegraded":"2024-09-19T09:52:45.532296+0000","last_fullsized":"2024-09-19T09:52:45.532296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99779,"num_write_kb":1243684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'20","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527624+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:52:45.527624+0000","last_peered":"2024-09-19T09:52:45.527624+0000","last_clean":"2024-09-19T09:52:45.527624+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:52:45.527624+0000","last_undegraded":"2024-09-19T09:52:45.527624+0000","last_fullsized":"2024-09-19T09:52:45.527624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6375","reported_seq":6396,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.556240+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:52:45.556240+0000","last_peered":"2024-09-19T09:52:45.556240+0000","last_clean":"2024-09-19T09:52:45.556240+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:52:45.556240+0000","last_undegraded":"2024-09-19T09:52:45.556240+0000","last_fullsized":"2024-09-19T09:52:45.556240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6375,"log_dups_size":0,"ondisk_log_size":6375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97075,"num_write_kb":1245753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'17","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516603+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:52:45.516603+0000","last_peered":"2024-09-19T09:52:45.516603+0000","last_clean":"2024-09-19T09:52:45.516603+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:52:45.516603+0000","last_undegraded":"2024-09-19T09:52:45.516603+0000","last_fullsized":"2024-09-19T09:52:45.516603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5984","reported_seq":6005,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.533335+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:52:45.533335+0000","last_peered":"2024-09-19T09:52:45.533335+0000","last_clean":"2024-09-19T09:52:45.533335+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:52:45.533335+0000","last_undegraded":"2024-09-19T09:52:45.533335+0000","last_fullsized":"2024-09-19T09:52:45.533335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5984,"log_dups_size":0,"ondisk_log_size":5984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90916,"num_write_kb":1171530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.521454+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:52:45.521454+0000","last_peered":"2024-09-19T09:52:45.521454+0000","last_clean":"2024-09-19T09:52:45.521454+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:52:45.521454+0000","last_undegraded":"2024-09-19T09:52:45.521454+0000","last_fullsized":"2024-09-19T09:52:45.521454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7097","reported_seq":7118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549068+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:52:45.549068+0000","last_peered":"2024-09-19T09:52:45.549068+0000","last_clean":"2024-09-19T09:52:45.549068+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:52:45.549068+0000","last_undegraded":"2024-09-19T09:52:45.549068+0000","last_fullsized":"2024-09-19T09:52:45.549068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7097,"log_dups_size":0,"ondisk_log_size":7097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107857,"num_write_kb":1353549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'250","reported_seq":273,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:47.809450+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:52:47.809450+0000","last_peered":"2024-09-19T09:52:47.809450+0000","last_clean":"2024-09-19T09:52:47.809450+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:52:47.809450+0000","last_undegraded":"2024-09-19T09:52:47.809450+0000","last_fullsized":"2024-09-19T09:52:47.809450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'6905","reported_seq":6926,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.532439+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:52:45.532439+0000","last_peered":"2024-09-19T09:52:45.532439+0000","last_clean":"2024-09-19T09:52:45.532439+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:52:45.532439+0000","last_undegraded":"2024-09-19T09:52:45.532439+0000","last_fullsized":"2024-09-19T09:52:45.532439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6905,"log_dups_size":0,"ondisk_log_size":6905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104946,"num_write_kb":1269889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558520+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:52:45.558520+0000","last_peered":"2024-09-19T09:52:45.558520+0000","last_clean":"2024-09-19T09:52:45.558520+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:52:45.558520+0000","last_undegraded":"2024-09-19T09:52:45.558520+0000","last_fullsized":"2024-09-19T09:52:45.558520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'5813","reported_seq":5834,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.489594+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:52:45.489594+0000","last_peered":"2024-09-19T09:52:45.489594+0000","last_clean":"2024-09-19T09:52:45.489594+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:52:45.489594+0000","last_undegraded":"2024-09-19T09:52:45.489594+0000","last_fullsized":"2024-09-19T09:52:45.489594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5813,"log_dups_size":0,"ondisk_log_size":5813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88305,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.515790+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:52:45.515790+0000","last_peered":"2024-09-19T09:52:45.515790+0000","last_clean":"2024-09-19T09:52:45.515790+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:52:45.515790+0000","last_undegraded":"2024-09-19T09:52:45.515790+0000","last_fullsized":"2024-09-19T09:52:45.515790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'6610","reported_seq":6631,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.530709+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:52:45.530709+0000","last_peered":"2024-09-19T09:52:45.530709+0000","last_clean":"2024-09-19T09:52:45.530709+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:52:45.530709+0000","last_undegraded":"2024-09-19T09:52:45.530709+0000","last_fullsized":"2024-09-19T09:52:45.530709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100566,"num_write_kb":1195835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.502529+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:52:45.502529+0000","last_peered":"2024-09-19T09:52:45.502529+0000","last_clean":"2024-09-19T09:52:45.502529+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:52:45.502529+0000","last_undegraded":"2024-09-19T09:52:45.502529+0000","last_fullsized":"2024-09-19T09:52:45.502529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'6873","reported_seq":6887,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.780902+0000","last_change":"2024-09-19T09:43:20.620289+0000","last_active":"2024-09-19T09:52:44.780902+0000","last_peered":"2024-09-19T09:52:44.780902+0000","last_clean":"2024-09-19T09:52:44.780902+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:52:44.780902+0000","last_undegraded":"2024-09-19T09:52:44.780902+0000","last_fullsized":"2024-09-19T09:52:44.780902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:36.817715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104802,"num_write_kb":1303037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"25'20","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.523960+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:52:45.523960+0000","last_peered":"2024-09-19T09:52:45.523960+0000","last_clean":"2024-09-19T09:52:45.523960+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:52:45.523960+0000","last_undegraded":"2024-09-19T09:52:45.523960+0000","last_fullsized":"2024-09-19T09:52:45.523960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'5973","reported_seq":5993,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520284+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:52:45.520284+0000","last_peered":"2024-09-19T09:52:45.520284+0000","last_clean":"2024-09-19T09:52:45.520284+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:52:45.520284+0000","last_undegraded":"2024-09-19T09:52:45.520284+0000","last_fullsized":"2024-09-19T09:52:45.520284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5973,"log_dups_size":0,"ondisk_log_size":5973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91144,"num_write_kb":1060104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'181","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516531+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:52:45.516531+0000","last_peered":"2024-09-19T09:52:45.516531+0000","last_clean":"2024-09-19T09:52:45.516531+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:52:45.516531+0000","last_undegraded":"2024-09-19T09:52:45.516531+0000","last_fullsized":"2024-09-19T09:52:45.516531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'6186","reported_seq":6207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506944+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:52:45.506944+0000","last_peered":"2024-09-19T09:52:45.506944+0000","last_clean":"2024-09-19T09:52:45.506944+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:52:45.506944+0000","last_undegraded":"2024-09-19T09:52:45.506944+0000","last_fullsized":"2024-09-19T09:52:45.506944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6186,"log_dups_size":0,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94126,"num_write_kb":1169732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'8359","reported_seq":8373,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.868072+0000","last_change":"2024-09-19T09:43:20.620403+0000","last_active":"2024-09-19T09:52:45.868072+0000","last_peered":"2024-09-19T09:52:45.868072+0000","last_clean":"2024-09-19T09:52:45.868072+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:52:45.868072+0000","last_undegraded":"2024-09-19T09:52:45.868072+0000","last_fullsized":"2024-09-19T09:52:45.868072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8359,"log_dups_size":0,"ondisk_log_size":8359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:34.693485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127388,"num_write_kb":1561891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'7","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:41.359906+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:52:41.359906+0000","last_peered":"2024-09-19T09:52:41.359906+0000","last_clean":"2024-09-19T09:52:41.359906+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:52:41.359906+0000","last_undegraded":"2024-09-19T09:52:41.359906+0000","last_fullsized":"2024-09-19T09:52:41.359906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5047","reported_seq":5067,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.797581+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:52:44.797581+0000","last_peered":"2024-09-19T09:52:44.797581+0000","last_clean":"2024-09-19T09:52:44.797581+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:52:44.797581+0000","last_undegraded":"2024-09-19T09:52:44.797581+0000","last_fullsized":"2024-09-19T09:52:44.797581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76792,"num_write_kb":903119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'48","reported_seq":70,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508070+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:52:45.508070+0000","last_peered":"2024-09-19T09:52:45.508070+0000","last_clean":"2024-09-19T09:52:45.508070+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:52:45.508070+0000","last_undegraded":"2024-09-19T09:52:45.508070+0000","last_fullsized":"2024-09-19T09:52:45.508070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":16399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'8294","reported_seq":8315,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.554207+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:52:45.554207+0000","last_peered":"2024-09-19T09:52:45.554207+0000","last_clean":"2024-09-19T09:52:45.554207+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:52:45.554207+0000","last_undegraded":"2024-09-19T09:52:45.554207+0000","last_fullsized":"2024-09-19T09:52:45.554207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8294,"log_dups_size":0,"ondisk_log_size":8294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125930,"num_write_kb":1569689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'26","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.539717+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:52:45.539717+0000","last_peered":"2024-09-19T09:52:45.539717+0000","last_clean":"2024-09-19T09:52:45.539717+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:52:45.539717+0000","last_undegraded":"2024-09-19T09:52:45.539717+0000","last_fullsized":"2024-09-19T09:52:45.539717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'7281","reported_seq":7302,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.942091+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:52:44.942091+0000","last_peered":"2024-09-19T09:52:44.942091+0000","last_clean":"2024-09-19T09:52:44.942091+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:52:44.942091+0000","last_undegraded":"2024-09-19T09:52:44.942091+0000","last_fullsized":"2024-09-19T09:52:44.942091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7281,"log_dups_size":0,"ondisk_log_size":7281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110915,"num_write_kb":1387536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'21","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:55.215897+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:50:55.215897+0000","last_peered":"2024-09-19T09:50:55.215897+0000","last_clean":"2024-09-19T09:50:55.215897+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:50:55.215897+0000","last_undegraded":"2024-09-19T09:50:55.215897+0000","last_fullsized":"2024-09-19T09:50:55.215897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6761782,"num_write_kb":82954764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":444424,"ondisk_log_size":444424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":209497899,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":2655,"num_write_kb":206604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":419061760,"data_stored":418995798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2580,"ondisk_log_size":2580,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509576,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705108,"kb_used_data":78660,"kb_used_omap":1,"kb_used_meta":626430,"kb_avail":93666732,"statfs":{"total":96636764160,"available":95914733568,"internally_reserved":0,"allocated":80547840,"data_stored":80376143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":641464778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443924,"kb_used_data":61700,"kb_used_omap":1,"kb_used_meta":382206,"kb_avail":93927916,"statfs":{"total":96636764160,"available":96182185984,"internally_reserved":0,"allocated":63180800,"data_stored":63008649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":391379398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509575,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653352,"kb_used_data":49112,"kb_used_omap":1,"kb_used_meta":604222,"kb_avail":93718488,"statfs":{"total":96636764160,"available":95967731712,"internally_reserved":0,"allocated":50290688,"data_stored":50118304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618723781},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":679896,"kb_used_data":57608,"kb_used_omap":1,"kb_used_meta":622270,"kb_avail":93691944,"statfs":{"total":96636764160,"available":95940550656,"internally_reserved":0,"allocated":58990592,"data_stored":58813799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":637204933},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":649708,"kb_used_data":41308,"kb_used_omap":1,"kb_used_meta":608382,"kb_avail":93722132,"statfs":{"total":96636764160,"available":95971463168,"internally_reserved":0,"allocated":42299392,"data_stored":42125209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":622983623},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435372,"kb_used_data":57308,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93936468,"statfs":{"total":96636764160,"available":96190943232,"internally_reserved":0,"allocated":58683392,"data_stored":58506982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":387119557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":654364,"kb_used_data":45900,"kb_used_omap":1,"kb_used_meta":608446,"kb_avail":93717476,"statfs":{"total":96636764160,"available":95966695424,"internally_reserved":0,"allocated":47001600,"data_stored":46821767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":623049158},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421092,"kb_used_data":20820,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93950748,"statfs":{"total":96636764160,"available":96205565952,"internally_reserved":0,"allocated":21319680,"data_stored":21153017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":409860549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58425344,"data_stored":58413565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":21059600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42041344,"data_stored":42031792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58732544,"data_stored":58720382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50032640,"data_stored":50024887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:53:36.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:53:36.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.322+0000 7f93c8778640 1 Processor -- start 2024-09-19T09:53:36.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.322+0000 7f93c8778640 1 -- start start 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c8778640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f93c00c7f40 0x7f93c00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c8778640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f93c00c8400 0x7f93c00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c8778640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c015c240 con 0x7f93c0155650 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c8778640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f93c0155a30 con 0x7f93c00c8400 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c8778640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f93c015b3e0 con 0x7f93c00c7f40 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f93c00c8400 0x7f93c00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f93c00c8400 0x7f93c00cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58260/0 (socket says 172.21.15.123:58260) 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6514640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f93c0155650 0x7f93c00cc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59748/0 (socket says 172.21.15.123:59748) 2024-09-19T09:53:36.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 -- 172.21.15.123:0/154434374 learned_addr learned my addr 172.21.15.123:0/154434374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:36.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c5d13640 1 --2- 172.21.15.123:0/154434374 >> v2:172.21.15.194:3300/0 conn(0x7f93c00c7f40 0x7f93c00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 -- 172.21.15.123:0/154434374 >> v2:172.21.15.194:3300/0 conn(0x7f93c00c7f40 msgr2=0x7f93c00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 --2- 172.21.15.123:0/154434374 >> v2:172.21.15.194:3300/0 conn(0x7f93c00c7f40 0x7f93c00cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 -- 172.21.15.123:0/154434374 >> v1:172.21.15.123:6789/0 conn(0x7f93c0155650 legacy=0x7f93c00cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c6d15640 1 -- 172.21.15.123:0/154434374 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c015b6c0 con 0x7f93c00c8400 2024-09-19T09:53:36.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.323+0000 7f93c5512640 1 -- 172.21.15.123:0/154434374 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564618189 0 0) 0x7f93c015c240 con 0x7f93c0155650 2024-09-19T09:53:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.324+0000 7f93c6d15640 1 --2- 172.21.15.123:0/154434374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c00c8400 0x7f93c00cbd30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93c00ca840 tx=0x7f93b802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c946c4a7e51a2f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.324+0000 7f93c5512640 1 -- 172.21.15.123:0/154434374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8036070 con 0x7f93c00c8400 2024-09-19T09:53:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.324+0000 7f93c5512640 1 -- 172.21.15.123:0/154434374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b8031600 con 0x7f93c00c8400 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.324+0000 7f93c5512640 1 -- 172.21.15.123:0/154434374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b80319d0 con 0x7f93c00c8400 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 -- 172.21.15.123:0/154434374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c00c8400 msgr2=0x7f93c00cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 --2- 172.21.15.123:0/154434374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c00c8400 0x7f93c00cbd30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93c00ca840 tx=0x7f93b802a730 comp rx=0 tx=0).stop 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 -- 172.21.15.123:0/154434374 shutdown_connections 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 --2- 172.21.15.123:0/154434374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c00c8400 0x7f93c00cbd30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 --2- 172.21.15.123:0/154434374 >> v2:172.21.15.194:3300/0 conn(0x7f93c00c7f40 0x7f93c00cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 -- 172.21.15.123:0/154434374 >> 172.21.15.123:0/154434374 conn(0x7f93c00cd5c0 msgr2=0x7f93c00cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 -- 172.21.15.123:0/154434374 shutdown_connections 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.325+0000 7f93c8778640 1 -- 172.21.15.123:0/154434374 wait complete. 2024-09-19T09:53:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.326+0000 7f93c8778640 1 Processor -- start 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.326+0000 7f93c8778640 1 -- start start 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93c00c7f40 0x7f93c01f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93c00c8400 0x7f93c01e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 0x7f93c01e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93c015bf60 con 0x7f93c0155650 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f93c015bc80 con 0x7f93c00c7f40 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f93c00ce430 con 0x7f93c00c8400 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 0x7f93c01e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6514640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93c00c7f40 0x7f93c01f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 0x7f93c01e2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58270/0 (socket says 172.21.15.123:58270) 2024-09-19T09:53:36.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 -- 172.21.15.123:0/2509663089 learned_addr learned my addr 172.21.15.123:0/2509663089 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c5d13640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93c00c8400 0x7f93c01e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 -- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93c00c8400 msgr2=0x7f93c01e27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93c00c8400 0x7f93c01e27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 -- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93c00c7f40 msgr2=0x7f93c01f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93c00c7f40 0x7f93c01f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 -- 172.21.15.123:0/2509663089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c01f4f80 con 0x7f93c0155650 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c6d15640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 0x7f93c01e2d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009f40 tx=0x7f93b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b803f020 con 0x7f93c0155650 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b8037040 con 0x7f93c0155650 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.327+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c014f910 con 0x7f93c0155650 2024-09-19T09:53:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.328+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8036070 con 0x7f93c0155650 2024-09-19T09:53:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.328+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c014fed0 con 0x7f93c0155650 2024-09-19T09:53:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.328+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c01500a0 con 0x7f93c0155650 2024-09-19T09:53:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.329+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f93b8042020 con 0x7f93c0155650 2024-09-19T09:53:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.329+0000 7f93b6ffd640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f93a406c2b0 0x7f93a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.330+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f93b80ab810 con 0x7f93c0155650 2024-09-19T09:53:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.330+0000 7f93c6514640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f93a406c2b0 0x7f93a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.330+0000 7f93c6514640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f93a406c2b0 0x7f93a406e770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93bc007fd0 tx=0x7f93bc007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.334+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f93b8049030 con 0x7f93c0155650 2024-09-19T09:53:36.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.502+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93c00b6690 con 0x7f93a406c2b0 2024-09-19T09:53:36.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.508+0000 7f93b6ffd640 1 -- 172.21.15.123:0/2509663089 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253910 (secure 0 0 0) 0x7f93c00b6690 con 0x7f93a406c2b0 2024-09-19T09:53:36.512 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:53:36.514 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:53:36.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f93a406c2b0 msgr2=0x7f93a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f93a406c2b0 0x7f93a406e770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93bc007fd0 tx=0x7f93bc007de0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 msgr2=0x7f93c01e2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 0x7f93c01e2d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009f40 tx=0x7f93b8004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 shutdown_connections 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93c0155650 0x7f93c01e2d10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f93a406c2b0 0x7f93a406e770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93c00c8400 0x7f93c01e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 --2- 172.21.15.123:0/2509663089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93c00c7f40 0x7f93c01f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 >> 172.21.15.123:0/2509663089 conn(0x7f93c00cd5c0 msgr2=0x7f93c00c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 shutdown_connections 2024-09-19T09:53:36.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.511+0000 7f93c8778640 1 -- 172.21.15.123:0/2509663089 wait complete. 2024-09-19T09:53:36.524 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-19T09:53:34.894076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210088267,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":140,"num_read_kb":201,"num_write":6764596,"num_write_kb":83163784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447121,"ondisk_log_size":447121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4642816,"kb_used_data":412416,"kb_used_omap":12,"kb_used_meta":4230259,"kb_avail":750331904,"statfs":{"total":773094113280,"available":768339869696,"internally_reserved":0,"allocated":422313984,"data_stored":420923870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":4331785777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"3.3f","version":"25'5955","reported_seq":5976,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.544765+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:52:45.544765+0000","last_peered":"2024-09-19T09:52:45.544765+0000","last_clean":"2024-09-19T09:52:45.544765+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:52:45.544765+0000","last_undegraded":"2024-09-19T09:52:45.544765+0000","last_fullsized":"2024-09-19T09:52:45.544765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5955,"log_dups_size":0,"ondisk_log_size":5955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90667,"num_write_kb":1126123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'8754","reported_seq":8775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.556938+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:52:45.556938+0000","last_peered":"2024-09-19T09:52:45.556938+0000","last_clean":"2024-09-19T09:52:45.556938+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:52:45.556938+0000","last_undegraded":"2024-09-19T09:52:45.556938+0000","last_fullsized":"2024-09-19T09:52:45.556938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8754,"log_dups_size":0,"ondisk_log_size":8754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133411,"num_write_kb":1655568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7056","reported_seq":7077,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.534391+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:52:45.534391+0000","last_peered":"2024-09-19T09:52:45.534391+0000","last_clean":"2024-09-19T09:52:45.534391+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:52:45.534391+0000","last_undegraded":"2024-09-19T09:52:45.534391+0000","last_fullsized":"2024-09-19T09:52:45.534391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7056,"log_dups_size":0,"ondisk_log_size":7056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107453,"num_write_kb":1318687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'6123","reported_seq":6144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.545508+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:52:44.545508+0000","last_peered":"2024-09-19T09:52:44.545508+0000","last_clean":"2024-09-19T09:52:44.545508+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:52:44.545508+0000","last_undegraded":"2024-09-19T09:52:44.545508+0000","last_fullsized":"2024-09-19T09:52:44.545508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6123,"log_dups_size":0,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93226,"num_write_kb":1192949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'8352","reported_seq":8372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.561761+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:52:45.561761+0000","last_peered":"2024-09-19T09:52:45.561761+0000","last_clean":"2024-09-19T09:52:45.561761+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:52:45.561761+0000","last_undegraded":"2024-09-19T09:52:45.561761+0000","last_fullsized":"2024-09-19T09:52:45.561761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8352,"log_dups_size":0,"ondisk_log_size":8352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127203,"num_write_kb":1494052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6127","reported_seq":6147,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.739185+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:52:44.739185+0000","last_peered":"2024-09-19T09:52:44.739185+0000","last_clean":"2024-09-19T09:52:44.739185+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:52:44.739185+0000","last_undegraded":"2024-09-19T09:52:44.739185+0000","last_fullsized":"2024-09-19T09:52:44.739185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6127,"log_dups_size":0,"ondisk_log_size":6127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93163,"num_write_kb":1116253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'6602","reported_seq":6622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.557090+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:52:45.557090+0000","last_peered":"2024-09-19T09:52:45.557090+0000","last_clean":"2024-09-19T09:52:45.557090+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:52:45.557090+0000","last_undegraded":"2024-09-19T09:52:45.557090+0000","last_fullsized":"2024-09-19T09:52:45.557090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6602,"log_dups_size":0,"ondisk_log_size":6602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100493,"num_write_kb":1261887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'7464","reported_seq":7484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.725996+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:52:44.725996+0000","last_peered":"2024-09-19T09:52:44.725996+0000","last_clean":"2024-09-19T09:52:44.725996+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:52:44.725996+0000","last_undegraded":"2024-09-19T09:52:44.725996+0000","last_fullsized":"2024-09-19T09:52:44.725996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113853,"num_write_kb":1361930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'8241","reported_seq":8261,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.779815+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:52:44.779815+0000","last_peered":"2024-09-19T09:52:44.779815+0000","last_clean":"2024-09-19T09:52:44.779815+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:52:44.779815+0000","last_undegraded":"2024-09-19T09:52:44.779815+0000","last_fullsized":"2024-09-19T09:52:44.779815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8241,"log_dups_size":0,"ondisk_log_size":8241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125203,"num_write_kb":1603079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'7720","reported_seq":7740,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.495424+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:52:45.495424+0000","last_peered":"2024-09-19T09:52:45.495424+0000","last_clean":"2024-09-19T09:52:45.495424+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:52:45.495424+0000","last_undegraded":"2024-09-19T09:52:45.495424+0000","last_fullsized":"2024-09-19T09:52:45.495424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7720,"log_dups_size":0,"ondisk_log_size":7720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117401,"num_write_kb":1489402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'6676","reported_seq":6696,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.736174+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:52:44.736174+0000","last_peered":"2024-09-19T09:52:44.736174+0000","last_clean":"2024-09-19T09:52:44.736174+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:52:44.736174+0000","last_undegraded":"2024-09-19T09:52:44.736174+0000","last_fullsized":"2024-09-19T09:52:44.736174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6676,"log_dups_size":0,"ondisk_log_size":6676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101709,"num_write_kb":1228477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'5916","reported_seq":5936,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.474457+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:52:45.474457+0000","last_peered":"2024-09-19T09:52:45.474457+0000","last_clean":"2024-09-19T09:52:45.474457+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:52:45.474457+0000","last_undegraded":"2024-09-19T09:52:45.474457+0000","last_fullsized":"2024-09-19T09:52:45.474457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5916,"log_dups_size":0,"ondisk_log_size":5916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90039,"num_write_kb":1066111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'6228","reported_seq":6248,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538290+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:52:45.538290+0000","last_peered":"2024-09-19T09:52:45.538290+0000","last_clean":"2024-09-19T09:52:45.538290+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:52:45.538290+0000","last_undegraded":"2024-09-19T09:52:45.538290+0000","last_fullsized":"2024-09-19T09:52:45.538290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6228,"log_dups_size":0,"ondisk_log_size":6228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94800,"num_write_kb":1191870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'7094","reported_seq":7114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.468110+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:52:45.468110+0000","last_peered":"2024-09-19T09:52:45.468110+0000","last_clean":"2024-09-19T09:52:45.468110+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:52:45.468110+0000","last_undegraded":"2024-09-19T09:52:45.468110+0000","last_fullsized":"2024-09-19T09:52:45.468110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7094,"log_dups_size":0,"ondisk_log_size":7094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107699,"num_write_kb":1339564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'7235","reported_seq":7255,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519773+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:52:45.519773+0000","last_peered":"2024-09-19T09:52:45.519773+0000","last_clean":"2024-09-19T09:52:45.519773+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:52:45.519773+0000","last_undegraded":"2024-09-19T09:52:45.519773+0000","last_fullsized":"2024-09-19T09:52:45.519773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109960,"num_write_kb":1298661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'6065","reported_seq":6085,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.479454+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:52:45.479454+0000","last_peered":"2024-09-19T09:52:45.479454+0000","last_clean":"2024-09-19T09:52:45.479454+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:52:45.479454+0000","last_undegraded":"2024-09-19T09:52:45.479454+0000","last_fullsized":"2024-09-19T09:52:45.479454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92239,"num_write_kb":1166043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8309","reported_seq":8329,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.495740+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:52:45.495740+0000","last_peered":"2024-09-19T09:52:45.495740+0000","last_clean":"2024-09-19T09:52:45.495740+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:52:45.495740+0000","last_undegraded":"2024-09-19T09:52:45.495740+0000","last_fullsized":"2024-09-19T09:52:45.495740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8309,"log_dups_size":0,"ondisk_log_size":8309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126488,"num_write_kb":1557261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'5639","reported_seq":5659,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549778+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:52:45.549778+0000","last_peered":"2024-09-19T09:52:45.549778+0000","last_clean":"2024-09-19T09:52:45.549778+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:52:45.549778+0000","last_undegraded":"2024-09-19T09:52:45.549778+0000","last_fullsized":"2024-09-19T09:52:45.549778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5639,"log_dups_size":0,"ondisk_log_size":5639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85570,"num_write_kb":1023683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'6866","reported_seq":6886,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538514+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:52:45.538514+0000","last_peered":"2024-09-19T09:52:45.538514+0000","last_clean":"2024-09-19T09:52:45.538514+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:52:45.538514+0000","last_undegraded":"2024-09-19T09:52:45.538514+0000","last_fullsized":"2024-09-19T09:52:45.538514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6866,"log_dups_size":0,"ondisk_log_size":6866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104491,"num_write_kb":1253325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'6773","reported_seq":6793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.529598+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:52:45.529598+0000","last_peered":"2024-09-19T09:52:45.529598+0000","last_clean":"2024-09-19T09:52:45.529598+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:52:45.529598+0000","last_undegraded":"2024-09-19T09:52:45.529598+0000","last_fullsized":"2024-09-19T09:52:45.529598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6773,"log_dups_size":0,"ondisk_log_size":6773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103096,"num_write_kb":1273163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'7058","reported_seq":7078,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.533572+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:52:45.533572+0000","last_peered":"2024-09-19T09:52:45.533572+0000","last_clean":"2024-09-19T09:52:45.533572+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:52:45.533572+0000","last_undegraded":"2024-09-19T09:52:45.533572+0000","last_fullsized":"2024-09-19T09:52:45.533572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7058,"log_dups_size":0,"ondisk_log_size":7058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107113,"num_write_kb":1305966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'7483","reported_seq":7503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.802426+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:52:44.802426+0000","last_peered":"2024-09-19T09:52:44.802426+0000","last_clean":"2024-09-19T09:52:44.802426+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:52:44.802426+0000","last_undegraded":"2024-09-19T09:52:44.802426+0000","last_fullsized":"2024-09-19T09:52:44.802426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7483,"log_dups_size":0,"ondisk_log_size":7483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113925,"num_write_kb":1408486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'6876","reported_seq":6896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.727578+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:52:44.727578+0000","last_peered":"2024-09-19T09:52:44.727578+0000","last_clean":"2024-09-19T09:52:44.727578+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:52:44.727578+0000","last_undegraded":"2024-09-19T09:52:44.727578+0000","last_fullsized":"2024-09-19T09:52:44.727578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104459,"num_write_kb":1263249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'6113","reported_seq":6133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538211+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:52:45.538211+0000","last_peered":"2024-09-19T09:52:45.538211+0000","last_clean":"2024-09-19T09:52:45.538211+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:52:45.538211+0000","last_undegraded":"2024-09-19T09:52:45.538211+0000","last_fullsized":"2024-09-19T09:52:45.538211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6113,"log_dups_size":0,"ondisk_log_size":6113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93016,"num_write_kb":1127551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'8000","reported_seq":8021,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.550005+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:52:45.550005+0000","last_peered":"2024-09-19T09:52:45.550005+0000","last_clean":"2024-09-19T09:52:45.550005+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:52:45.550005+0000","last_undegraded":"2024-09-19T09:52:45.550005+0000","last_fullsized":"2024-09-19T09:52:45.550005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8000,"log_dups_size":0,"ondisk_log_size":8000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121789,"num_write_kb":1510406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'6207","reported_seq":6228,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.531220+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:52:45.531220+0000","last_peered":"2024-09-19T09:52:45.531220+0000","last_clean":"2024-09-19T09:52:45.531220+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:52:45.531220+0000","last_undegraded":"2024-09-19T09:52:45.531220+0000","last_fullsized":"2024-09-19T09:52:45.531220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6207,"log_dups_size":0,"ondisk_log_size":6207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94313,"num_write_kb":1157877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'7387","reported_seq":7408,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549991+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:52:45.549991+0000","last_peered":"2024-09-19T09:52:45.549991+0000","last_clean":"2024-09-19T09:52:45.549991+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:52:45.549991+0000","last_undegraded":"2024-09-19T09:52:45.549991+0000","last_fullsized":"2024-09-19T09:52:45.549991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7387,"log_dups_size":0,"ondisk_log_size":7387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112469,"num_write_kb":1393395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'6312","reported_seq":6333,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.559946+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:52:45.559946+0000","last_peered":"2024-09-19T09:52:45.559946+0000","last_clean":"2024-09-19T09:52:45.559946+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:52:45.559946+0000","last_undegraded":"2024-09-19T09:52:45.559946+0000","last_fullsized":"2024-09-19T09:52:45.559946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6312,"log_dups_size":0,"ondisk_log_size":6312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96072,"num_write_kb":1169122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'5898","reported_seq":5919,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.523449+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:52:45.523449+0000","last_peered":"2024-09-19T09:52:45.523449+0000","last_clean":"2024-09-19T09:52:45.523449+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:52:45.523449+0000","last_undegraded":"2024-09-19T09:52:45.523449+0000","last_fullsized":"2024-09-19T09:52:45.523449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5898,"log_dups_size":0,"ondisk_log_size":5898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89887,"num_write_kb":1118423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'8484","reported_seq":8505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.555300+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:52:45.555300+0000","last_peered":"2024-09-19T09:52:45.555300+0000","last_clean":"2024-09-19T09:52:45.555300+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:52:45.555300+0000","last_undegraded":"2024-09-19T09:52:45.555300+0000","last_fullsized":"2024-09-19T09:52:45.555300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8484,"log_dups_size":0,"ondisk_log_size":8484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129293,"num_write_kb":1558943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'7295","reported_seq":7316,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.799433+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:52:44.799433+0000","last_peered":"2024-09-19T09:52:44.799433+0000","last_clean":"2024-09-19T09:52:44.799433+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:52:44.799433+0000","last_undegraded":"2024-09-19T09:52:44.799433+0000","last_fullsized":"2024-09-19T09:52:44.799433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7295,"log_dups_size":0,"ondisk_log_size":7295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111025,"num_write_kb":1382740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'8637","reported_seq":8658,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.553761+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:52:45.553761+0000","last_peered":"2024-09-19T09:52:45.553761+0000","last_clean":"2024-09-19T09:52:45.553761+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:52:45.553761+0000","last_undegraded":"2024-09-19T09:52:45.553761+0000","last_fullsized":"2024-09-19T09:52:45.553761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8637,"log_dups_size":0,"ondisk_log_size":8637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131457,"num_write_kb":1608657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'5965","reported_seq":5985,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.511836+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:52:45.511836+0000","last_peered":"2024-09-19T09:52:45.511836+0000","last_clean":"2024-09-19T09:52:45.511836+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:52:45.511836+0000","last_undegraded":"2024-09-19T09:52:45.511836+0000","last_fullsized":"2024-09-19T09:52:45.511836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90903,"num_write_kb":1098126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1242","reported_seq":1264,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:39.669842+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:52:39.669842+0000","last_peered":"2024-09-19T09:52:39.669842+0000","last_clean":"2024-09-19T09:52:39.669842+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:52:39.669842+0000","last_undegraded":"2024-09-19T09:52:39.669842+0000","last_fullsized":"2024-09-19T09:52:39.669842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":5249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5275","reported_seq":5295,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.480284+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:52:45.480284+0000","last_peered":"2024-09-19T09:52:45.480284+0000","last_clean":"2024-09-19T09:52:45.480284+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:52:45.480284+0000","last_undegraded":"2024-09-19T09:52:45.480284+0000","last_fullsized":"2024-09-19T09:52:45.480284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80097,"num_write_kb":999347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'43","reported_seq":65,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506874+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:52:45.506874+0000","last_peered":"2024-09-19T09:52:45.506874+0000","last_clean":"2024-09-19T09:52:45.506874+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:52:45.506874+0000","last_undegraded":"2024-09-19T09:52:45.506874+0000","last_fullsized":"2024-09-19T09:52:45.506874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":16406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:29.642711+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:52:29.642711+0000","last_peered":"2024-09-19T09:52:29.642711+0000","last_clean":"2024-09-19T09:52:29.642711+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:52:29.642711+0000","last_undegraded":"2024-09-19T09:52:29.642711+0000","last_fullsized":"2024-09-19T09:52:29.642711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'6888","reported_seq":6908,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558630+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:52:45.558630+0000","last_peered":"2024-09-19T09:52:45.558630+0000","last_clean":"2024-09-19T09:52:45.558630+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:52:45.558630+0000","last_undegraded":"2024-09-19T09:52:45.558630+0000","last_fullsized":"2024-09-19T09:52:45.558630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6888,"log_dups_size":0,"ondisk_log_size":6888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104648,"num_write_kb":1287559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'31","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.798938+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:52:44.798938+0000","last_peered":"2024-09-19T09:52:44.798938+0000","last_clean":"2024-09-19T09:52:44.798938+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:52:44.798938+0000","last_undegraded":"2024-09-19T09:52:44.798938+0000","last_fullsized":"2024-09-19T09:52:44.798938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'8123","reported_seq":8143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.554490+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:52:45.554490+0000","last_peered":"2024-09-19T09:52:45.554490+0000","last_clean":"2024-09-19T09:52:45.554490+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:52:45.554490+0000","last_undegraded":"2024-09-19T09:52:45.554490+0000","last_fullsized":"2024-09-19T09:52:45.554490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8123,"log_dups_size":0,"ondisk_log_size":8123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123619,"num_write_kb":1504166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:21.261469+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:52:21.261469+0000","last_peered":"2024-09-19T09:52:21.261469+0000","last_clean":"2024-09-19T09:52:21.261469+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:52:21.261469+0000","last_undegraded":"2024-09-19T09:52:21.261469+0000","last_fullsized":"2024-09-19T09:52:21.261469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'6985","reported_seq":7005,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508817+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:52:45.508817+0000","last_peered":"2024-09-19T09:52:45.508817+0000","last_clean":"2024-09-19T09:52:45.508817+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:52:45.508817+0000","last_undegraded":"2024-09-19T09:52:45.508817+0000","last_fullsized":"2024-09-19T09:52:45.508817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6985,"log_dups_size":0,"ondisk_log_size":6985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106286,"num_write_kb":1265589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'27","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.513741+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:52:45.513741+0000","last_peered":"2024-09-19T09:52:45.513741+0000","last_clean":"2024-09-19T09:52:45.513741+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:52:45.513741+0000","last_undegraded":"2024-09-19T09:52:45.513741+0000","last_fullsized":"2024-09-19T09:52:45.513741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'6097","reported_seq":6117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541773+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:52:45.541773+0000","last_peered":"2024-09-19T09:52:45.541773+0000","last_clean":"2024-09-19T09:52:45.541773+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:52:45.541773+0000","last_undegraded":"2024-09-19T09:52:45.541773+0000","last_fullsized":"2024-09-19T09:52:45.541773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6097,"log_dups_size":0,"ondisk_log_size":6097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92578,"num_write_kb":1120610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'145","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.535559+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:52:45.535559+0000","last_peered":"2024-09-19T09:52:45.535559+0000","last_clean":"2024-09-19T09:52:45.535559+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:52:45.535559+0000","last_undegraded":"2024-09-19T09:52:45.535559+0000","last_fullsized":"2024-09-19T09:52:45.535559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8081847,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":7956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9198","reported_seq":9218,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.474144+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:52:45.474144+0000","last_peered":"2024-09-19T09:52:45.474144+0000","last_clean":"2024-09-19T09:52:45.474144+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:52:45.474144+0000","last_undegraded":"2024-09-19T09:52:45.474144+0000","last_fullsized":"2024-09-19T09:52:45.474144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":9198,"log_dups_size":0,"ondisk_log_size":9198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140136,"num_write_kb":1697056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'234","reported_seq":256,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.501129+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:52:45.501129+0000","last_peered":"2024-09-19T09:52:45.501129+0000","last_clean":"2024-09-19T09:52:45.501129+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:52:45.501129+0000","last_undegraded":"2024-09-19T09:52:45.501129+0000","last_fullsized":"2024-09-19T09:52:45.501129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'6637","reported_seq":6657,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.611484+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:52:44.611484+0000","last_peered":"2024-09-19T09:52:44.611484+0000","last_clean":"2024-09-19T09:52:44.611484+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:52:44.611484+0000","last_undegraded":"2024-09-19T09:52:44.611484+0000","last_fullsized":"2024-09-19T09:52:44.611484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6637,"log_dups_size":0,"ondisk_log_size":6637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100932,"num_write_kb":1211662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520510+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:52:45.520510+0000","last_peered":"2024-09-19T09:52:45.520510+0000","last_clean":"2024-09-19T09:52:45.520510+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:52:45.520510+0000","last_undegraded":"2024-09-19T09:52:45.520510+0000","last_fullsized":"2024-09-19T09:52:45.520510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'6594","reported_seq":6614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.726783+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:52:44.726783+0000","last_peered":"2024-09-19T09:52:44.726783+0000","last_clean":"2024-09-19T09:52:44.726783+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:52:44.726783+0000","last_undegraded":"2024-09-19T09:52:44.726783+0000","last_fullsized":"2024-09-19T09:52:44.726783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6594,"log_dups_size":0,"ondisk_log_size":6594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100178,"num_write_kb":1211527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542370+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:52:45.542370+0000","last_peered":"2024-09-19T09:52:45.542370+0000","last_clean":"2024-09-19T09:52:45.542370+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:52:45.542370+0000","last_undegraded":"2024-09-19T09:52:45.542370+0000","last_fullsized":"2024-09-19T09:52:45.542370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'7757","reported_seq":7777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538835+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:52:45.538835+0000","last_peered":"2024-09-19T09:52:45.538835+0000","last_clean":"2024-09-19T09:52:45.538835+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:52:45.538835+0000","last_undegraded":"2024-09-19T09:52:45.538835+0000","last_fullsized":"2024-09-19T09:52:45.538835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7757,"log_dups_size":0,"ondisk_log_size":7757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118022,"num_write_kb":1435104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519810+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:52:45.519810+0000","last_peered":"2024-09-19T09:52:45.519810+0000","last_clean":"2024-09-19T09:52:45.519810+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:52:45.519810+0000","last_undegraded":"2024-09-19T09:52:45.519810+0000","last_fullsized":"2024-09-19T09:52:45.519810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'7341","reported_seq":7361,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.531573+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:52:45.531573+0000","last_peered":"2024-09-19T09:52:45.531573+0000","last_clean":"2024-09-19T09:52:45.531573+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:52:45.531573+0000","last_undegraded":"2024-09-19T09:52:45.531573+0000","last_fullsized":"2024-09-19T09:52:45.531573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7341,"log_dups_size":0,"ondisk_log_size":7341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111551,"num_write_kb":1366296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'36","reported_seq":58,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.490639+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:52:45.490639+0000","last_peered":"2024-09-19T09:52:45.490639+0000","last_clean":"2024-09-19T09:52:45.490639+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:52:45.490639+0000","last_undegraded":"2024-09-19T09:52:45.490639+0000","last_fullsized":"2024-09-19T09:52:45.490639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'6685","reported_seq":6705,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527282+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:52:45.527282+0000","last_peered":"2024-09-19T09:52:45.527282+0000","last_clean":"2024-09-19T09:52:45.527282+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:52:45.527282+0000","last_undegraded":"2024-09-19T09:52:45.527282+0000","last_fullsized":"2024-09-19T09:52:45.527282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6685,"log_dups_size":0,"ondisk_log_size":6685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101427,"num_write_kb":1285780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'17","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520111+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:52:45.520111+0000","last_peered":"2024-09-19T09:52:45.520111+0000","last_clean":"2024-09-19T09:52:45.520111+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:52:45.520111+0000","last_undegraded":"2024-09-19T09:52:45.520111+0000","last_fullsized":"2024-09-19T09:52:45.520111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'6797","reported_seq":6811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.461046+0000","last_change":"2024-09-19T09:43:20.619746+0000","last_active":"2024-09-19T09:52:45.461046+0000","last_peered":"2024-09-19T09:52:45.461046+0000","last_clean":"2024-09-19T09:52:45.461046+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:52:45.461046+0000","last_undegraded":"2024-09-19T09:52:45.461046+0000","last_fullsized":"2024-09-19T09:52:45.461046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6797,"log_dups_size":0,"ondisk_log_size":6797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:39.025798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103611,"num_write_kb":1225908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"25'19","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.525331+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:52:45.525331+0000","last_peered":"2024-09-19T09:52:45.525331+0000","last_clean":"2024-09-19T09:52:45.525331+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:52:45.525331+0000","last_undegraded":"2024-09-19T09:52:45.525331+0000","last_fullsized":"2024-09-19T09:52:45.525331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'8072","reported_seq":8092,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506996+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:52:45.506996+0000","last_peered":"2024-09-19T09:52:45.506996+0000","last_clean":"2024-09-19T09:52:45.506996+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:52:45.506996+0000","last_undegraded":"2024-09-19T09:52:45.506996+0000","last_fullsized":"2024-09-19T09:52:45.506996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8072,"log_dups_size":0,"ondisk_log_size":8072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122842,"num_write_kb":1473778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:39.088249+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:51:39.088249+0000","last_peered":"2024-09-19T09:51:39.088249+0000","last_clean":"2024-09-19T09:51:39.088249+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:51:39.088249+0000","last_undegraded":"2024-09-19T09:51:39.088249+0000","last_fullsized":"2024-09-19T09:51:39.088249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'7124","reported_seq":7138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.546437+0000","last_change":"2024-09-19T09:43:20.619216+0000","last_active":"2024-09-19T09:52:45.546437+0000","last_peered":"2024-09-19T09:52:45.546437+0000","last_clean":"2024-09-19T09:52:45.546437+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:52:45.546437+0000","last_undegraded":"2024-09-19T09:52:45.546437+0000","last_fullsized":"2024-09-19T09:52:45.546437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7124,"log_dups_size":0,"ondisk_log_size":7124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:14.168619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108281,"num_write_kb":1344761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:34.636798+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:51:34.636798+0000","last_peered":"2024-09-19T09:51:34.636798+0000","last_clean":"2024-09-19T09:51:34.636798+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:51:34.636798+0000","last_undegraded":"2024-09-19T09:51:34.636798+0000","last_fullsized":"2024-09-19T09:51:34.636798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'6852","reported_seq":6872,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.546768+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:52:45.546768+0000","last_peered":"2024-09-19T09:52:45.546768+0000","last_clean":"2024-09-19T09:52:45.546768+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:52:45.546768+0000","last_undegraded":"2024-09-19T09:52:45.546768+0000","last_fullsized":"2024-09-19T09:52:45.546768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6852,"log_dups_size":0,"ondisk_log_size":6852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104241,"num_write_kb":1288428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.775818+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:50:37.775818+0000","last_peered":"2024-09-19T09:50:37.775818+0000","last_clean":"2024-09-19T09:50:37.775818+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:50:37.775818+0000","last_undegraded":"2024-09-19T09:50:37.775818+0000","last_fullsized":"2024-09-19T09:50:37.775818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:58.592828+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:50:58.592828+0000","last_peered":"2024-09-19T09:50:58.592828+0000","last_clean":"2024-09-19T09:50:58.592828+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:50:58.592828+0000","last_undegraded":"2024-09-19T09:50:58.592828+0000","last_fullsized":"2024-09-19T09:50:58.592828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'7186","reported_seq":7207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.458691+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:52:45.458691+0000","last_peered":"2024-09-19T09:52:45.458691+0000","last_clean":"2024-09-19T09:52:45.458691+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:52:45.458691+0000","last_undegraded":"2024-09-19T09:52:45.458691+0000","last_fullsized":"2024-09-19T09:52:45.458691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109665,"num_write_kb":1344078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'51","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542830+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:52:45.542830+0000","last_peered":"2024-09-19T09:52:45.542830+0000","last_clean":"2024-09-19T09:52:45.542830+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:52:45.542830+0000","last_undegraded":"2024-09-19T09:52:45.542830+0000","last_fullsized":"2024-09-19T09:52:45.542830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'6521","reported_seq":6542,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.501975+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:52:45.501975+0000","last_peered":"2024-09-19T09:52:45.501975+0000","last_clean":"2024-09-19T09:52:45.501975+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:52:45.501975+0000","last_undegraded":"2024-09-19T09:52:45.501975+0000","last_fullsized":"2024-09-19T09:52:45.501975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6521,"log_dups_size":0,"ondisk_log_size":6521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99242,"num_write_kb":1260349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'26","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541286+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:52:45.541286+0000","last_peered":"2024-09-19T09:52:45.541286+0000","last_clean":"2024-09-19T09:52:45.541286+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:52:45.541286+0000","last_undegraded":"2024-09-19T09:52:45.541286+0000","last_fullsized":"2024-09-19T09:52:45.541286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":24,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'6585","reported_seq":6606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.532296+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:52:45.532296+0000","last_peered":"2024-09-19T09:52:45.532296+0000","last_clean":"2024-09-19T09:52:45.532296+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:52:45.532296+0000","last_undegraded":"2024-09-19T09:52:45.532296+0000","last_fullsized":"2024-09-19T09:52:45.532296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99779,"num_write_kb":1243684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'20","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527624+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:52:45.527624+0000","last_peered":"2024-09-19T09:52:45.527624+0000","last_clean":"2024-09-19T09:52:45.527624+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:52:45.527624+0000","last_undegraded":"2024-09-19T09:52:45.527624+0000","last_fullsized":"2024-09-19T09:52:45.527624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6375","reported_seq":6396,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.556240+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:52:45.556240+0000","last_peered":"2024-09-19T09:52:45.556240+0000","last_clean":"2024-09-19T09:52:45.556240+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:52:45.556240+0000","last_undegraded":"2024-09-19T09:52:45.556240+0000","last_fullsized":"2024-09-19T09:52:45.556240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6375,"log_dups_size":0,"ondisk_log_size":6375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97075,"num_write_kb":1245753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'17","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516603+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:52:45.516603+0000","last_peered":"2024-09-19T09:52:45.516603+0000","last_clean":"2024-09-19T09:52:45.516603+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:52:45.516603+0000","last_undegraded":"2024-09-19T09:52:45.516603+0000","last_fullsized":"2024-09-19T09:52:45.516603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5984","reported_seq":6005,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.533335+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:52:45.533335+0000","last_peered":"2024-09-19T09:52:45.533335+0000","last_clean":"2024-09-19T09:52:45.533335+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:52:45.533335+0000","last_undegraded":"2024-09-19T09:52:45.533335+0000","last_fullsized":"2024-09-19T09:52:45.533335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5984,"log_dups_size":0,"ondisk_log_size":5984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90916,"num_write_kb":1171530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.521454+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:52:45.521454+0000","last_peered":"2024-09-19T09:52:45.521454+0000","last_clean":"2024-09-19T09:52:45.521454+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:52:45.521454+0000","last_undegraded":"2024-09-19T09:52:45.521454+0000","last_fullsized":"2024-09-19T09:52:45.521454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7097","reported_seq":7118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549068+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:52:45.549068+0000","last_peered":"2024-09-19T09:52:45.549068+0000","last_clean":"2024-09-19T09:52:45.549068+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:52:45.549068+0000","last_undegraded":"2024-09-19T09:52:45.549068+0000","last_fullsized":"2024-09-19T09:52:45.549068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7097,"log_dups_size":0,"ondisk_log_size":7097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107857,"num_write_kb":1353549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'250","reported_seq":273,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:47.809450+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:52:47.809450+0000","last_peered":"2024-09-19T09:52:47.809450+0000","last_clean":"2024-09-19T09:52:47.809450+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:52:47.809450+0000","last_undegraded":"2024-09-19T09:52:47.809450+0000","last_fullsized":"2024-09-19T09:52:47.809450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'6905","reported_seq":6926,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.532439+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:52:45.532439+0000","last_peered":"2024-09-19T09:52:45.532439+0000","last_clean":"2024-09-19T09:52:45.532439+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:52:45.532439+0000","last_undegraded":"2024-09-19T09:52:45.532439+0000","last_fullsized":"2024-09-19T09:52:45.532439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6905,"log_dups_size":0,"ondisk_log_size":6905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104946,"num_write_kb":1269889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558520+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:52:45.558520+0000","last_peered":"2024-09-19T09:52:45.558520+0000","last_clean":"2024-09-19T09:52:45.558520+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:52:45.558520+0000","last_undegraded":"2024-09-19T09:52:45.558520+0000","last_fullsized":"2024-09-19T09:52:45.558520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'5813","reported_seq":5834,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.489594+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:52:45.489594+0000","last_peered":"2024-09-19T09:52:45.489594+0000","last_clean":"2024-09-19T09:52:45.489594+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:52:45.489594+0000","last_undegraded":"2024-09-19T09:52:45.489594+0000","last_fullsized":"2024-09-19T09:52:45.489594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5813,"log_dups_size":0,"ondisk_log_size":5813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88305,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.515790+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:52:45.515790+0000","last_peered":"2024-09-19T09:52:45.515790+0000","last_clean":"2024-09-19T09:52:45.515790+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:52:45.515790+0000","last_undegraded":"2024-09-19T09:52:45.515790+0000","last_fullsized":"2024-09-19T09:52:45.515790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'6610","reported_seq":6631,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.530709+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:52:45.530709+0000","last_peered":"2024-09-19T09:52:45.530709+0000","last_clean":"2024-09-19T09:52:45.530709+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:52:45.530709+0000","last_undegraded":"2024-09-19T09:52:45.530709+0000","last_fullsized":"2024-09-19T09:52:45.530709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100566,"num_write_kb":1195835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.502529+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:52:45.502529+0000","last_peered":"2024-09-19T09:52:45.502529+0000","last_clean":"2024-09-19T09:52:45.502529+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:52:45.502529+0000","last_undegraded":"2024-09-19T09:52:45.502529+0000","last_fullsized":"2024-09-19T09:52:45.502529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'6873","reported_seq":6887,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.780902+0000","last_change":"2024-09-19T09:43:20.620289+0000","last_active":"2024-09-19T09:52:44.780902+0000","last_peered":"2024-09-19T09:52:44.780902+0000","last_clean":"2024-09-19T09:52:44.780902+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:52:44.780902+0000","last_undegraded":"2024-09-19T09:52:44.780902+0000","last_fullsized":"2024-09-19T09:52:44.780902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:36.817715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104802,"num_write_kb":1303037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"25'20","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.523960+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:52:45.523960+0000","last_peered":"2024-09-19T09:52:45.523960+0000","last_clean":"2024-09-19T09:52:45.523960+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:52:45.523960+0000","last_undegraded":"2024-09-19T09:52:45.523960+0000","last_fullsized":"2024-09-19T09:52:45.523960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'5973","reported_seq":5993,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520284+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:52:45.520284+0000","last_peered":"2024-09-19T09:52:45.520284+0000","last_clean":"2024-09-19T09:52:45.520284+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:52:45.520284+0000","last_undegraded":"2024-09-19T09:52:45.520284+0000","last_fullsized":"2024-09-19T09:52:45.520284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5973,"log_dups_size":0,"ondisk_log_size":5973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91144,"num_write_kb":1060104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'181","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516531+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:52:45.516531+0000","last_peered":"2024-09-19T09:52:45.516531+0000","last_clean":"2024-09-19T09:52:45.516531+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:52:45.516531+0000","last_undegraded":"2024-09-19T09:52:45.516531+0000","last_fullsized":"2024-09-19T09:52:45.516531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'6186","reported_seq":6207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506944+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:52:45.506944+0000","last_peered":"2024-09-19T09:52:45.506944+0000","last_clean":"2024-09-19T09:52:45.506944+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:52:45.506944+0000","last_undegraded":"2024-09-19T09:52:45.506944+0000","last_fullsized":"2024-09-19T09:52:45.506944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6186,"log_dups_size":0,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94126,"num_write_kb":1169732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'8359","reported_seq":8373,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.868072+0000","last_change":"2024-09-19T09:43:20.620403+0000","last_active":"2024-09-19T09:52:45.868072+0000","last_peered":"2024-09-19T09:52:45.868072+0000","last_clean":"2024-09-19T09:52:45.868072+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:52:45.868072+0000","last_undegraded":"2024-09-19T09:52:45.868072+0000","last_fullsized":"2024-09-19T09:52:45.868072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8359,"log_dups_size":0,"ondisk_log_size":8359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:34.693485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127388,"num_write_kb":1561891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'7","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:41.359906+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:52:41.359906+0000","last_peered":"2024-09-19T09:52:41.359906+0000","last_clean":"2024-09-19T09:52:41.359906+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:52:41.359906+0000","last_undegraded":"2024-09-19T09:52:41.359906+0000","last_fullsized":"2024-09-19T09:52:41.359906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5047","reported_seq":5067,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.797581+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:52:44.797581+0000","last_peered":"2024-09-19T09:52:44.797581+0000","last_clean":"2024-09-19T09:52:44.797581+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:52:44.797581+0000","last_undegraded":"2024-09-19T09:52:44.797581+0000","last_fullsized":"2024-09-19T09:52:44.797581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76792,"num_write_kb":903119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'48","reported_seq":70,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508070+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:52:45.508070+0000","last_peered":"2024-09-19T09:52:45.508070+0000","last_clean":"2024-09-19T09:52:45.508070+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:52:45.508070+0000","last_undegraded":"2024-09-19T09:52:45.508070+0000","last_fullsized":"2024-09-19T09:52:45.508070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":16399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'8294","reported_seq":8315,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.554207+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:52:45.554207+0000","last_peered":"2024-09-19T09:52:45.554207+0000","last_clean":"2024-09-19T09:52:45.554207+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:52:45.554207+0000","last_undegraded":"2024-09-19T09:52:45.554207+0000","last_fullsized":"2024-09-19T09:52:45.554207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8294,"log_dups_size":0,"ondisk_log_size":8294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125930,"num_write_kb":1569689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'26","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.539717+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:52:45.539717+0000","last_peered":"2024-09-19T09:52:45.539717+0000","last_clean":"2024-09-19T09:52:45.539717+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:52:45.539717+0000","last_undegraded":"2024-09-19T09:52:45.539717+0000","last_fullsized":"2024-09-19T09:52:45.539717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'7281","reported_seq":7302,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.942091+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:52:44.942091+0000","last_peered":"2024-09-19T09:52:44.942091+0000","last_clean":"2024-09-19T09:52:44.942091+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:52:44.942091+0000","last_undegraded":"2024-09-19T09:52:44.942091+0000","last_fullsized":"2024-09-19T09:52:44.942091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7281,"log_dups_size":0,"ondisk_log_size":7281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110915,"num_write_kb":1387536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'21","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:55.215897+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:50:55.215897+0000","last_peered":"2024-09-19T09:50:55.215897+0000","last_clean":"2024-09-19T09:50:55.215897+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:50:55.215897+0000","last_undegraded":"2024-09-19T09:50:55.215897+0000","last_fullsized":"2024-09-19T09:50:55.215897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6761782,"num_write_kb":82954764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":444424,"ondisk_log_size":444424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":209497899,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":2655,"num_write_kb":206604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":419061760,"data_stored":418995798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2580,"ondisk_log_size":2580,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509576,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705108,"kb_used_data":78660,"kb_used_omap":1,"kb_used_meta":626430,"kb_avail":93666732,"statfs":{"total":96636764160,"available":95914733568,"internally_reserved":0,"allocated":80547840,"data_stored":80376143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":641464778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443924,"kb_used_data":61700,"kb_used_omap":1,"kb_used_meta":382206,"kb_avail":93927916,"statfs":{"total":96636764160,"available":96182185984,"internally_reserved":0,"allocated":63180800,"data_stored":63008649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":391379398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509575,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653352,"kb_used_data":49112,"kb_used_omap":1,"kb_used_meta":604222,"kb_avail":93718488,"statfs":{"total":96636764160,"available":95967731712,"internally_reserved":0,"allocated":50290688,"data_stored":50118304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618723781},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":679896,"kb_used_data":57608,"kb_used_omap":1,"kb_used_meta":622270,"kb_avail":93691944,"statfs":{"total":96636764160,"available":95940550656,"internally_reserved":0,"allocated":58990592,"data_stored":58813799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":637204933},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":649708,"kb_used_data":41308,"kb_used_omap":1,"kb_used_meta":608382,"kb_avail":93722132,"statfs":{"total":96636764160,"available":95971463168,"internally_reserved":0,"allocated":42299392,"data_stored":42125209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":622983623},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435372,"kb_used_data":57308,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93936468,"statfs":{"total":96636764160,"available":96190943232,"internally_reserved":0,"allocated":58683392,"data_stored":58506982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":387119557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":654364,"kb_used_data":45900,"kb_used_omap":1,"kb_used_meta":608446,"kb_avail":93717476,"statfs":{"total":96636764160,"available":95966695424,"internally_reserved":0,"allocated":47001600,"data_stored":46821767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":623049158},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421092,"kb_used_data":20820,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93950748,"statfs":{"total":96636764160,"available":96205565952,"internally_reserved":0,"allocated":21319680,"data_stored":21153017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":409860549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58425344,"data_stored":58413565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":21059600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42041344,"data_stored":42031792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58732544,"data_stored":58720382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50032640,"data_stored":50024887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:53:36.528 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:53:36.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:53:36.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.661+0000 7f5628d31640 1 Processor -- start 2024-09-19T09:53:36.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.661+0000 7f5628d31640 1 -- start start 2024-09-19T09:53:36.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5628d31640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f56241557e0 0x7f562415f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5628d31640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 0x7f56240729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5628d31640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562415b450 con 0x7f56240cc790 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5628d31640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f562415f790 con 0x7f56241557e0 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5628d31640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f562415b6f0 con 0x7f56240725a0 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5622d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f56240cc790 0x7f56240ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59752/0 (socket says 172.21.15.123:59752) 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5622d9d640 1 -- 172.21.15.123:0/1853241913 learned_addr learned my addr 172.21.15.123:0/1853241913 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680608947 0 0) 0x7f562415b450 con 0x7f56240cc790 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560c003520 con 0x7f56240cc790 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f5621d9b640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 0x7f56240729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.662+0000 7f562259c640 1 --2- 172.21.15.123:0/1853241913 >> v2:172.21.15.194:3300/0 conn(0x7f56241557e0 0x7f562415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1047007131 0 0) 0x7f560c003520 con 0x7f56240cc790 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 msgr2=0x7f56240729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 0x7f56240729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 >> v2:172.21.15.194:3300/0 conn(0x7f56241557e0 msgr2=0x7f562415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 --2- 172.21.15.123:0/1853241913 >> v2:172.21.15.194:3300/0 conn(0x7f56241557e0 0x7f562415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562415b9d0 con 0x7f56240cc790 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f561c001670 con 0x7f56240cc790 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 >> v1:172.21.15.123:6789/0 conn(0x7f56240cc790 legacy=0x7f56240ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 0x7f560c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f560c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f562415f790 con 0x7f560c004d40 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f562415b6f0 con 0x7f560c0039b0 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f560c00ba70 con 0x7f56240725a0 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5622d9d640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f560c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5621d9b640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 0x7f560c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f562259c640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5622d9d640 1 -- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 msgr2=0x7f560c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5622d9d640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56240725a0 0x7f560c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5622d9d640 1 -- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f560c0039b0 msgr2=0x7f560c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5622d9d640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.663+0000 7f5622d9d640 1 -- 172.21.15.123:0/1853241913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c003520 con 0x7f560c004d40 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.664+0000 7f5622d9d640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f560c0051c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561c007fd0 tx=0x7f560c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2fa70da6433829 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.664+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c007d50 con 0x7f560c004d40 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.664+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c005ad0 con 0x7f560c004d40 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.664+0000 7f562159a640 1 -- 172.21.15.123:0/1853241913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c007070 con 0x7f560c004d40 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5628d31640 1 -- 172.21.15.123:0/1853241913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 msgr2=0x7f560c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5628d31640 1 --2- 172.21.15.123:0/1853241913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f560c0051c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561c007fd0 tx=0x7f560c005830 comp rx=0 tx=0).stop 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5622d9d640 1 -- 172.21.15.123:0/1853241913 reap_dead start 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5628d31640 1 -- 172.21.15.123:0/1853241913 shutdown_connections 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5628d31640 1 -- 172.21.15.123:0/1853241913 >> 172.21.15.123:0/1853241913 conn(0x7f56240ca380 msgr2=0x7f56240ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5628d31640 1 -- 172.21.15.123:0/1853241913 shutdown_connections 2024-09-19T09:53:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.665+0000 7f5628d31640 1 -- 172.21.15.123:0/1853241913 wait complete. 2024-09-19T09:53:36.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.666+0000 7f5628d31640 1 Processor -- start 2024-09-19T09:53:36.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.666+0000 7f5628d31640 1 -- start start 2024-09-19T09:53:36.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5628d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f56241575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5628d31640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5624156610 0x7f56241f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5628d31640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5624158760 0x7f5624159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5628d31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f562406f980 con 0x7f560c004d40 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5628d31640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f562415bf90 con 0x7f5624156610 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5628d31640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f56240cd350 con 0x7f5624158760 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f56241575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f56241575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58284/0 (socket says 172.21.15.123:58284) 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 -- 172.21.15.123:0/427843663 learned_addr learned my addr 172.21.15.123:0/427843663 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5621d9b640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5624156610 0x7f56241f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5622d9d640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5624158760 0x7f5624159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 -- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5624158760 msgr2=0x7f5624159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5624158760 0x7f5624159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 -- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5624156610 msgr2=0x7f56241f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5624156610 0x7f56241f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 -- 172.21.15.123:0/427843663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56241e6840 con 0x7f560c004d40 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f562259c640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f56241575e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f56140046d0 tx=0x7f5614007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.667+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614015420 con 0x7f560c004d40 2024-09-19T09:53:36.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.668+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561401a070 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.668+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140157e0 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.668+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562415c4d0 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.668+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562415ca90 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.669+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562415f250 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.669+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5614015980 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.670+0000 7f5612ffd640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f560406c2e0 0x7f560406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.670+0000 7f5621d9b640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f560406c2e0 0x7f560406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.670+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f561408bf40 con 0x7f560c004d40 2024-09-19T09:53:36.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.670+0000 7f5621d9b640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f560406c2e0 0x7f560406e7a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5624156a30 tx=0x7f5618008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.674+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f561405a5a0 con 0x7f560c004d40 2024-09-19T09:53:36.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.837+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56241f4720 con 0x7f560406c2e0 2024-09-19T09:53:36.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.843+0000 7f5612ffd640 1 -- 172.21.15.123:0/427843663 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253910 (secure 0 0 0) 0x7f56241f4720 con 0x7f560406c2e0 2024-09-19T09:53:36.847 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:53:36.849 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:53:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f560406c2e0 msgr2=0x7f560406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f560406c2e0 0x7f560406e7a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5624156a30 tx=0x7f5618008040 comp rx=0 tx=0).stop 2024-09-19T09:53:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 msgr2=0x7f56241575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f56241575e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f56140046d0 tx=0x7f5614007700 comp rx=0 tx=0).stop 2024-09-19T09:53:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 shutdown_connections 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f560406c2e0 0x7f560406e7a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5624158760 0x7f5624159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5624156610 0x7f56241f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 --2- 172.21.15.123:0/427843663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f560c004d40 0x7f56241575e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 >> 172.21.15.123:0/427843663 conn(0x7f56240ca380 msgr2=0x7f562406cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 shutdown_connections 2024-09-19T09:53:36.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.846+0000 7f5628d31640 1 -- 172.21.15.123:0/427843663 wait complete. 2024-09-19T09:53:36.859 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-19T09:53:34.894076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210088267,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":140,"num_read_kb":201,"num_write":6764596,"num_write_kb":83163784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447121,"ondisk_log_size":447121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4642816,"kb_used_data":412416,"kb_used_omap":12,"kb_used_meta":4230259,"kb_avail":750331904,"statfs":{"total":773094113280,"available":768339869696,"internally_reserved":0,"allocated":422313984,"data_stored":420923870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":4331785777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"3.3f","version":"25'5955","reported_seq":5976,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.544765+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:52:45.544765+0000","last_peered":"2024-09-19T09:52:45.544765+0000","last_clean":"2024-09-19T09:52:45.544765+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:52:45.544765+0000","last_undegraded":"2024-09-19T09:52:45.544765+0000","last_fullsized":"2024-09-19T09:52:45.544765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5955,"log_dups_size":0,"ondisk_log_size":5955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90667,"num_write_kb":1126123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'8754","reported_seq":8775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.556938+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:52:45.556938+0000","last_peered":"2024-09-19T09:52:45.556938+0000","last_clean":"2024-09-19T09:52:45.556938+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:52:45.556938+0000","last_undegraded":"2024-09-19T09:52:45.556938+0000","last_fullsized":"2024-09-19T09:52:45.556938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8754,"log_dups_size":0,"ondisk_log_size":8754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133411,"num_write_kb":1655568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7056","reported_seq":7077,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.534391+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:52:45.534391+0000","last_peered":"2024-09-19T09:52:45.534391+0000","last_clean":"2024-09-19T09:52:45.534391+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:52:45.534391+0000","last_undegraded":"2024-09-19T09:52:45.534391+0000","last_fullsized":"2024-09-19T09:52:45.534391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7056,"log_dups_size":0,"ondisk_log_size":7056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:32.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107453,"num_write_kb":1318687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'6123","reported_seq":6144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.545508+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:52:44.545508+0000","last_peered":"2024-09-19T09:52:44.545508+0000","last_clean":"2024-09-19T09:52:44.545508+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:52:44.545508+0000","last_undegraded":"2024-09-19T09:52:44.545508+0000","last_fullsized":"2024-09-19T09:52:44.545508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6123,"log_dups_size":0,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93226,"num_write_kb":1192949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'8352","reported_seq":8372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.561761+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:52:45.561761+0000","last_peered":"2024-09-19T09:52:45.561761+0000","last_clean":"2024-09-19T09:52:45.561761+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:52:45.561761+0000","last_undegraded":"2024-09-19T09:52:45.561761+0000","last_fullsized":"2024-09-19T09:52:45.561761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8352,"log_dups_size":0,"ondisk_log_size":8352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127203,"num_write_kb":1494052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6127","reported_seq":6147,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.739185+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:52:44.739185+0000","last_peered":"2024-09-19T09:52:44.739185+0000","last_clean":"2024-09-19T09:52:44.739185+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:52:44.739185+0000","last_undegraded":"2024-09-19T09:52:44.739185+0000","last_fullsized":"2024-09-19T09:52:44.739185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6127,"log_dups_size":0,"ondisk_log_size":6127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93163,"num_write_kb":1116253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'6602","reported_seq":6622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.557090+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:52:45.557090+0000","last_peered":"2024-09-19T09:52:45.557090+0000","last_clean":"2024-09-19T09:52:45.557090+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:52:45.557090+0000","last_undegraded":"2024-09-19T09:52:45.557090+0000","last_fullsized":"2024-09-19T09:52:45.557090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6602,"log_dups_size":0,"ondisk_log_size":6602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100493,"num_write_kb":1261887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'7464","reported_seq":7484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.725996+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:52:44.725996+0000","last_peered":"2024-09-19T09:52:44.725996+0000","last_clean":"2024-09-19T09:52:44.725996+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:52:44.725996+0000","last_undegraded":"2024-09-19T09:52:44.725996+0000","last_fullsized":"2024-09-19T09:52:44.725996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7464,"log_dups_size":0,"ondisk_log_size":7464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113853,"num_write_kb":1361930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'8241","reported_seq":8261,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.779815+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:52:44.779815+0000","last_peered":"2024-09-19T09:52:44.779815+0000","last_clean":"2024-09-19T09:52:44.779815+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:52:44.779815+0000","last_undegraded":"2024-09-19T09:52:44.779815+0000","last_fullsized":"2024-09-19T09:52:44.779815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8241,"log_dups_size":0,"ondisk_log_size":8241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125203,"num_write_kb":1603079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'7720","reported_seq":7740,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.495424+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:52:45.495424+0000","last_peered":"2024-09-19T09:52:45.495424+0000","last_clean":"2024-09-19T09:52:45.495424+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:52:45.495424+0000","last_undegraded":"2024-09-19T09:52:45.495424+0000","last_fullsized":"2024-09-19T09:52:45.495424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7720,"log_dups_size":0,"ondisk_log_size":7720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117401,"num_write_kb":1489402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'6676","reported_seq":6696,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.736174+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:52:44.736174+0000","last_peered":"2024-09-19T09:52:44.736174+0000","last_clean":"2024-09-19T09:52:44.736174+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:52:44.736174+0000","last_undegraded":"2024-09-19T09:52:44.736174+0000","last_fullsized":"2024-09-19T09:52:44.736174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6676,"log_dups_size":0,"ondisk_log_size":6676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101709,"num_write_kb":1228477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'5916","reported_seq":5936,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.474457+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:52:45.474457+0000","last_peered":"2024-09-19T09:52:45.474457+0000","last_clean":"2024-09-19T09:52:45.474457+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:52:45.474457+0000","last_undegraded":"2024-09-19T09:52:45.474457+0000","last_fullsized":"2024-09-19T09:52:45.474457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5916,"log_dups_size":0,"ondisk_log_size":5916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90039,"num_write_kb":1066111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'6228","reported_seq":6248,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538290+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:52:45.538290+0000","last_peered":"2024-09-19T09:52:45.538290+0000","last_clean":"2024-09-19T09:52:45.538290+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:52:45.538290+0000","last_undegraded":"2024-09-19T09:52:45.538290+0000","last_fullsized":"2024-09-19T09:52:45.538290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6228,"log_dups_size":0,"ondisk_log_size":6228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94800,"num_write_kb":1191870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'7094","reported_seq":7114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.468110+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:52:45.468110+0000","last_peered":"2024-09-19T09:52:45.468110+0000","last_clean":"2024-09-19T09:52:45.468110+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:52:45.468110+0000","last_undegraded":"2024-09-19T09:52:45.468110+0000","last_fullsized":"2024-09-19T09:52:45.468110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7094,"log_dups_size":0,"ondisk_log_size":7094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:30.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107699,"num_write_kb":1339564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'7235","reported_seq":7255,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519773+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:52:45.519773+0000","last_peered":"2024-09-19T09:52:45.519773+0000","last_clean":"2024-09-19T09:52:45.519773+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:52:45.519773+0000","last_undegraded":"2024-09-19T09:52:45.519773+0000","last_fullsized":"2024-09-19T09:52:45.519773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109960,"num_write_kb":1298661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'6065","reported_seq":6085,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.479454+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:52:45.479454+0000","last_peered":"2024-09-19T09:52:45.479454+0000","last_clean":"2024-09-19T09:52:45.479454+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:52:45.479454+0000","last_undegraded":"2024-09-19T09:52:45.479454+0000","last_fullsized":"2024-09-19T09:52:45.479454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92239,"num_write_kb":1166043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8309","reported_seq":8329,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.495740+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:52:45.495740+0000","last_peered":"2024-09-19T09:52:45.495740+0000","last_clean":"2024-09-19T09:52:45.495740+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:52:45.495740+0000","last_undegraded":"2024-09-19T09:52:45.495740+0000","last_fullsized":"2024-09-19T09:52:45.495740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8309,"log_dups_size":0,"ondisk_log_size":8309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126488,"num_write_kb":1557261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'5639","reported_seq":5659,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549778+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:52:45.549778+0000","last_peered":"2024-09-19T09:52:45.549778+0000","last_clean":"2024-09-19T09:52:45.549778+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:52:45.549778+0000","last_undegraded":"2024-09-19T09:52:45.549778+0000","last_fullsized":"2024-09-19T09:52:45.549778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5639,"log_dups_size":0,"ondisk_log_size":5639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85570,"num_write_kb":1023683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'6866","reported_seq":6886,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538514+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:52:45.538514+0000","last_peered":"2024-09-19T09:52:45.538514+0000","last_clean":"2024-09-19T09:52:45.538514+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:52:45.538514+0000","last_undegraded":"2024-09-19T09:52:45.538514+0000","last_fullsized":"2024-09-19T09:52:45.538514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6866,"log_dups_size":0,"ondisk_log_size":6866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104491,"num_write_kb":1253325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'6773","reported_seq":6793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.529598+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:52:45.529598+0000","last_peered":"2024-09-19T09:52:45.529598+0000","last_clean":"2024-09-19T09:52:45.529598+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:52:45.529598+0000","last_undegraded":"2024-09-19T09:52:45.529598+0000","last_fullsized":"2024-09-19T09:52:45.529598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6773,"log_dups_size":0,"ondisk_log_size":6773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103096,"num_write_kb":1273163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'7058","reported_seq":7078,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.533572+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:52:45.533572+0000","last_peered":"2024-09-19T09:52:45.533572+0000","last_clean":"2024-09-19T09:52:45.533572+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:52:45.533572+0000","last_undegraded":"2024-09-19T09:52:45.533572+0000","last_fullsized":"2024-09-19T09:52:45.533572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7058,"log_dups_size":0,"ondisk_log_size":7058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.487682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107113,"num_write_kb":1305966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'7483","reported_seq":7503,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.802426+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:52:44.802426+0000","last_peered":"2024-09-19T09:52:44.802426+0000","last_clean":"2024-09-19T09:52:44.802426+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:52:44.802426+0000","last_undegraded":"2024-09-19T09:52:44.802426+0000","last_fullsized":"2024-09-19T09:52:44.802426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7483,"log_dups_size":0,"ondisk_log_size":7483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113925,"num_write_kb":1408486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'6876","reported_seq":6896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.727578+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:52:44.727578+0000","last_peered":"2024-09-19T09:52:44.727578+0000","last_clean":"2024-09-19T09:52:44.727578+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:52:44.727578+0000","last_undegraded":"2024-09-19T09:52:44.727578+0000","last_fullsized":"2024-09-19T09:52:44.727578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6876,"log_dups_size":0,"ondisk_log_size":6876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104459,"num_write_kb":1263249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'6113","reported_seq":6133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538211+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:52:45.538211+0000","last_peered":"2024-09-19T09:52:45.538211+0000","last_clean":"2024-09-19T09:52:45.538211+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:52:45.538211+0000","last_undegraded":"2024-09-19T09:52:45.538211+0000","last_fullsized":"2024-09-19T09:52:45.538211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6113,"log_dups_size":0,"ondisk_log_size":6113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93016,"num_write_kb":1127551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'8000","reported_seq":8021,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.550005+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:52:45.550005+0000","last_peered":"2024-09-19T09:52:45.550005+0000","last_clean":"2024-09-19T09:52:45.550005+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:52:45.550005+0000","last_undegraded":"2024-09-19T09:52:45.550005+0000","last_fullsized":"2024-09-19T09:52:45.550005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8000,"log_dups_size":0,"ondisk_log_size":8000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121789,"num_write_kb":1510406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'6207","reported_seq":6228,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.531220+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:52:45.531220+0000","last_peered":"2024-09-19T09:52:45.531220+0000","last_clean":"2024-09-19T09:52:45.531220+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:52:45.531220+0000","last_undegraded":"2024-09-19T09:52:45.531220+0000","last_fullsized":"2024-09-19T09:52:45.531220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6207,"log_dups_size":0,"ondisk_log_size":6207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94313,"num_write_kb":1157877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'7387","reported_seq":7408,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549991+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:52:45.549991+0000","last_peered":"2024-09-19T09:52:45.549991+0000","last_clean":"2024-09-19T09:52:45.549991+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:52:45.549991+0000","last_undegraded":"2024-09-19T09:52:45.549991+0000","last_fullsized":"2024-09-19T09:52:45.549991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7387,"log_dups_size":0,"ondisk_log_size":7387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112469,"num_write_kb":1393395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'6312","reported_seq":6333,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.559946+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:52:45.559946+0000","last_peered":"2024-09-19T09:52:45.559946+0000","last_clean":"2024-09-19T09:52:45.559946+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:52:45.559946+0000","last_undegraded":"2024-09-19T09:52:45.559946+0000","last_fullsized":"2024-09-19T09:52:45.559946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6312,"log_dups_size":0,"ondisk_log_size":6312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96072,"num_write_kb":1169122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'5898","reported_seq":5919,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.523449+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:52:45.523449+0000","last_peered":"2024-09-19T09:52:45.523449+0000","last_clean":"2024-09-19T09:52:45.523449+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:52:45.523449+0000","last_undegraded":"2024-09-19T09:52:45.523449+0000","last_fullsized":"2024-09-19T09:52:45.523449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5898,"log_dups_size":0,"ondisk_log_size":5898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:04.386940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89887,"num_write_kb":1118423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'8484","reported_seq":8505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.555300+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:52:45.555300+0000","last_peered":"2024-09-19T09:52:45.555300+0000","last_clean":"2024-09-19T09:52:45.555300+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:52:45.555300+0000","last_undegraded":"2024-09-19T09:52:45.555300+0000","last_fullsized":"2024-09-19T09:52:45.555300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8484,"log_dups_size":0,"ondisk_log_size":8484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129293,"num_write_kb":1558943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'7295","reported_seq":7316,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.799433+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:52:44.799433+0000","last_peered":"2024-09-19T09:52:44.799433+0000","last_clean":"2024-09-19T09:52:44.799433+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:52:44.799433+0000","last_undegraded":"2024-09-19T09:52:44.799433+0000","last_fullsized":"2024-09-19T09:52:44.799433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7295,"log_dups_size":0,"ondisk_log_size":7295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111025,"num_write_kb":1382740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'8637","reported_seq":8658,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.553761+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:52:45.553761+0000","last_peered":"2024-09-19T09:52:45.553761+0000","last_clean":"2024-09-19T09:52:45.553761+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:52:45.553761+0000","last_undegraded":"2024-09-19T09:52:45.553761+0000","last_fullsized":"2024-09-19T09:52:45.553761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8637,"log_dups_size":0,"ondisk_log_size":8637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131457,"num_write_kb":1608657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'5965","reported_seq":5985,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.511836+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:52:45.511836+0000","last_peered":"2024-09-19T09:52:45.511836+0000","last_clean":"2024-09-19T09:52:45.511836+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:52:45.511836+0000","last_undegraded":"2024-09-19T09:52:45.511836+0000","last_fullsized":"2024-09-19T09:52:45.511836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90903,"num_write_kb":1098126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1242","reported_seq":1264,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:39.669842+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:52:39.669842+0000","last_peered":"2024-09-19T09:52:39.669842+0000","last_clean":"2024-09-19T09:52:39.669842+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:52:39.669842+0000","last_undegraded":"2024-09-19T09:52:39.669842+0000","last_fullsized":"2024-09-19T09:52:39.669842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":5249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5275","reported_seq":5295,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.480284+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:52:45.480284+0000","last_peered":"2024-09-19T09:52:45.480284+0000","last_clean":"2024-09-19T09:52:45.480284+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:52:45.480284+0000","last_undegraded":"2024-09-19T09:52:45.480284+0000","last_fullsized":"2024-09-19T09:52:45.480284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:19.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80097,"num_write_kb":999347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'43","reported_seq":65,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506874+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:52:45.506874+0000","last_peered":"2024-09-19T09:52:45.506874+0000","last_clean":"2024-09-19T09:52:45.506874+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:52:45.506874+0000","last_undegraded":"2024-09-19T09:52:45.506874+0000","last_fullsized":"2024-09-19T09:52:45.506874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":16406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:29.642711+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:52:29.642711+0000","last_peered":"2024-09-19T09:52:29.642711+0000","last_clean":"2024-09-19T09:52:29.642711+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:52:29.642711+0000","last_undegraded":"2024-09-19T09:52:29.642711+0000","last_fullsized":"2024-09-19T09:52:29.642711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'6888","reported_seq":6908,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558630+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:52:45.558630+0000","last_peered":"2024-09-19T09:52:45.558630+0000","last_clean":"2024-09-19T09:52:45.558630+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:52:45.558630+0000","last_undegraded":"2024-09-19T09:52:45.558630+0000","last_fullsized":"2024-09-19T09:52:45.558630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6888,"log_dups_size":0,"ondisk_log_size":6888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104648,"num_write_kb":1287559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'31","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.798938+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:52:44.798938+0000","last_peered":"2024-09-19T09:52:44.798938+0000","last_clean":"2024-09-19T09:52:44.798938+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:52:44.798938+0000","last_undegraded":"2024-09-19T09:52:44.798938+0000","last_fullsized":"2024-09-19T09:52:44.798938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'8123","reported_seq":8143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.554490+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:52:45.554490+0000","last_peered":"2024-09-19T09:52:45.554490+0000","last_clean":"2024-09-19T09:52:45.554490+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:52:45.554490+0000","last_undegraded":"2024-09-19T09:52:45.554490+0000","last_fullsized":"2024-09-19T09:52:45.554490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8123,"log_dups_size":0,"ondisk_log_size":8123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123619,"num_write_kb":1504166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:21.261469+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:52:21.261469+0000","last_peered":"2024-09-19T09:52:21.261469+0000","last_clean":"2024-09-19T09:52:21.261469+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:52:21.261469+0000","last_undegraded":"2024-09-19T09:52:21.261469+0000","last_fullsized":"2024-09-19T09:52:21.261469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'6985","reported_seq":7005,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508817+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:52:45.508817+0000","last_peered":"2024-09-19T09:52:45.508817+0000","last_clean":"2024-09-19T09:52:45.508817+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:52:45.508817+0000","last_undegraded":"2024-09-19T09:52:45.508817+0000","last_fullsized":"2024-09-19T09:52:45.508817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6985,"log_dups_size":0,"ondisk_log_size":6985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106286,"num_write_kb":1265589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'27","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.513741+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:52:45.513741+0000","last_peered":"2024-09-19T09:52:45.513741+0000","last_clean":"2024-09-19T09:52:45.513741+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:52:45.513741+0000","last_undegraded":"2024-09-19T09:52:45.513741+0000","last_fullsized":"2024-09-19T09:52:45.513741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'6097","reported_seq":6117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541773+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:52:45.541773+0000","last_peered":"2024-09-19T09:52:45.541773+0000","last_clean":"2024-09-19T09:52:45.541773+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:52:45.541773+0000","last_undegraded":"2024-09-19T09:52:45.541773+0000","last_fullsized":"2024-09-19T09:52:45.541773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6097,"log_dups_size":0,"ondisk_log_size":6097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:32.134941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92578,"num_write_kb":1120610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'145","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.535559+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:52:45.535559+0000","last_peered":"2024-09-19T09:52:45.535559+0000","last_clean":"2024-09-19T09:52:45.535559+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:52:45.535559+0000","last_undegraded":"2024-09-19T09:52:45.535559+0000","last_fullsized":"2024-09-19T09:52:45.535559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8081847,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":7956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9198","reported_seq":9218,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.474144+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:52:45.474144+0000","last_peered":"2024-09-19T09:52:45.474144+0000","last_clean":"2024-09-19T09:52:45.474144+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:52:45.474144+0000","last_undegraded":"2024-09-19T09:52:45.474144+0000","last_fullsized":"2024-09-19T09:52:45.474144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":9198,"log_dups_size":0,"ondisk_log_size":9198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140136,"num_write_kb":1697056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'234","reported_seq":256,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.501129+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:52:45.501129+0000","last_peered":"2024-09-19T09:52:45.501129+0000","last_clean":"2024-09-19T09:52:45.501129+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:52:45.501129+0000","last_undegraded":"2024-09-19T09:52:45.501129+0000","last_fullsized":"2024-09-19T09:52:45.501129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'6637","reported_seq":6657,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.611484+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:52:44.611484+0000","last_peered":"2024-09-19T09:52:44.611484+0000","last_clean":"2024-09-19T09:52:44.611484+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:52:44.611484+0000","last_undegraded":"2024-09-19T09:52:44.611484+0000","last_fullsized":"2024-09-19T09:52:44.611484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6637,"log_dups_size":0,"ondisk_log_size":6637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100932,"num_write_kb":1211662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520510+0000","last_change":"2024-09-19T09:42:36.497613+0000","last_active":"2024-09-19T09:52:45.520510+0000","last_peered":"2024-09-19T09:52:45.520510+0000","last_clean":"2024-09-19T09:52:45.520510+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:52:45.520510+0000","last_undegraded":"2024-09-19T09:52:45.520510+0000","last_fullsized":"2024-09-19T09:52:45.520510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:43.638575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'6594","reported_seq":6614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.726783+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:52:44.726783+0000","last_peered":"2024-09-19T09:52:44.726783+0000","last_clean":"2024-09-19T09:52:44.726783+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:52:44.726783+0000","last_undegraded":"2024-09-19T09:52:44.726783+0000","last_fullsized":"2024-09-19T09:52:44.726783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6594,"log_dups_size":0,"ondisk_log_size":6594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:22.257303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100178,"num_write_kb":1211527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542370+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:52:45.542370+0000","last_peered":"2024-09-19T09:52:45.542370+0000","last_clean":"2024-09-19T09:52:45.542370+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:52:45.542370+0000","last_undegraded":"2024-09-19T09:52:45.542370+0000","last_fullsized":"2024-09-19T09:52:45.542370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'7757","reported_seq":7777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.538835+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:52:45.538835+0000","last_peered":"2024-09-19T09:52:45.538835+0000","last_clean":"2024-09-19T09:52:45.538835+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:52:45.538835+0000","last_undegraded":"2024-09-19T09:52:45.538835+0000","last_fullsized":"2024-09-19T09:52:45.538835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7757,"log_dups_size":0,"ondisk_log_size":7757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118022,"num_write_kb":1435104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519810+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:52:45.519810+0000","last_peered":"2024-09-19T09:52:45.519810+0000","last_clean":"2024-09-19T09:52:45.519810+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:52:45.519810+0000","last_undegraded":"2024-09-19T09:52:45.519810+0000","last_fullsized":"2024-09-19T09:52:45.519810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'7341","reported_seq":7361,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.531573+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:52:45.531573+0000","last_peered":"2024-09-19T09:52:45.531573+0000","last_clean":"2024-09-19T09:52:45.531573+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:52:45.531573+0000","last_undegraded":"2024-09-19T09:52:45.531573+0000","last_fullsized":"2024-09-19T09:52:45.531573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7341,"log_dups_size":0,"ondisk_log_size":7341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111551,"num_write_kb":1366296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'36","reported_seq":58,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.490639+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:52:45.490639+0000","last_peered":"2024-09-19T09:52:45.490639+0000","last_clean":"2024-09-19T09:52:45.490639+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:52:45.490639+0000","last_undegraded":"2024-09-19T09:52:45.490639+0000","last_fullsized":"2024-09-19T09:52:45.490639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'6685","reported_seq":6705,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527282+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:52:45.527282+0000","last_peered":"2024-09-19T09:52:45.527282+0000","last_clean":"2024-09-19T09:52:45.527282+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:52:45.527282+0000","last_undegraded":"2024-09-19T09:52:45.527282+0000","last_fullsized":"2024-09-19T09:52:45.527282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6685,"log_dups_size":0,"ondisk_log_size":6685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101427,"num_write_kb":1285780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'17","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520111+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:52:45.520111+0000","last_peered":"2024-09-19T09:52:45.520111+0000","last_clean":"2024-09-19T09:52:45.520111+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:52:45.520111+0000","last_undegraded":"2024-09-19T09:52:45.520111+0000","last_fullsized":"2024-09-19T09:52:45.520111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'6797","reported_seq":6811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.461046+0000","last_change":"2024-09-19T09:43:20.619746+0000","last_active":"2024-09-19T09:52:45.461046+0000","last_peered":"2024-09-19T09:52:45.461046+0000","last_clean":"2024-09-19T09:52:45.461046+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:52:45.461046+0000","last_undegraded":"2024-09-19T09:52:45.461046+0000","last_fullsized":"2024-09-19T09:52:45.461046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6797,"log_dups_size":0,"ondisk_log_size":6797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:39.025798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103611,"num_write_kb":1225908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"25'19","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.525331+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:52:45.525331+0000","last_peered":"2024-09-19T09:52:45.525331+0000","last_clean":"2024-09-19T09:52:45.525331+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:52:45.525331+0000","last_undegraded":"2024-09-19T09:52:45.525331+0000","last_fullsized":"2024-09-19T09:52:45.525331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'8072","reported_seq":8092,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506996+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:52:45.506996+0000","last_peered":"2024-09-19T09:52:45.506996+0000","last_clean":"2024-09-19T09:52:45.506996+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:52:45.506996+0000","last_undegraded":"2024-09-19T09:52:45.506996+0000","last_fullsized":"2024-09-19T09:52:45.506996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8072,"log_dups_size":0,"ondisk_log_size":8072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122842,"num_write_kb":1473778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:39.088249+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:51:39.088249+0000","last_peered":"2024-09-19T09:51:39.088249+0000","last_clean":"2024-09-19T09:51:39.088249+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:51:39.088249+0000","last_undegraded":"2024-09-19T09:51:39.088249+0000","last_fullsized":"2024-09-19T09:51:39.088249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'7124","reported_seq":7138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.546437+0000","last_change":"2024-09-19T09:43:20.619216+0000","last_active":"2024-09-19T09:52:45.546437+0000","last_peered":"2024-09-19T09:52:45.546437+0000","last_clean":"2024-09-19T09:52:45.546437+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:52:45.546437+0000","last_undegraded":"2024-09-19T09:52:45.546437+0000","last_fullsized":"2024-09-19T09:52:45.546437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7124,"log_dups_size":0,"ondisk_log_size":7124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:14.168619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108281,"num_write_kb":1344761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:34.636798+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:51:34.636798+0000","last_peered":"2024-09-19T09:51:34.636798+0000","last_clean":"2024-09-19T09:51:34.636798+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:51:34.636798+0000","last_undegraded":"2024-09-19T09:51:34.636798+0000","last_fullsized":"2024-09-19T09:51:34.636798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'6852","reported_seq":6872,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.546768+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:52:45.546768+0000","last_peered":"2024-09-19T09:52:45.546768+0000","last_clean":"2024-09-19T09:52:45.546768+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:52:45.546768+0000","last_undegraded":"2024-09-19T09:52:45.546768+0000","last_fullsized":"2024-09-19T09:52:45.546768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6852,"log_dups_size":0,"ondisk_log_size":6852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104241,"num_write_kb":1288428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.775818+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:50:37.775818+0000","last_peered":"2024-09-19T09:50:37.775818+0000","last_clean":"2024-09-19T09:50:37.775818+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:50:37.775818+0000","last_undegraded":"2024-09-19T09:50:37.775818+0000","last_fullsized":"2024-09-19T09:50:37.775818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:58.592828+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:50:58.592828+0000","last_peered":"2024-09-19T09:50:58.592828+0000","last_clean":"2024-09-19T09:50:58.592828+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:50:58.592828+0000","last_undegraded":"2024-09-19T09:50:58.592828+0000","last_fullsized":"2024-09-19T09:50:58.592828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'7186","reported_seq":7207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.458691+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:52:45.458691+0000","last_peered":"2024-09-19T09:52:45.458691+0000","last_clean":"2024-09-19T09:52:45.458691+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:52:45.458691+0000","last_undegraded":"2024-09-19T09:52:45.458691+0000","last_fullsized":"2024-09-19T09:52:45.458691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109665,"num_write_kb":1344078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'51","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542830+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:52:45.542830+0000","last_peered":"2024-09-19T09:52:45.542830+0000","last_clean":"2024-09-19T09:52:45.542830+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:52:45.542830+0000","last_undegraded":"2024-09-19T09:52:45.542830+0000","last_fullsized":"2024-09-19T09:52:45.542830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'6521","reported_seq":6542,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.501975+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:52:45.501975+0000","last_peered":"2024-09-19T09:52:45.501975+0000","last_clean":"2024-09-19T09:52:45.501975+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:52:45.501975+0000","last_undegraded":"2024-09-19T09:52:45.501975+0000","last_fullsized":"2024-09-19T09:52:45.501975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6521,"log_dups_size":0,"ondisk_log_size":6521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:55.642136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99242,"num_write_kb":1260349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'26","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541286+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:52:45.541286+0000","last_peered":"2024-09-19T09:52:45.541286+0000","last_clean":"2024-09-19T09:52:45.541286+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:52:45.541286+0000","last_undegraded":"2024-09-19T09:52:45.541286+0000","last_fullsized":"2024-09-19T09:52:45.541286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":24,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'6585","reported_seq":6606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.532296+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:52:45.532296+0000","last_peered":"2024-09-19T09:52:45.532296+0000","last_clean":"2024-09-19T09:52:45.532296+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:52:45.532296+0000","last_undegraded":"2024-09-19T09:52:45.532296+0000","last_fullsized":"2024-09-19T09:52:45.532296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99779,"num_write_kb":1243684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'20","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527624+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:52:45.527624+0000","last_peered":"2024-09-19T09:52:45.527624+0000","last_clean":"2024-09-19T09:52:45.527624+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:52:45.527624+0000","last_undegraded":"2024-09-19T09:52:45.527624+0000","last_fullsized":"2024-09-19T09:52:45.527624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6375","reported_seq":6396,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.556240+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:52:45.556240+0000","last_peered":"2024-09-19T09:52:45.556240+0000","last_clean":"2024-09-19T09:52:45.556240+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:52:45.556240+0000","last_undegraded":"2024-09-19T09:52:45.556240+0000","last_fullsized":"2024-09-19T09:52:45.556240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6375,"log_dups_size":0,"ondisk_log_size":6375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97075,"num_write_kb":1245753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'17","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516603+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:52:45.516603+0000","last_peered":"2024-09-19T09:52:45.516603+0000","last_clean":"2024-09-19T09:52:45.516603+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:52:45.516603+0000","last_undegraded":"2024-09-19T09:52:45.516603+0000","last_fullsized":"2024-09-19T09:52:45.516603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5984","reported_seq":6005,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.533335+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:52:45.533335+0000","last_peered":"2024-09-19T09:52:45.533335+0000","last_clean":"2024-09-19T09:52:45.533335+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:52:45.533335+0000","last_undegraded":"2024-09-19T09:52:45.533335+0000","last_fullsized":"2024-09-19T09:52:45.533335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5984,"log_dups_size":0,"ondisk_log_size":5984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90916,"num_write_kb":1171530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.521454+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:52:45.521454+0000","last_peered":"2024-09-19T09:52:45.521454+0000","last_clean":"2024-09-19T09:52:45.521454+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:52:45.521454+0000","last_undegraded":"2024-09-19T09:52:45.521454+0000","last_fullsized":"2024-09-19T09:52:45.521454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7097","reported_seq":7118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.549068+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:52:45.549068+0000","last_peered":"2024-09-19T09:52:45.549068+0000","last_clean":"2024-09-19T09:52:45.549068+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:52:45.549068+0000","last_undegraded":"2024-09-19T09:52:45.549068+0000","last_fullsized":"2024-09-19T09:52:45.549068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7097,"log_dups_size":0,"ondisk_log_size":7097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107857,"num_write_kb":1353549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'250","reported_seq":273,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:47.809450+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:52:47.809450+0000","last_peered":"2024-09-19T09:52:47.809450+0000","last_clean":"2024-09-19T09:52:47.809450+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:52:47.809450+0000","last_undegraded":"2024-09-19T09:52:47.809450+0000","last_fullsized":"2024-09-19T09:52:47.809450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'6905","reported_seq":6926,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.532439+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:52:45.532439+0000","last_peered":"2024-09-19T09:52:45.532439+0000","last_clean":"2024-09-19T09:52:45.532439+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:52:45.532439+0000","last_undegraded":"2024-09-19T09:52:45.532439+0000","last_fullsized":"2024-09-19T09:52:45.532439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6905,"log_dups_size":0,"ondisk_log_size":6905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104946,"num_write_kb":1269889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558520+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:52:45.558520+0000","last_peered":"2024-09-19T09:52:45.558520+0000","last_clean":"2024-09-19T09:52:45.558520+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:52:45.558520+0000","last_undegraded":"2024-09-19T09:52:45.558520+0000","last_fullsized":"2024-09-19T09:52:45.558520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'5813","reported_seq":5834,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.489594+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:52:45.489594+0000","last_peered":"2024-09-19T09:52:45.489594+0000","last_clean":"2024-09-19T09:52:45.489594+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:52:45.489594+0000","last_undegraded":"2024-09-19T09:52:45.489594+0000","last_fullsized":"2024-09-19T09:52:45.489594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5813,"log_dups_size":0,"ondisk_log_size":5813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:34.067251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88305,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.515790+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:52:45.515790+0000","last_peered":"2024-09-19T09:52:45.515790+0000","last_clean":"2024-09-19T09:52:45.515790+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:52:45.515790+0000","last_undegraded":"2024-09-19T09:52:45.515790+0000","last_fullsized":"2024-09-19T09:52:45.515790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'6610","reported_seq":6631,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.530709+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:52:45.530709+0000","last_peered":"2024-09-19T09:52:45.530709+0000","last_clean":"2024-09-19T09:52:45.530709+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:52:45.530709+0000","last_undegraded":"2024-09-19T09:52:45.530709+0000","last_fullsized":"2024-09-19T09:52:45.530709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100566,"num_write_kb":1195835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.502529+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:52:45.502529+0000","last_peered":"2024-09-19T09:52:45.502529+0000","last_clean":"2024-09-19T09:52:45.502529+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:52:45.502529+0000","last_undegraded":"2024-09-19T09:52:45.502529+0000","last_fullsized":"2024-09-19T09:52:45.502529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'6873","reported_seq":6887,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.780902+0000","last_change":"2024-09-19T09:43:20.620289+0000","last_active":"2024-09-19T09:52:44.780902+0000","last_peered":"2024-09-19T09:52:44.780902+0000","last_clean":"2024-09-19T09:52:44.780902+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:52:44.780902+0000","last_undegraded":"2024-09-19T09:52:44.780902+0000","last_fullsized":"2024-09-19T09:52:44.780902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:36.817715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104802,"num_write_kb":1303037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"25'20","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.523960+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:52:45.523960+0000","last_peered":"2024-09-19T09:52:45.523960+0000","last_clean":"2024-09-19T09:52:45.523960+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:52:45.523960+0000","last_undegraded":"2024-09-19T09:52:45.523960+0000","last_fullsized":"2024-09-19T09:52:45.523960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'5973","reported_seq":5993,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520284+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:52:45.520284+0000","last_peered":"2024-09-19T09:52:45.520284+0000","last_clean":"2024-09-19T09:52:45.520284+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:52:45.520284+0000","last_undegraded":"2024-09-19T09:52:45.520284+0000","last_fullsized":"2024-09-19T09:52:45.520284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5973,"log_dups_size":0,"ondisk_log_size":5973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91144,"num_write_kb":1060104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'181","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516531+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:52:45.516531+0000","last_peered":"2024-09-19T09:52:45.516531+0000","last_clean":"2024-09-19T09:52:45.516531+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:52:45.516531+0000","last_undegraded":"2024-09-19T09:52:45.516531+0000","last_fullsized":"2024-09-19T09:52:45.516531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'6186","reported_seq":6207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506944+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:52:45.506944+0000","last_peered":"2024-09-19T09:52:45.506944+0000","last_clean":"2024-09-19T09:52:45.506944+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:52:45.506944+0000","last_undegraded":"2024-09-19T09:52:45.506944+0000","last_fullsized":"2024-09-19T09:52:45.506944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6186,"log_dups_size":0,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94126,"num_write_kb":1169732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'8359","reported_seq":8373,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.868072+0000","last_change":"2024-09-19T09:43:20.620403+0000","last_active":"2024-09-19T09:52:45.868072+0000","last_peered":"2024-09-19T09:52:45.868072+0000","last_clean":"2024-09-19T09:52:45.868072+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:52:45.868072+0000","last_undegraded":"2024-09-19T09:52:45.868072+0000","last_fullsized":"2024-09-19T09:52:45.868072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8359,"log_dups_size":0,"ondisk_log_size":8359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:34.693485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127388,"num_write_kb":1561891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'7","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:41.359906+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:52:41.359906+0000","last_peered":"2024-09-19T09:52:41.359906+0000","last_clean":"2024-09-19T09:52:41.359906+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:52:41.359906+0000","last_undegraded":"2024-09-19T09:52:41.359906+0000","last_fullsized":"2024-09-19T09:52:41.359906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5047","reported_seq":5067,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.797581+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:52:44.797581+0000","last_peered":"2024-09-19T09:52:44.797581+0000","last_clean":"2024-09-19T09:52:44.797581+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:52:44.797581+0000","last_undegraded":"2024-09-19T09:52:44.797581+0000","last_fullsized":"2024-09-19T09:52:44.797581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5047,"log_dups_size":0,"ondisk_log_size":5047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76792,"num_write_kb":903119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'48","reported_seq":70,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508070+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:52:45.508070+0000","last_peered":"2024-09-19T09:52:45.508070+0000","last_clean":"2024-09-19T09:52:45.508070+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:52:45.508070+0000","last_undegraded":"2024-09-19T09:52:45.508070+0000","last_fullsized":"2024-09-19T09:52:45.508070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":16399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'8294","reported_seq":8315,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.554207+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:52:45.554207+0000","last_peered":"2024-09-19T09:52:45.554207+0000","last_clean":"2024-09-19T09:52:45.554207+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:52:45.554207+0000","last_undegraded":"2024-09-19T09:52:45.554207+0000","last_fullsized":"2024-09-19T09:52:45.554207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8294,"log_dups_size":0,"ondisk_log_size":8294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:21.199141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125930,"num_write_kb":1569689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'26","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.539717+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:52:45.539717+0000","last_peered":"2024-09-19T09:52:45.539717+0000","last_clean":"2024-09-19T09:52:45.539717+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:52:45.539717+0000","last_undegraded":"2024-09-19T09:52:45.539717+0000","last_fullsized":"2024-09-19T09:52:45.539717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'7281","reported_seq":7302,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.942091+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:52:44.942091+0000","last_peered":"2024-09-19T09:52:44.942091+0000","last_clean":"2024-09-19T09:52:44.942091+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:52:44.942091+0000","last_undegraded":"2024-09-19T09:52:44.942091+0000","last_fullsized":"2024-09-19T09:52:44.942091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7281,"log_dups_size":0,"ondisk_log_size":7281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110915,"num_write_kb":1387536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'21","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:55.215897+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:50:55.215897+0000","last_peered":"2024-09-19T09:50:55.215897+0000","last_clean":"2024-09-19T09:50:55.215897+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:50:55.215897+0000","last_undegraded":"2024-09-19T09:50:55.215897+0000","last_fullsized":"2024-09-19T09:50:55.215897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:38.210445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6761782,"num_write_kb":82954764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":444424,"ondisk_log_size":444424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":209497899,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":2655,"num_write_kb":206604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":419061760,"data_stored":418995798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2580,"ondisk_log_size":2580,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509576,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705108,"kb_used_data":78660,"kb_used_omap":1,"kb_used_meta":626430,"kb_avail":93666732,"statfs":{"total":96636764160,"available":95914733568,"internally_reserved":0,"allocated":80547840,"data_stored":80376143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":641464778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443924,"kb_used_data":61700,"kb_used_omap":1,"kb_used_meta":382206,"kb_avail":93927916,"statfs":{"total":96636764160,"available":96182185984,"internally_reserved":0,"allocated":63180800,"data_stored":63008649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":391379398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509575,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653352,"kb_used_data":49112,"kb_used_omap":1,"kb_used_meta":604222,"kb_avail":93718488,"statfs":{"total":96636764160,"available":95967731712,"internally_reserved":0,"allocated":50290688,"data_stored":50118304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618723781},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":679896,"kb_used_data":57608,"kb_used_omap":1,"kb_used_meta":622270,"kb_avail":93691944,"statfs":{"total":96636764160,"available":95940550656,"internally_reserved":0,"allocated":58990592,"data_stored":58813799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":637204933},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":649708,"kb_used_data":41308,"kb_used_omap":1,"kb_used_meta":608382,"kb_avail":93722132,"statfs":{"total":96636764160,"available":95971463168,"internally_reserved":0,"allocated":42299392,"data_stored":42125209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":622983623},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435372,"kb_used_data":57308,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93936468,"statfs":{"total":96636764160,"available":96190943232,"internally_reserved":0,"allocated":58683392,"data_stored":58506982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":387119557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":654364,"kb_used_data":45900,"kb_used_omap":1,"kb_used_meta":608446,"kb_avail":93717476,"statfs":{"total":96636764160,"available":95966695424,"internally_reserved":0,"allocated":47001600,"data_stored":46821767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":623049158},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421092,"kb_used_data":20820,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93950748,"statfs":{"total":96636764160,"available":96205565952,"internally_reserved":0,"allocated":21319680,"data_stored":21153017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":409860549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58425344,"data_stored":58413565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":21059600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42041344,"data_stored":42031792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58732544,"data_stored":58720382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50032640,"data_stored":50024887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:53:36.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:53:36.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.997+0000 7f3965f6d640 1 Processor -- start 2024-09-19T09:53:36.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.997+0000 7f3965f6d640 1 -- start start 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f3965f6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f3965f6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39600c4720 0x7f3960073300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f3965f6d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3960073840 0x7f396006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f3965f6d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f39600c61f0 con 0x7f39600c4720 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f3965f6d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f39600c4290 con 0x7f3960073840 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f3965f6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f39600c6ce0 con 0x7f39601531e0 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39600c4720 0x7f3960073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39600c4720 0x7f3960073300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58290/0 (socket says 172.21.15.123:58290) 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 -- 172.21.15.123:0/3337083238 learned_addr learned my addr 172.21.15.123:0/3337083238 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395ffff640 1 --2- 172.21.15.123:0/3337083238 >> v2:172.21.15.194:3300/0 conn(0x7f3960073840 0x7f396006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 -- 172.21.15.123:0/3337083238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 msgr2=0x7f3960158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395f7fe640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 -- 172.21.15.123:0/3337083238 >> v2:172.21.15.194:3300/0 conn(0x7f3960073840 msgr2=0x7f396006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 --2- 172.21.15.123:0/3337083238 >> v2:172.21.15.194:3300/0 conn(0x7f3960073840 0x7f396006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395effd640 1 -- 172.21.15.123:0/3337083238 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39600c4b20 con 0x7f39600c4720 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.998+0000 7f395f7fe640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f395effd640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f3960073300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3960071080 tx=0x7f395402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6e8a2888a76a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f395e7fc640 1 -- 172.21.15.123:0/3337083238 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954037070 con 0x7f39600c4720 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f395e7fc640 1 -- 172.21.15.123:0/3337083238 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954032440 con 0x7f39600c4720 2024-09-19T09:53:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f395e7fc640 1 -- 172.21.15.123:0/3337083238 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954032810 con 0x7f39600c4720 2024-09-19T09:53:37.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 -- 172.21.15.123:0/3337083238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 msgr2=0x7f3960073300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:37.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f3960073300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3960071080 tx=0x7f395402a270 comp rx=0 tx=0).stop 2024-09-19T09:53:37.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 -- 172.21.15.123:0/3337083238 shutdown_connections 2024-09-19T09:53:37.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 --2- 172.21.15.123:0/3337083238 >> v2:172.21.15.194:3300/0 conn(0x7f3960073840 0x7f396006c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f3960073300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 --2- 172.21.15.123:0/3337083238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 -- 172.21.15.123:0/3337083238 >> 172.21.15.123:0/3337083238 conn(0x7f396006ec90 msgr2=0x7f396006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:36.999+0000 7f3965f6d640 1 -- 172.21.15.123:0/3337083238 shutdown_connections 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.000+0000 7f3965f6d640 1 -- 172.21.15.123:0/3337083238 wait complete. 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.001+0000 7f3965f6d640 1 Processor -- start 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.001+0000 7f3965f6d640 1 -- start start 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3960073840 0x7f39600cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f39600cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39600c6a00 con 0x7f39600c4720 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39600c6720 con 0x7f3960073840 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f39600c3f20 con 0x7f39601531e0 2024-09-19T09:53:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f39600cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f39600cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58304/0 (socket says 172.21.15.123:58304) 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 -- 172.21.15.123:0/2519794798 learned_addr learned my addr 172.21.15.123:0/2519794798 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395f7fe640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3960073840 0x7f39600cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395ffff640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 -- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 msgr2=0x7f3960147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 -- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3960073840 msgr2=0x7f39600cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3960073840 0x7f39600cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 -- 172.21.15.123:0/2519794798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39600cd5b0 con 0x7f39600c4720 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395f7fe640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3960073840 0x7f39600cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395ffff640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f395effd640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f39600cc960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f395402a2b0 tx=0x7f39540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954041020 con 0x7f39600c4720 2024-09-19T09:53:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540306c0 con 0x7f39600c4720 2024-09-19T09:53:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39600cbd30 con 0x7f39600c4720 2024-09-19T09:53:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954037040 con 0x7f39600c4720 2024-09-19T09:53:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.002+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39600ca840 con 0x7f39600c4720 2024-09-19T09:53:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.004+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396006bc80 con 0x7f39600c4720 2024-09-19T09:53:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.004+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3954044020 con 0x7f39600c4720 2024-09-19T09:53:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.004+0000 7f3947fff640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394c06c2b0 0x7f394c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.004+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f39540abcb0 con 0x7f39600c4720 2024-09-19T09:53:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.004+0000 7f395f7fe640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394c06c2b0 0x7f394c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.005+0000 7f395f7fe640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394c06c2b0 0x7f394c06e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f395000a990 tx=0x7f3950008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:37.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.009+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f396006bc80 con 0x7f39600c4720 2024-09-19T09:53:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.174+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39600c3a00 con 0x7f39600c4720 2024-09-19T09:53:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.175+0000 7f3947fff640 1 -- 172.21.15.123:0/2519794798 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16892 (secure 0 0 0) 0x7f395404b030 con 0x7f39600c4720 2024-09-19T09:53:37.178 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:53:37.178 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:43:20.608350+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394c06c2b0 msgr2=0x7f394c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394c06c2b0 0x7f394c06e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f395000a990 tx=0x7f3950008040 comp rx=0 tx=0).stop 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 msgr2=0x7f39600cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f39600cc960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f395402a2b0 tx=0x7f39540046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 shutdown_connections 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f394c06c2b0 0x7f394c06e770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39601531e0 0x7f3960147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39600c4720 0x7f39600cc960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 --2- 172.21.15.123:0/2519794798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3960073840 0x7f39600cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 >> 172.21.15.123:0/2519794798 conn(0x7f396006ec90 msgr2=0x7f3960152490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 shutdown_connections 2024-09-19T09:53:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:37.177+0000 7f3965f6d640 1 -- 172.21.15.123:0/2519794798 wait complete. 2024-09-19T09:53:38.191 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T09:53:38.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:38.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.303+0000 7f67f3001640 1 Processor -- start 2024-09-19T09:53:38.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.303+0000 7f67f3001640 1 -- start start 2024-09-19T09:53:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f3001640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f3001640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f67ec0c48b0 0x7f67ec0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f3001640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ec0c9c90 con 0x7f67ec0caf40 2024-09-19T09:53:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f3001640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f67ec0c9f30 con 0x7f67ec0c48b0 2024-09-19T09:53:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f3001640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec0ca1d0 con 0x7f67ec1554a0 2024-09-19T09:53:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f0d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67ebfff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f67ec0c48b0 0x7f67ec0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f0d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec0cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36724/0 (socket says 172.21.15.123:36724) 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3191058312 learned_addr learned my addr 172.21.15.123:0/3191058312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.304+0000 7f67f159e640 1 --1- 172.21.15.123:0/3191058312 >> v1:172.21.15.194:6789/0 conn(0x7f67ec0caf40 0x7f67ec15e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.123:44898/0 (socket says 172.21.15.123:44898) 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.305+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3191058312 >> v2:172.21.15.194:3300/0 conn(0x7f67ec0c48b0 msgr2=0x7f67ec0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.305+0000 7f67f0d9d640 1 --2- 172.21.15.123:0/3191058312 >> v2:172.21.15.194:3300/0 conn(0x7f67ec0c48b0 0x7f67ec0cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.305+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3191058312 >> v1:172.21.15.194:6789/0 conn(0x7f67ec0caf40 legacy=0x7f67ec15e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.305+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3191058312 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec0709d0 con 0x7f67ec1554a0 2024-09-19T09:53:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.305+0000 7f67ebfff640 1 --2- 172.21.15.123:0/3191058312 >> v2:172.21.15.194:3300/0 conn(0x7f67ec0c48b0 0x7f67ec0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f0d9d640 1 --2- 172.21.15.123:0/3191058312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec0cb640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009870 tx=0x7f67dc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba9a0558c15e04e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67eb7fe640 1 -- 172.21.15.123:0/3191058312 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc037070 con 0x7f67ec1554a0 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67eb7fe640 1 -- 172.21.15.123:0/3191058312 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc032440 con 0x7f67ec1554a0 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67eb7fe640 1 -- 172.21.15.123:0/3191058312 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc032810 con 0x7f67ec1554a0 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 -- 172.21.15.123:0/3191058312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 msgr2=0x7f67ec0cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 --2- 172.21.15.123:0/3191058312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec0cb640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009870 tx=0x7f67dc02a270 comp rx=0 tx=0).stop 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 -- 172.21.15.123:0/3191058312 shutdown_connections 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 --2- 172.21.15.123:0/3191058312 >> v2:172.21.15.194:3300/0 conn(0x7f67ec0c48b0 0x7f67ec0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 --2- 172.21.15.123:0/3191058312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec0cb640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 -- 172.21.15.123:0/3191058312 >> 172.21.15.123:0/3191058312 conn(0x7f67ec06f530 msgr2=0x7f67ec06f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 -- 172.21.15.123:0/3191058312 shutdown_connections 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.306+0000 7f67f3001640 1 -- 172.21.15.123:0/3191058312 wait complete. 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.308+0000 7f67f3001640 1 Processor -- start 2024-09-19T09:53:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.308+0000 7f67f3001640 1 -- start start 2024-09-19T09:53:38.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.308+0000 7f67f3001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67ec0c48b0 0x7f67ec155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.308+0000 7f67f3001640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ec0caf40 0x7f67ec06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.308+0000 7f67f3001640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f3001640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec071270 con 0x7f67ec0c48b0 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f3001640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec070f90 con 0x7f67ec0caf40 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f3001640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec071550 con 0x7f67ec1554a0 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67ec0c48b0 0x7f67ec155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67ec0c48b0 0x7f67ec155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58314/0 (socket says 172.21.15.123:58314) 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3158278915 learned_addr learned my addr 172.21.15.123:0/3158278915 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f159e640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67ebfff640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ec0caf40 0x7f67ec06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3158278915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 msgr2=0x7f67ec06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67ec1554a0 0x7f67ec06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3158278915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ec0caf40 msgr2=0x7f67ec06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ec0caf40 0x7f67ec06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 -- 172.21.15.123:0/3158278915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec1f5130 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f0d9d640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67ec0c48b0 0x7f67ec155a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02a2b0 tx=0x7f67dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc041030 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc030440 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec06c0d0 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc037040 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.309+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec06c690 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.310+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67ec0ca4c0 con 0x7f67ec0c48b0 2024-09-19T09:53:38.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f67dc044070 con 0x7f67ec0c48b0 2024-09-19T09:53:38.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67e97fa640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f67d806c2b0 0x7f67d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f67dc0aba90 con 0x7f67ec0c48b0 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67ebfff640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f67d806c2b0 0x7f67d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67e97fa640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7f67d8074630 0x7f67d8076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 --> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67dc049e70 con 0x7f67d8074630 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.311+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f67dc0b02c0 con 0x7f67ec0c48b0 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.312+0000 7f67f159e640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7f67d8074630 0x7f67d8076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.312+0000 7f67ebfff640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f67d806c2b0 0x7f67d806e770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f67ec1ef090 tx=0x7f67e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.312+0000 7f67f159e640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7f67d8074630 0x7f67d8076ab0 crc :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.312+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== osd.0 v2:172.21.15.123:6826/202872460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67dc049e70 con 0x7f67d8074630 2024-09-19T09:53:38.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.325+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 --> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67ec0ca7d0 con 0x7f67d8074630 2024-09-19T09:53:38.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.325+0000 7f67e97fa640 1 -- 172.21.15.123:0/3158278915 <== osd.0 v2:172.21.15.123:6826/202872460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67ec0ca7d0 con 0x7f67d8074630 2024-09-19T09:53:38.328 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:38.329 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:38.329 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7f67d8074630 msgr2=0x7f67d8076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6826/202872460,v1:172.21.15.123:6827/202872460] conn(0x7f67d8074630 0x7f67d8076ab0 crc :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f67d806c2b0 msgr2=0x7f67d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f67d806c2b0 0x7f67d806e770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f67ec1ef090 tx=0x7f67e0008040 comp rx=0 tx=0).stop 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67ec0c48b0 msgr2=0x7f67ec155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 --2- 172.21.15.123:0/3158278915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67ec0c48b0 0x7f67ec155a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02a2b0 tx=0x7f67dc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f159e640 1 -- 172.21.15.123:0/3158278915 reap_dead start 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 shutdown_connections 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 >> 172.21.15.123:0/3158278915 conn(0x7f67ec06f530 msgr2=0x7f67ec1e71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 shutdown_connections 2024-09-19T09:53:38.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.326+0000 7f67f3001640 1 -- 172.21.15.123:0/3158278915 wait complete. 2024-09-19T09:53:38.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T09:53:38.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.436+0000 7f3033b52640 1 Processor -- start 2024-09-19T09:53:38.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.436+0000 7f3033b52640 1 -- start start 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f3033b52640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f302c14edd0 0x7f302c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f3033b52640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f302c1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f3033b52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302c0720d0 con 0x7f302c0c9a30 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f3033b52640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f302c071110 con 0x7f302c14edd0 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f3033b52640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f302c157e10 con 0x7f302c0724a0 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f30310ed640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f302c0c9a30 0x7f302c0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59758/0 (socket says 172.21.15.123:59758) 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f30310ed640 1 -- 172.21.15.123:0/2044131769 learned_addr learned my addr 172.21.15.123:0/2044131769 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f30320ef640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f302c1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f30318ee640 1 --2- 172.21.15.123:0/2044131769 >> v2:172.21.15.194:3300/0 conn(0x7f302c14edd0 0x7f302c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735837274 0 0) 0x7f302c0720d0 con 0x7f302c0c9a30 2024-09-19T09:53:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.437+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3018003520 con 0x7f302c0c9a30 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 550988068 0 0) 0x7f3018003520 con 0x7f302c0c9a30 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 msgr2=0x7f302c1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f302c1588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 >> v2:172.21.15.194:3300/0 conn(0x7f302c14edd0 msgr2=0x7f302c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 --2- 172.21.15.123:0/2044131769 >> v2:172.21.15.194:3300/0 conn(0x7f302c14edd0 0x7f302c15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c071360 con 0x7f302c0c9a30 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f3020001670 con 0x7f302c0c9a30 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 >> v1:172.21.15.123:6789/0 conn(0x7f302c0c9a30 legacy=0x7f302c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30180039b0 0x7f3018003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018004800 0x7f3018004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f30180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f302c071110 con 0x7f30180039b0 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f302c157e10 con 0x7f3018004800 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f301800ba70 con 0x7f302c0724a0 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30318ee640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30180039b0 0x7f3018003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30310ed640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018004800 0x7f3018004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30320ef640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f30180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30318ee640 1 -- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 msgr2=0x7f30180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30318ee640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f30180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30318ee640 1 -- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018004800 msgr2=0x7f3018004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30318ee640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018004800 0x7f3018004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30318ee640 1 -- 172.21.15.123:0/2044131769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3018003520 con 0x7f30180039b0 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30310ed640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018004800 0x7f3018004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.438+0000 7f30320ef640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f302c0724a0 0x7f30180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.439+0000 7f30318ee640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30180039b0 0x7f3018003dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3028009ac0 tx=0x7f3018005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f6fb4c65fe1901 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.439+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302803a070 con 0x7f30180039b0 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.439+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3028035480 con 0x7f30180039b0 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.439+0000 7f30308ec640 1 -- 172.21.15.123:0/2044131769 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028009690 con 0x7f30180039b0 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.439+0000 7f3033b52640 1 -- 172.21.15.123:0/2044131769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30180039b0 msgr2=0x7f3018003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.439+0000 7f3033b52640 1 --2- 172.21.15.123:0/2044131769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30180039b0 0x7f3018003dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3028009ac0 tx=0x7f3018005830 comp rx=0 tx=0).stop 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.440+0000 7f30320ef640 1 -- 172.21.15.123:0/2044131769 reap_dead start 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.440+0000 7f3033b52640 1 -- 172.21.15.123:0/2044131769 shutdown_connections 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.440+0000 7f3033b52640 1 -- 172.21.15.123:0/2044131769 >> 172.21.15.123:0/2044131769 conn(0x7f302c06ed00 msgr2=0x7f302c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.440+0000 7f3033b52640 1 -- 172.21.15.123:0/2044131769 shutdown_connections 2024-09-19T09:53:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.440+0000 7f3033b52640 1 -- 172.21.15.123:0/2044131769 wait complete. 2024-09-19T09:53:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.441+0000 7f3033b52640 1 Processor -- start 2024-09-19T09:53:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.441+0000 7f3033b52640 1 -- start start 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180039b0 0x7f302c1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 0x7f302c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f302c151fb0 0x7f302c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f302c1583b0 con 0x7f302c1f2ae0 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f302c1580d0 con 0x7f302c151fb0 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f302c071c80 con 0x7f30180039b0 2024-09-19T09:53:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 0x7f302c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 0x7f302c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58332/0 (socket says 172.21.15.123:58332) 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 -- 172.21.15.123:0/887206226 learned_addr learned my addr 172.21.15.123:0/887206226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30318ee640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180039b0 0x7f302c1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30320ef640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f302c151fb0 0x7f302c15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 -- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180039b0 msgr2=0x7f302c1f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180039b0 0x7f302c1f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 -- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f302c151fb0 msgr2=0x7f302c15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f302c151fb0 0x7f302c15b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 -- 172.21.15.123:0/887206226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c1f1cd0 con 0x7f302c1f2ae0 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30318ee640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180039b0 0x7f302c1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f30310ed640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 0x7f302c15b090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3020001120 tx=0x7f302000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302000c660 con 0x7f302c1f2ae0 2024-09-19T09:53:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3020018070 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c0c2f70 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302000ca00 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.442+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c14d600 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.443+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c071f50 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.444+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f302000cba0 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.444+0000 7f301e7fc640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f301006c2e0 0x7f301006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.444+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f302008b310 con 0x7f302c1f2ae0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.444+0000 7f30318ee640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f301006c2e0 0x7f301006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.445+0000 7f30318ee640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f301006c2e0 0x7f301006e7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3028037000 tx=0x7f3028008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.449+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3020059a00 con 0x7f302c1f2ae0 2024-09-19T09:53:38.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.613+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f302c0c7a10 con 0x7f301006c2e0 2024-09-19T09:53:38.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.613+0000 7f301e7fc640 1 -- 172.21.15.123:0/887206226 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f302c0c7a10 con 0x7f301006c2e0 2024-09-19T09:53:38.617 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T09:53:38.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f301006c2e0 msgr2=0x7f301006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f301006c2e0 0x7f301006e7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3028037000 tx=0x7f3028008030 comp rx=0 tx=0).stop 2024-09-19T09:53:38.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 msgr2=0x7f302c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 0x7f302c15b090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3020001120 tx=0x7f302000ec10 comp rx=0 tx=0).stop 2024-09-19T09:53:38.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 shutdown_connections 2024-09-19T09:53:38.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f302c151fb0 0x7f302c15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f302c1f2ae0 0x7f302c15b090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f301006c2e0 0x7f301006e7a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 --2- 172.21.15.123:0/887206226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180039b0 0x7f302c1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.615+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 >> 172.21.15.123:0/887206226 conn(0x7f302c06ed00 msgr2=0x7f302c0c8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.616+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 shutdown_connections 2024-09-19T09:53:38.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.616+0000 7f3033b52640 1 -- 172.21.15.123:0/887206226 wait complete. 2024-09-19T09:53:38.630 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T09:53:38.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:38.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.730+0000 7f9273027640 1 Processor -- start 2024-09-19T09:53:38.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.730+0000 7f9273027640 1 -- start start 2024-09-19T09:53:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f9273027640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f926c153610 0x7f926c06c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f9273027640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926c1592d0 con 0x7f926c06d570 2024-09-19T09:53:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f9273027640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926c159570 con 0x7f926c153230 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f9273027640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f926c159e20 con 0x7f926c153610 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f926bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f926c153610 0x7f926c06c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f92715c4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f926c06d570 0x7f926c15c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59774/0 (socket says 172.21.15.123:59774) 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f92715c4640 1 -- 172.21.15.123:0/2613427188 learned_addr learned my addr 172.21.15.123:0/2613427188 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f926bfff640 1 -- 172.21.15.123:0/2613427188 >> v1:172.21.15.194:6789/0 conn(0x7f926c153230 legacy=0x7f926c0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f926b7fe640 1 -- 172.21.15.123:0/2613427188 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980037650 0 0) 0x7f926c1592d0 con 0x7f926c06d570 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f926bfff640 1 -- 172.21.15.123:0/2613427188 >> v1:172.21.15.123:6789/0 conn(0x7f926c06d570 legacy=0x7f926c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.731+0000 7f926bfff640 1 -- 172.21.15.123:0/2613427188 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926c159810 con 0x7f926c153610 2024-09-19T09:53:38.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.732+0000 7f926bfff640 1 --2- 172.21.15.123:0/2613427188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153610 0x7f926c06c1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92580097a0 tx=0x7f925802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ad8b4a7a742eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.732+0000 7f926b7fe640 1 -- 172.21.15.123:0/2613427188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258037070 con 0x7f926c153610 2024-09-19T09:53:38.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.732+0000 7f926b7fe640 1 -- 172.21.15.123:0/2613427188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9258032440 con 0x7f926c153610 2024-09-19T09:53:38.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.732+0000 7f926b7fe640 1 -- 172.21.15.123:0/2613427188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258032810 con 0x7f926c153610 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 -- 172.21.15.123:0/2613427188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153610 msgr2=0x7f926c06c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 --2- 172.21.15.123:0/2613427188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153610 0x7f926c06c1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92580097a0 tx=0x7f925802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 -- 172.21.15.123:0/2613427188 shutdown_connections 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 --2- 172.21.15.123:0/2613427188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153610 0x7f926c06c1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 -- 172.21.15.123:0/2613427188 >> 172.21.15.123:0/2613427188 conn(0x7f926c0ca3d0 msgr2=0x7f926c0ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 -- 172.21.15.123:0/2613427188 shutdown_connections 2024-09-19T09:53:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.733+0000 7f9273027640 1 -- 172.21.15.123:0/2613427188 wait complete. 2024-09-19T09:53:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.734+0000 7f9273027640 1 Processor -- start 2024-09-19T09:53:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.734+0000 7f9273027640 1 -- start start 2024-09-19T09:53:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c06d570 0x7f926c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153230 0x7f926c1f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c153610 0x7f926c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f926c0c8410 con 0x7f926c153230 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f926c0c8290 con 0x7f926c06d570 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f926c0c76b0 con 0x7f926c153610 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153230 0x7f926c1f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153230 0x7f926c1f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58344/0 (socket says 172.21.15.123:58344) 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 -- 172.21.15.123:0/1859605857 learned_addr learned my addr 172.21.15.123:0/1859605857 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f92715c4640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c153610 0x7f926c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9270dc3640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c06d570 0x7f926c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 -- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c153610 msgr2=0x7f926c148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c153610 0x7f926c148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 -- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c06d570 msgr2=0x7f926c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c06d570 0x7f926c157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 -- 172.21.15.123:0/1859605857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926c1e35b0 con 0x7f926c153230 2024-09-19T09:53:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f92715c4640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c153610 0x7f926c148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9270dc3640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c06d570 0x7f926c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f926bfff640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153230 0x7f926c1f0040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92580098c0 tx=0x7f92580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258042020 con 0x7f926c153230 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9258030990 con 0x7f926c153230 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926c1ef8a0 con 0x7f926c153230 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258037040 con 0x7f926c153230 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.735+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926c0c4520 con 0x7f926c153230 2024-09-19T09:53:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.736+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f926c0c7f80 con 0x7f926c153230 2024-09-19T09:53:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9258045020 con 0x7f926c153230 2024-09-19T09:53:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92697fa640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f925006c2b0 0x7f925006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f92580ac1e0 con 0x7f926c153230 2024-09-19T09:53:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f9270dc3640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f925006c2b0 0x7f925006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92697fa640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f9250074630 0x7f9250076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 --> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9258036e90 con 0x7f9250074630 2024-09-19T09:53:38.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92580b3050 con 0x7f926c153230 2024-09-19T09:53:38.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.737+0000 7f92715c4640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f9250074630 0x7f9250076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.738+0000 7f9270dc3640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f925006c2b0 0x7f925006e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9260003eb0 tx=0x7f9260009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.738+0000 7f92715c4640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f9250074630 0x7f9250076ab0 crc :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.738+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== osd.1 v2:172.21.15.123:6800/1169600851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9258036e90 con 0x7f9250074630 2024-09-19T09:53:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 --> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f926c1efe00 con 0x7f9250074630 2024-09-19T09:53:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f92697fa640 1 -- 172.21.15.123:0/1859605857 <== osd.1 v2:172.21.15.123:6800/1169600851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f926c1efe00 con 0x7f9250074630 2024-09-19T09:53:38.754 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:38.754 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:38.754 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:38.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f9250074630 msgr2=0x7f9250076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6800/1169600851,v1:172.21.15.123:6802/1169600851] conn(0x7f9250074630 0x7f9250076ab0 crc :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f925006c2b0 msgr2=0x7f925006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f925006c2b0 0x7f925006e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9260003eb0 tx=0x7f9260009040 comp rx=0 tx=0).stop 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153230 msgr2=0x7f926c1f0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 --2- 172.21.15.123:0/1859605857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f926c153230 0x7f926c1f0040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92580098c0 tx=0x7f92580046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f92715c4640 1 -- 172.21.15.123:0/1859605857 reap_dead start 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 shutdown_connections 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 >> 172.21.15.123:0/1859605857 conn(0x7f926c0ca3d0 msgr2=0x7f926c15c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 shutdown_connections 2024-09-19T09:53:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.751+0000 7f9273027640 1 -- 172.21.15.123:0/1859605857 wait complete. 2024-09-19T09:53:38.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T09:53:38.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.860+0000 7f4f24ca4640 1 Processor -- start 2024-09-19T09:53:38.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.861+0000 7f4f24ca4640 1 -- start start 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.861+0000 7f4f24ca4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f2015b1c0 0x7f4f2015f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.861+0000 7f4f24ca4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4f200c78f0 0x7f4f200c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.861+0000 7f4f24ca4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f200c0cb0 con 0x7f4f20155640 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.861+0000 7f4f24ca4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2015ee00 con 0x7f4f2015b1c0 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.861+0000 7f4f24ca4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2015b5a0 con 0x7f4f200c78f0 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f2015b1c0 0x7f4f2015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f2015b1c0 0x7f4f2015f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58354/0 (socket says 172.21.15.123:58354) 2024-09-19T09:53:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 -- 172.21.15.123:0/3495363844 learned_addr learned my addr 172.21.15.123:0/3495363844 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1ed9d640 1 --2- 172.21.15.123:0/3495363844 >> v2:172.21.15.194:3300/0 conn(0x7f4f200c78f0 0x7f4f200c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 -- 172.21.15.123:0/3495363844 >> v2:172.21.15.194:3300/0 conn(0x7f4f200c78f0 msgr2=0x7f4f200c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 --2- 172.21.15.123:0/3495363844 >> v2:172.21.15.194:3300/0 conn(0x7f4f200c78f0 0x7f4f200c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 -- 172.21.15.123:0/3495363844 >> v1:172.21.15.194:6789/0 conn(0x7f4f20155640 legacy=0x7f4f20071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.862+0000 7f4f1dd9b640 1 -- 172.21.15.123:0/3495363844 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f200c8130 con 0x7f4f2015b1c0 2024-09-19T09:53:38.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f1dd9b640 1 --2- 172.21.15.123:0/3495363844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f2015f290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f2006efd0 tx=0x7f4f0802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2329a07e77668e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f1d59a640 1 -- 172.21.15.123:0/3495363844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08036070 con 0x7f4f2015b1c0 2024-09-19T09:53:38.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f1d59a640 1 -- 172.21.15.123:0/3495363844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f08031600 con 0x7f4f2015b1c0 2024-09-19T09:53:38.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f1d59a640 1 -- 172.21.15.123:0/3495363844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f080319d0 con 0x7f4f2015b1c0 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 -- 172.21.15.123:0/3495363844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 msgr2=0x7f4f2015f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/3495363844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f2015f290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f2006efd0 tx=0x7f4f0802a6f0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 -- 172.21.15.123:0/3495363844 shutdown_connections 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/3495363844 >> v2:172.21.15.194:3300/0 conn(0x7f4f200c78f0 0x7f4f200c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/3495363844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f2015f290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 -- 172.21.15.123:0/3495363844 >> 172.21.15.123:0/3495363844 conn(0x7f4f20073880 msgr2=0x7f4f20073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 -- 172.21.15.123:0/3495363844 shutdown_connections 2024-09-19T09:53:38.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.863+0000 7f4f24ca4640 1 -- 172.21.15.123:0/3495363844 wait complete. 2024-09-19T09:53:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 Processor -- start 2024-09-19T09:53:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 -- start start 2024-09-19T09:53:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f200c78f0 0x7f4f201581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f20155640 0x7f4f200c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f200ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2015e7b0 con 0x7f4f2015b1c0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200c86f0 con 0x7f4f20155640 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f24ca4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2015ea90 con 0x7f4f200c78f0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f1ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f200ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f1ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f200ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58356/0 (socket says 172.21.15.123:58356) 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.865+0000 7f4f1ed9d640 1 -- 172.21.15.123:0/2674159613 learned_addr learned my addr 172.21.15.123:0/2674159613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1e59c640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f200c78f0 0x7f4f201581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1dd9b640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f20155640 0x7f4f200c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1ed9d640 1 -- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f200c78f0 msgr2=0x7f4f201581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1ed9d640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f200c78f0 0x7f4f201581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1ed9d640 1 -- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f20155640 msgr2=0x7f4f200c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1ed9d640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f20155640 0x7f4f200c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1ed9d640 1 -- 172.21.15.123:0/2674159613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2015dab0 con 0x7f4f2015b1c0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f1ed9d640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f200ca310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000d490 tx=0x7f4f1000d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f100125f0 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10019070 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f20158720 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f100129f0 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.866+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f200c2c10 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.867+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f20069110 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.867+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f10012b90 con 0x7f4f2015b1c0 2024-09-19T09:53:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.868+0000 7f4f16ffd640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4f0006c2e0 0x7f4f0006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.868+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f4f1008b5d0 con 0x7f4f2015b1c0 2024-09-19T09:53:38.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.868+0000 7f4f1e59c640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4f0006c2e0 0x7f4f0006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.868+0000 7f4f1e59c640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4f0006c2e0 0x7f4f0006e7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f18004f60 tx=0x7f4f18007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:38.872+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4f20069110 con 0x7f4f2015b1c0 2024-09-19T09:53:39.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.040+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4f201f1b00 con 0x7f4f0006c2e0 2024-09-19T09:53:39.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.040+0000 7f4f16ffd640 1 -- 172.21.15.123:0/2674159613 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f201f1b00 con 0x7f4f0006c2e0 2024-09-19T09:53:39.044 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.042+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4f0006c2e0 msgr2=0x7f4f0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.042+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4f0006c2e0 0x7f4f0006e7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4f18004f60 tx=0x7f4f18007e30 comp rx=0 tx=0).stop 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.042+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 msgr2=0x7f4f200ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.042+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f200ca310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000d490 tx=0x7f4f1000d950 comp rx=0 tx=0).stop 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 shutdown_connections 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f2015b1c0 0x7f4f200ca310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f20155640 0x7f4f200c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f4f0006c2e0 0x7f4f0006e7a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 --2- 172.21.15.123:0/2674159613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f200c78f0 0x7f4f201581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 >> 172.21.15.123:0/2674159613 conn(0x7f4f20073880 msgr2=0x7f4f20073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 shutdown_connections 2024-09-19T09:53:39.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.043+0000 7f4f24ca4640 1 -- 172.21.15.123:0/2674159613 wait complete. 2024-09-19T09:53:39.057 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T09:53:39.057 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:39.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.156+0000 7fa69bd59640 1 Processor -- start 2024-09-19T09:53:39.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.156+0000 7fa69bd59640 1 -- start start 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69bd59640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6940ca510 0x7fa6940cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69bd59640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6940710e0 con 0x7fa694155530 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69bd59640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa694155910 con 0x7fa6940c4940 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69bd59640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa6940c9d00 con 0x7fa6940ca510 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa699af5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa694155530 0x7fa6940709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59788/0 (socket says 172.21.15.123:59788) 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa699af5640 1 -- 172.21.15.123:0/1273109560 learned_addr learned my addr 172.21.15.123:0/1273109560 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69a2f6640 1 --2- 172.21.15.123:0/1273109560 >> v2:172.21.15.123:3300/0 conn(0x7fa6940ca510 0x7fa6940cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69a2f6640 1 -- 172.21.15.123:0/1273109560 >> v1:172.21.15.194:6789/0 conn(0x7fa6940c4940 legacy=0x7fa6940cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69a2f6640 1 -- 172.21.15.123:0/1273109560 >> v1:172.21.15.123:6789/0 conn(0x7fa694155530 legacy=0x7fa6940709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa698af3640 1 -- 172.21.15.123:0/1273109560 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224178270 0 0) 0x7fa6940710e0 con 0x7fa694155530 2024-09-19T09:53:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.157+0000 7fa69a2f6640 1 -- 172.21.15.123:0/1273109560 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940c9f50 con 0x7fa6940ca510 2024-09-19T09:53:39.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.158+0000 7fa69a2f6640 1 --2- 172.21.15.123:0/1273109560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6940ca510 0x7fa6940cafd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0097a0 tx=0x7fa68c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12230addacb0d0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.158+0000 7fa698af3640 1 -- 172.21.15.123:0/1273109560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c037070 con 0x7fa6940ca510 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.158+0000 7fa698af3640 1 -- 172.21.15.123:0/1273109560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68c032640 con 0x7fa6940ca510 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.158+0000 7fa698af3640 1 -- 172.21.15.123:0/1273109560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c032a10 con 0x7fa6940ca510 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 -- 172.21.15.123:0/1273109560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6940ca510 msgr2=0x7fa6940cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 --2- 172.21.15.123:0/1273109560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6940ca510 0x7fa6940cafd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0097a0 tx=0x7fa68c02a2c0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 -- 172.21.15.123:0/1273109560 shutdown_connections 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 --2- 172.21.15.123:0/1273109560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6940ca510 0x7fa6940cafd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 -- 172.21.15.123:0/1273109560 >> 172.21.15.123:0/1273109560 conn(0x7fa69406f530 msgr2=0x7fa69406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 -- 172.21.15.123:0/1273109560 shutdown_connections 2024-09-19T09:53:39.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.159+0000 7fa69bd59640 1 -- 172.21.15.123:0/1273109560 wait complete. 2024-09-19T09:53:39.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.160+0000 7fa69bd59640 1 Processor -- start 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.160+0000 7fa69bd59640 1 -- start start 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6940c4940 0x7fa694152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6940ca510 0x7fa6941582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa694155530 0x7fa694158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa69415b8a0 con 0x7fa694155530 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa69415b5c0 con 0x7fa6940c4940 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa69415bb80 con 0x7fa6940ca510 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa694155530 0x7fa694158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa694155530 0x7fa694158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58370/0 (socket says 172.21.15.123:58370) 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 -- 172.21.15.123:0/3736074058 learned_addr learned my addr 172.21.15.123:0/3736074058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa699af5640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6940c4940 0x7fa694152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa6992f4640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6940ca510 0x7fa6941582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 -- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6940ca510 msgr2=0x7fa6941582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6940ca510 0x7fa6941582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 -- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6940c4940 msgr2=0x7fa694152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6940c4940 0x7fa694152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 -- 172.21.15.123:0/3736074058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6941e6870 con 0x7fa694155530 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa6992f4640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6940ca510 0x7fa6941582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69a2f6640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa694155530 0x7fa694158830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0098c0 tx=0x7fa68c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c041020 con 0x7fa694155530 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68c0308f0 con 0x7fa694155530 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c037040 con 0x7fa694155530 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.161+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6941f5300 con 0x7fa694155530 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.162+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6941e8420 con 0x7fa694155530 2024-09-19T09:53:39.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.162+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa69415c0a0 con 0x7fa694155530 2024-09-19T09:53:39.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa68c044020 con 0x7fa694155530 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa68a7fc640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa67806c2b0 0x7fa67806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa68c0abd40 con 0x7fa694155530 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa699af5640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa67806c2b0 0x7fa67806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa68a7fc640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7fa678074630 0x7fa678076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 --> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa678077180 con 0x7fa678074630 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.163+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa68c0ae440 con 0x7fa694155530 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.164+0000 7fa6992f4640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7fa678074630 0x7fa678076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.164+0000 7fa699af5640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa67806c2b0 0x7fa67806e770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa690001920 tx=0x7fa6900018b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.164+0000 7fa6992f4640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7fa678074630 0x7fa678076ab0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.165+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== osd.2 v2:172.21.15.123:6801/2615633995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa678077180 con 0x7fa678074630 2024-09-19T09:53:39.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 --> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa6940ccbc0 con 0x7fa678074630 2024-09-19T09:53:39.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa68a7fc640 1 -- 172.21.15.123:0/3736074058 <== osd.2 v2:172.21.15.123:6801/2615633995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa6940ccbc0 con 0x7fa678074630 2024-09-19T09:53:39.180 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:39.180 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:39.181 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7fa678074630 msgr2=0x7fa678076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6801/2615633995,v1:172.21.15.123:6803/2615633995] conn(0x7fa678074630 0x7fa678076ab0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa67806c2b0 msgr2=0x7fa67806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa67806c2b0 0x7fa67806e770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa690001920 tx=0x7fa6900018b0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa694155530 msgr2=0x7fa694158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 --2- 172.21.15.123:0/3736074058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa694155530 0x7fa694158830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0098c0 tx=0x7fa68c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69a2f6640 1 -- 172.21.15.123:0/3736074058 reap_dead start 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 shutdown_connections 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.177+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 >> 172.21.15.123:0/3736074058 conn(0x7fa69406f530 msgr2=0x7fa6940cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.178+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 shutdown_connections 2024-09-19T09:53:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.178+0000 7fa69bd59640 1 -- 172.21.15.123:0/3736074058 wait complete. 2024-09-19T09:53:39.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T09:53:39.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.287+0000 7f65b404c640 1 Processor -- start 2024-09-19T09:53:39.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.287+0000 7f65b404c640 1 -- start start 2024-09-19T09:53:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b404c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65ac070c30 0x7f65ac0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b404c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b404c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac15b5f0 con 0x7f65ac0c9200 2024-09-19T09:53:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b404c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f65ac15b8d0 con 0x7f65ac070c30 2024-09-19T09:53:39.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b404c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f65ac15bbb0 con 0x7f65ac071010 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b1de8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65ac070c30 0x7f65ac0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b25e9640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f65ac0c9200 0x7f65ac1440c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59800/0 (socket says 172.21.15.123:59800) 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b1de8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65ac070c30 0x7f65ac0cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58372/0 (socket says 172.21.15.123:58372) 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.288+0000 7f65b25e9640 1 -- 172.21.15.123:0/2356885744 learned_addr learned my addr 172.21.15.123:0/2356885744 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b15e7640 1 --2- 172.21.15.123:0/2356885744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b1de8640 1 -- 172.21.15.123:0/2356885744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 msgr2=0x7f65ac0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b1de8640 1 --2- 172.21.15.123:0/2356885744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b1de8640 1 -- 172.21.15.123:0/2356885744 >> v1:172.21.15.123:6789/0 conn(0x7f65ac0c9200 legacy=0x7f65ac1440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b0de6640 1 -- 172.21.15.123:0/2356885744 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631044532 0 0) 0x7f65ac15b5f0 con 0x7f65ac0c9200 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b1de8640 1 -- 172.21.15.123:0/2356885744 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac15be90 con 0x7f65ac070c30 2024-09-19T09:53:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.289+0000 7f65b1de8640 1 --2- 172.21.15.123:0/2356885744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac070c30 0x7f65ac0cdda0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65a80097a0 tx=0x7f65a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a6d32c7e4a31e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b0de6640 1 -- 172.21.15.123:0/2356885744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8037070 con 0x7f65ac070c30 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b0de6640 1 -- 172.21.15.123:0/2356885744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a8032440 con 0x7f65ac070c30 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b0de6640 1 -- 172.21.15.123:0/2356885744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8032810 con 0x7f65ac070c30 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 -- 172.21.15.123:0/2356885744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac070c30 msgr2=0x7f65ac0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 --2- 172.21.15.123:0/2356885744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac070c30 0x7f65ac0cdda0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65a80097a0 tx=0x7f65a802a210 comp rx=0 tx=0).stop 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 -- 172.21.15.123:0/2356885744 shutdown_connections 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 --2- 172.21.15.123:0/2356885744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 --2- 172.21.15.123:0/2356885744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac070c30 0x7f65ac0cdda0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 -- 172.21.15.123:0/2356885744 >> 172.21.15.123:0/2356885744 conn(0x7f65ac0ce8d0 msgr2=0x7f65ac0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 -- 172.21.15.123:0/2356885744 shutdown_connections 2024-09-19T09:53:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.290+0000 7f65b404c640 1 -- 172.21.15.123:0/2356885744 wait complete. 2024-09-19T09:53:39.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.291+0000 7f65b404c640 1 Processor -- start 2024-09-19T09:53:39.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.291+0000 7f65b404c640 1 -- start start 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b404c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65ac070c30 0x7f65ac0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b404c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b404c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 0x7f65ac156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b404c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac15b220 con 0x7f65ac0c9200 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b404c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac0ca0f0 con 0x7f65ac070c30 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b404c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f65ac15b3a0 con 0x7f65ac071010 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b25e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 0x7f65ac156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b25e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 0x7f65ac156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58374/0 (socket says 172.21.15.123:58374) 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b25e9640 1 -- 172.21.15.123:0/716826273 learned_addr learned my addr 172.21.15.123:0/716826273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.292+0000 7f65b15e7640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b1de8640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65ac070c30 0x7f65ac0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b25e9640 1 -- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 msgr2=0x7f65ac155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b25e9640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b25e9640 1 -- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65ac070c30 msgr2=0x7f65ac0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b25e9640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65ac070c30 0x7f65ac0c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b25e9640 1 -- 172.21.15.123:0/716826273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac15f120 con 0x7f65ac0c9200 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b25e9640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 0x7f65ac156dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c7b0 tx=0x7f65a400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4018070 con 0x7f65ac0c9200 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a400a640 con 0x7f65ac0c9200 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac1f18f0 con 0x7f65ac0c9200 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a400ce60 con 0x7f65ac0c9200 2024-09-19T09:53:39.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.293+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ac1f1bd0 con 0x7f65ac0c9200 2024-09-19T09:53:39.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.294+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ac06e7b0 con 0x7f65ac0c9200 2024-09-19T09:53:39.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.294+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f65a401b070 con 0x7f65ac0c9200 2024-09-19T09:53:39.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.295+0000 7f65a27fc640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f659006c2b0 0x7f659006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.295+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f65a408a9b0 con 0x7f65ac0c9200 2024-09-19T09:53:39.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.295+0000 7f65b1de8640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f659006c2b0 0x7f659006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.295+0000 7f65b1de8640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f659006c2b0 0x7f659006e770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f65a8034000 tx=0x7f65a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.299+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f65ac06e7b0 con 0x7f65ac0c9200 2024-09-19T09:53:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.466+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f65ac0ce450 con 0x7f659006c2b0 2024-09-19T09:53:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.466+0000 7f65a27fc640 1 -- 172.21.15.123:0/716826273 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65ac0ce450 con 0x7f659006c2b0 2024-09-19T09:53:39.469 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T09:53:39.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f659006c2b0 msgr2=0x7f659006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f659006c2b0 0x7f659006e770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f65a8034000 tx=0x7f65a802e000 comp rx=0 tx=0).stop 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 msgr2=0x7f65ac156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 0x7f65ac156dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c7b0 tx=0x7f65a400cc70 comp rx=0 tx=0).stop 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 shutdown_connections 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac0c9200 0x7f65ac156dd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f659006c2b0 0x7f659006e770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65ac071010 0x7f65ac155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 --2- 172.21.15.123:0/716826273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65ac070c30 0x7f65ac0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 >> 172.21.15.123:0/716826273 conn(0x7f65ac0ce8d0 msgr2=0x7f65ac0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 shutdown_connections 2024-09-19T09:53:39.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.468+0000 7f65b404c640 1 -- 172.21.15.123:0/716826273 wait complete. 2024-09-19T09:53:39.483 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T09:53:39.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:39.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.585+0000 7f87005e4640 1 Processor -- start 2024-09-19T09:53:39.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.585+0000 7f87005e4640 1 -- start start 2024-09-19T09:53:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f87005e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f806c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f87005e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f815e9e0 con 0x7f86f80c7470 2024-09-19T09:53:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f87005e4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f815ecc0 con 0x7f86f8067bc0 2024-09-19T09:53:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f87005e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f86f815f840 con 0x7f86f8067fa0 2024-09-19T09:53:39.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86feb81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f86f80c7470 0x7f86f815b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59810/0 (socket says 172.21.15.123:59810) 2024-09-19T09:53:39.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86feb81640 1 -- 172.21.15.123:0/1170431325 learned_addr learned my addr 172.21.15.123:0/1170431325 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:39.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fdb7f640 1 --2- 172.21.15.123:0/1170431325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180114990 0 0) 0x7f86f815e9e0 con 0x7f86f80c7470 2024-09-19T09:53:39.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86e4003520 con 0x7f86f80c7470 2024-09-19T09:53:39.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671436708 0 0) 0x7f86f815ecc0 con 0x7f86f8067bc0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f815e9e0 con 0x7f86f8067bc0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fdb7f640 1 -- 172.21.15.123:0/1170431325 >> v1:172.21.15.194:6789/0 conn(0x7f86f8067bc0 legacy=0x7f86f806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 659736708 0 0) 0x7f86e4003520 con 0x7f86f80c7470 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fdb7f640 1 -- 172.21.15.123:0/1170431325 >> v1:172.21.15.123:6789/0 conn(0x7f86f80c7470 legacy=0x7f86f815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.586+0000 7f86fdb7f640 1 -- 172.21.15.123:0/1170431325 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f815efa0 con 0x7f86f8067fa0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.587+0000 7f86fdb7f640 1 --2- 172.21.15.123:0/1170431325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f806c620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f86e80097d0 tx=0x7f86e802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47bdd4ece10d048 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.587+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8037070 con 0x7f86f8067fa0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.587+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e802acc0 con 0x7f86f8067fa0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.587+0000 7f86fd37e640 1 -- 172.21.15.123:0/1170431325 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f00019f0 con 0x7f86f8067fa0 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 -- 172.21.15.123:0/1170431325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 msgr2=0x7f86f806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 --2- 172.21.15.123:0/1170431325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f806c620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f86e80097d0 tx=0x7f86e802a230 comp rx=0 tx=0).stop 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 -- 172.21.15.123:0/1170431325 shutdown_connections 2024-09-19T09:53:39.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 --2- 172.21.15.123:0/1170431325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f806c620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 -- 172.21.15.123:0/1170431325 >> 172.21.15.123:0/1170431325 conn(0x7f86f80ca3d0 msgr2=0x7f86f80ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 -- 172.21.15.123:0/1170431325 shutdown_connections 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.588+0000 7f87005e4640 1 -- 172.21.15.123:0/1170431325 wait complete. 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.589+0000 7f87005e4640 1 Processor -- start 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.589+0000 7f87005e4640 1 -- start start 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f8067bc0 0x7f86f80cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f8152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80c7470 0x7f86f815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86f815bdd0 con 0x7f86f80c7470 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86f815f560 con 0x7f86f8067bc0 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f86f815bf50 con 0x7f86f8067fa0 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80c7470 0x7f86f815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80c7470 0x7f86f815d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58386/0 (socket says 172.21.15.123:58386) 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 -- 172.21.15.123:0/2361598114 learned_addr learned my addr 172.21.15.123:0/2361598114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86fdb7f640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f8152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86fe380640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f8067bc0 0x7f86f80cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 -- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 msgr2=0x7f86f8152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f8067fa0 0x7f86f8152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 -- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f8067bc0 msgr2=0x7f86f80cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f8067bc0 0x7f86f80cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 -- 172.21.15.123:0/2361598114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f815e4b0 con 0x7f86f80c7470 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86fe380640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f8067bc0 0x7f86f80cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86feb81640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80c7470 0x7f86f815d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86f000cbf0 tx=0x7f86f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0017070 con 0x7f86f80c7470 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f000ad50 con 0x7f86f80c7470 2024-09-19T09:53:39.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f815aec0 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0012600 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.590+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f8158df0 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.591+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86f806c620 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.592+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86f001a070 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.592+0000 7f86eeffd640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f86dc06c2e0 0x7f86dc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.592+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f86f008b1d0 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.592+0000 7f86fe380640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f86dc06c2e0 0x7f86dc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.593+0000 7f86eeffd640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7f86dc074660 0x7f86dc076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.593+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 --> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86f000de50 con 0x7f86dc074660 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.593+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86f0092050 con 0x7f86f80c7470 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.593+0000 7f86fdb7f640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7f86dc074660 0x7f86dc076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.593+0000 7f86fe380640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f86dc06c2e0 0x7f86dc06e7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86f40011e0 tx=0x7f86f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.593+0000 7f86fdb7f640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7f86dc074660 0x7f86dc076ae0 crc :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.594+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== osd.3 v2:172.21.15.123:6816/116101554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86f000de50 con 0x7f86dc074660 2024-09-19T09:53:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.606+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 --> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86f80ccbe0 con 0x7f86dc074660 2024-09-19T09:53:39.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.606+0000 7f86eeffd640 1 -- 172.21.15.123:0/2361598114 <== osd.3 v2:172.21.15.123:6816/116101554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f86f80ccbe0 con 0x7f86dc074660 2024-09-19T09:53:39.610 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:39.610 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:39.610 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7f86dc074660 msgr2=0x7f86dc076ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6816/116101554,v1:172.21.15.123:6817/116101554] conn(0x7f86dc074660 0x7f86dc076ae0 crc :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f86dc06c2e0 msgr2=0x7f86dc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f86dc06c2e0 0x7f86dc06e7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86f40011e0 tx=0x7f86f4009040 comp rx=0 tx=0).stop 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80c7470 msgr2=0x7f86f815d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 --2- 172.21.15.123:0/2361598114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86f80c7470 0x7f86f815d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86f000cbf0 tx=0x7f86f000a430 comp rx=0 tx=0).stop 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f86feb81640 1 -- 172.21.15.123:0/2361598114 reap_dead start 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 shutdown_connections 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 >> 172.21.15.123:0/2361598114 conn(0x7f86f80ca3d0 msgr2=0x7f86f80c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 shutdown_connections 2024-09-19T09:53:39.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.607+0000 7f87005e4640 1 -- 172.21.15.123:0/2361598114 wait complete. 2024-09-19T09:53:39.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T09:53:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.717+0000 7f996198d640 1 Processor -- start 2024-09-19T09:53:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.717+0000 7f996198d640 1 -- start start 2024-09-19T09:53:39.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f996198d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f995c1555b0 0x7f995c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f996198d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c15e620 con 0x7f995c1551d0 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f996198d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c15b5f0 con 0x7f995c15b080 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f996198d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f995c0c5c50 con 0x7f995c1555b0 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f995a7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f995c1555b0 0x7f995c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f995a7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f995c1555b0 0x7f995c0ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58394/0 (socket says 172.21.15.123:58394) 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f995affd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f995c1551d0 0x7f995c15edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59826/0 (socket says 172.21.15.123:59826) 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.718+0000 7f995a7fc640 1 -- 172.21.15.123:0/1002810850 learned_addr learned my addr 172.21.15.123:0/1002810850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.719+0000 7f995a7fc640 1 -- 172.21.15.123:0/1002810850 >> v1:172.21.15.194:6789/0 conn(0x7f995c15b080 legacy=0x7f995c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.719+0000 7f995a7fc640 1 -- 172.21.15.123:0/1002810850 >> v1:172.21.15.123:6789/0 conn(0x7f995c1551d0 legacy=0x7f995c15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.719+0000 7f995a7fc640 1 -- 172.21.15.123:0/1002810850 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c15b8d0 con 0x7f995c1555b0 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.719+0000 7f9959ffb640 1 -- 172.21.15.123:0/1002810850 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832582849 0 0) 0x7f994c001490 con 0x7f995c1551d0 2024-09-19T09:53:39.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.719+0000 7f995a7fc640 1 --2- 172.21.15.123:0/1002810850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c0ccb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9944009870 tx=0x7f994402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66361c423c1ba22a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.719+0000 7f9959ffb640 1 -- 172.21.15.123:0/1002810850 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944037070 con 0x7f995c1555b0 2024-09-19T09:53:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f9959ffb640 1 -- 172.21.15.123:0/1002810850 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994402ae50 con 0x7f995c1555b0 2024-09-19T09:53:39.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f9959ffb640 1 -- 172.21.15.123:0/1002810850 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944032860 con 0x7f995c1555b0 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 -- 172.21.15.123:0/1002810850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 msgr2=0x7f995c0ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 --2- 172.21.15.123:0/1002810850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c0ccb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9944009870 tx=0x7f994402a300 comp rx=0 tx=0).stop 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 -- 172.21.15.123:0/1002810850 shutdown_connections 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 --2- 172.21.15.123:0/1002810850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c0ccb30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 -- 172.21.15.123:0/1002810850 >> 172.21.15.123:0/1002810850 conn(0x7f995c0d0e10 msgr2=0x7f995c0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 -- 172.21.15.123:0/1002810850 shutdown_connections 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.720+0000 7f996198d640 1 -- 172.21.15.123:0/1002810850 wait complete. 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.721+0000 7f996198d640 1 Processor -- start 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.721+0000 7f996198d640 1 -- start start 2024-09-19T09:53:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f996198d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f995c1551d0 0x7f995c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f996198d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c1f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f996198d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995c15b080 0x7f995c1f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f996198d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f995c15e8a0 con 0x7f995c1555b0 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f996198d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f995c15be90 con 0x7f995c15b080 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f996198d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f995c15f4d0 con 0x7f995c1551d0 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c1f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c1f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58406/0 (socket says 172.21.15.123:58406) 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 -- 172.21.15.123:0/3943747703 learned_addr learned my addr 172.21.15.123:0/3943747703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995affd640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f995c1551d0 0x7f995c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995b7fe640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995c15b080 0x7f995c1f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 -- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f995c1551d0 msgr2=0x7f995c0cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f995c1551d0 0x7f995c0cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 -- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995c15b080 msgr2=0x7f995c1f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995c15b080 0x7f995c1f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995a7fc640 1 -- 172.21.15.123:0/3943747703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c157a60 con 0x7f995c1555b0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995affd640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f995c1551d0 0x7f995c0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.722+0000 7f995b7fe640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995c15b080 0x7f995c1f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.723+0000 7f995a7fc640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c1f4b70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9944000c00 tx=0x7f99440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.723+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944041070 con 0x7f995c1555b0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.723+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994403c870 con 0x7f995c1555b0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.723+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944037040 con 0x7f995c1555b0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.723+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995c0c7b80 con 0x7f995c1555b0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.723+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995c157fb0 con 0x7f995c1555b0 2024-09-19T09:53:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.724+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995c06d4f0 con 0x7f995c1555b0 2024-09-19T09:53:39.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.724+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9944044070 con 0x7f995c1555b0 2024-09-19T09:53:39.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.725+0000 7f9953fff640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f993c06c2b0 0x7f993c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.725+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f99440ac130 con 0x7f995c1555b0 2024-09-19T09:53:39.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.725+0000 7f995affd640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f993c06c2b0 0x7f993c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.725+0000 7f995affd640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f993c06c2b0 0x7f993c06e770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f994c0012e0 tx=0x7f994c007d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.729+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f995c06d4f0 con 0x7f995c1555b0 2024-09-19T09:53:39.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.894+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f995c15edc0 con 0x7f993c06c2b0 2024-09-19T09:53:39.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.895+0000 7f9953fff640 1 -- 172.21.15.123:0/3943747703 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f995c15edc0 con 0x7f993c06c2b0 2024-09-19T09:53:39.898 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T09:53:39.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f993c06c2b0 msgr2=0x7f993c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f993c06c2b0 0x7f993c06e770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f994c0012e0 tx=0x7f994c007d90 comp rx=0 tx=0).stop 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 msgr2=0x7f995c1f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c1f4b70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9944000c00 tx=0x7f99440046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 shutdown_connections 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995c15b080 0x7f995c1f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f995c1555b0 0x7f995c1f4b70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f993c06c2b0 0x7f993c06e770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 --2- 172.21.15.123:0/3943747703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f995c1551d0 0x7f995c0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 >> 172.21.15.123:0/3943747703 conn(0x7f995c0d0e10 msgr2=0x7f995c159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 shutdown_connections 2024-09-19T09:53:39.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:39.897+0000 7f996198d640 1 -- 172.21.15.123:0/3943747703 wait complete. 2024-09-19T09:53:39.913 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T09:53:39.914 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:40.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.014+0000 7fee1d8e4640 1 Processor -- start 2024-09-19T09:53:40.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.014+0000 7fee1d8e4640 1 -- start start 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee1d8e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee180cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee1d8e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee18155760 con 0x7fee1815f070 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee1d8e4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee1815b280 con 0x7fee18155380 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee1d8e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fee1815be90 con 0x7fee180c6d50 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee0e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee1815f070 0x7fee180c6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59836/0 (socket says 172.21.15.123:59836) 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee0e7fc640 1 -- 172.21.15.123:0/3831439682 learned_addr learned my addr 172.21.15.123:0/3831439682 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee177fe640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee180cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879556632 0 0) 0x7fee18155760 con 0x7fee1815f070 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.015+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee04003520 con 0x7fee1815f070 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233728583 0 0) 0x7fee04003520 con 0x7fee1815f070 2024-09-19T09:53:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 msgr2=0x7fee180cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee180cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 >> v1:172.21.15.194:6789/0 conn(0x7fee18155380 legacy=0x7fee180cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1815b560 con 0x7fee1815f070 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fee00001670 con 0x7fee1815f070 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 >> v1:172.21.15.123:6789/0 conn(0x7fee1815f070 legacy=0x7fee180c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040039e0 0x7fee04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee04004390 0x7fee04004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee040050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fee1815be90 con 0x7fee040039e0 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fee0400b9c0 con 0x7fee04004390 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fee0400bbc0 con 0x7fee180c6d50 2024-09-19T09:53:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee16ffd640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040039e0 0x7fee04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee0e7fc640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee04004390 0x7fee04004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee177fe640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee040050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee16ffd640 1 -- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 msgr2=0x7fee040050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee16ffd640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee040050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee16ffd640 1 -- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee04004390 msgr2=0x7fee04004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee16ffd640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee04004390 0x7fee04004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee16ffd640 1 -- 172.21.15.123:0/3831439682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee04003520 con 0x7fee040039e0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.016+0000 7fee177fe640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee180c6d50 0x7fee040050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee16ffd640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040039e0 0x7fee04003dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee08001860 tx=0x7fee04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf13467fb8a90440 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08037070 con 0x7fee040039e0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0802ac30 con 0x7fee040039e0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee167fc640 1 -- 172.21.15.123:0/3831439682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08001430 con 0x7fee040039e0 2024-09-19T09:53:40.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee1d8e4640 1 -- 172.21.15.123:0/3831439682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040039e0 msgr2=0x7fee04003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee1d8e4640 1 --2- 172.21.15.123:0/3831439682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee040039e0 0x7fee04003dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee08001860 tx=0x7fee04005830 comp rx=0 tx=0).stop 2024-09-19T09:53:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee177fe640 1 -- 172.21.15.123:0/3831439682 reap_dead start 2024-09-19T09:53:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee1d8e4640 1 -- 172.21.15.123:0/3831439682 shutdown_connections 2024-09-19T09:53:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee1d8e4640 1 -- 172.21.15.123:0/3831439682 >> 172.21.15.123:0/3831439682 conn(0x7fee18073ea0 msgr2=0x7fee1806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.017+0000 7fee1d8e4640 1 -- 172.21.15.123:0/3831439682 shutdown_connections 2024-09-19T09:53:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.018+0000 7fee1d8e4640 1 -- 172.21.15.123:0/3831439682 wait complete. 2024-09-19T09:53:40.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.019+0000 7fee1d8e4640 1 Processor -- start 2024-09-19T09:53:40.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.019+0000 7fee1d8e4640 1 -- start start 2024-09-19T09:53:40.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.019+0000 7fee1d8e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee040039e0 0x7fee180b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.019+0000 7fee1d8e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1815a340 0x7fee180d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee1d8e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1815cef0 0x7fee1815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee1d8e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fee180cdd00 con 0x7fee1815cef0 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee1d8e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fee1815bb20 con 0x7fee040039e0 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee1d8e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fee180cde80 con 0x7fee1815a340 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1815cef0 0x7fee1815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1815cef0 0x7fee1815d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58420/0 (socket says 172.21.15.123:58420) 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 -- 172.21.15.123:0/4211493498 learned_addr learned my addr 172.21.15.123:0/4211493498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee16ffd640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee040039e0 0x7fee180b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 -- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1815a340 msgr2=0x7fee180d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee0e7fc640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1815a340 0x7fee180d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1815a340 0x7fee180d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 -- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee040039e0 msgr2=0x7fee180b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee040039e0 0x7fee180b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 -- 172.21.15.123:0/4211493498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee181525d0 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee16ffd640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee040039e0 0x7fee180b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee177fe640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1815cef0 0x7fee1815d370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee10009ed0 tx=0x7fee10010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10003990 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee10003b30 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee180b51a0 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10004020 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.020+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1815e110 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.021+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee180c5e20 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee1001e020 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee14ff9640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fedf806c2b0 0x7fedf806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fee1008bbd0 con 0x7fee1815cef0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee16ffd640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fedf806c2b0 0x7fedf806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee14ff9640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7fedf80745d0 0x7fedf8076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 --> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee10020e50 con 0x7fedf80745d0 2024-09-19T09:53:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.022+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee100912a0 con 0x7fee1815cef0 2024-09-19T09:53:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.023+0000 7fee16ffd640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fedf806c2b0 0x7fedf806e770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee08001860 tx=0x7fee08009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.023+0000 7fee0e7fc640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7fedf80745d0 0x7fedf8076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.023+0000 7fee0e7fc640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7fedf80745d0 0x7fedf8076a50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.024+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== osd.4 v2:172.21.15.194:6808/3240452263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee10020e50 con 0x7fedf80745d0 2024-09-19T09:53:40.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.036+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 --> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fee180ce540 con 0x7fedf80745d0 2024-09-19T09:53:40.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee14ff9640 1 -- 172.21.15.123:0/4211493498 <== osd.4 v2:172.21.15.194:6808/3240452263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fee180ce540 con 0x7fedf80745d0 2024-09-19T09:53:40.040 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:40.040 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:40.040 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:40.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7fedf80745d0 msgr2=0x7fedf8076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.194:6808/3240452263,v1:172.21.15.194:6809/3240452263] conn(0x7fedf80745d0 0x7fedf8076a50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fedf806c2b0 msgr2=0x7fedf806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fedf806c2b0 0x7fedf806e770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee08001860 tx=0x7fee08009030 comp rx=0 tx=0).stop 2024-09-19T09:53:40.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1815cef0 msgr2=0x7fee1815d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 --2- 172.21.15.123:0/4211493498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1815cef0 0x7fee1815d370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee10009ed0 tx=0x7fee10010590 comp rx=0 tx=0).stop 2024-09-19T09:53:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee177fe640 1 -- 172.21.15.123:0/4211493498 reap_dead start 2024-09-19T09:53:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 shutdown_connections 2024-09-19T09:53:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 >> 172.21.15.123:0/4211493498 conn(0x7fee18073ea0 msgr2=0x7fee1814f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 shutdown_connections 2024-09-19T09:53:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.037+0000 7fee1d8e4640 1 -- 172.21.15.123:0/4211493498 wait complete. 2024-09-19T09:53:40.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T09:53:40.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.148+0000 7f8ba088d640 1 Processor -- start 2024-09-19T09:53:40.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.148+0000 7f8ba088d640 1 -- start start 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8ba088d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c0c9a30 0x7f8b9c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8ba088d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8b9c0724a0 0x7f8b9c1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8ba088d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9c0720d0 con 0x7f8b9c14edd0 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8ba088d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c071110 con 0x7f8b9c0724a0 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8ba088d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c157e10 con 0x7f8b9c0c9a30 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b9c14edd0 0x7f8b9c0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59846/0 (socket says 172.21.15.123:59846) 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9a59c640 1 -- 172.21.15.123:0/2214955188 learned_addr learned my addr 172.21.15.123:0/2214955188 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b99d9b640 1 --2- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c0c9a30 0x7f8b9c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9ad9d640 1 --2- 172.21.15.123:0/2214955188 >> v2:172.21.15.194:3300/0 conn(0x7f8b9c0724a0 0x7f8b9c1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9959a640 1 -- 172.21.15.123:0/2214955188 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870653910 0 0) 0x7f8b9c0720d0 con 0x7f8b9c14edd0 2024-09-19T09:53:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9959a640 1 -- 172.21.15.123:0/2214955188 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b84003520 con 0x7f8b9c14edd0 2024-09-19T09:53:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9ad9d640 1 -- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c0c9a30 msgr2=0x7f8b9c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9959a640 1 -- 172.21.15.123:0/2214955188 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 29745111 0 0) 0x7f8b84003520 con 0x7f8b9c14edd0 2024-09-19T09:53:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9ad9d640 1 --2- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c0c9a30 0x7f8b9c15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9ad9d640 1 -- 172.21.15.123:0/2214955188 >> v1:172.21.15.123:6789/0 conn(0x7f8b9c14edd0 legacy=0x7f8b9c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.149+0000 7f8b9ad9d640 1 -- 172.21.15.123:0/2214955188 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c071360 con 0x7f8b9c0724a0 2024-09-19T09:53:40.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.150+0000 7f8b9ad9d640 1 --2- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c1588d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009d90 tx=0x7f8b9402a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af90e4f3e50dcbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.150+0000 7f8b9959a640 1 -- 172.21.15.123:0/2214955188 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c001670 con 0x7f8b9c0724a0 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.150+0000 7f8b9959a640 1 -- 172.21.15.123:0/2214955188 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94007540 con 0x7f8b9c0724a0 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.150+0000 7f8b9959a640 1 -- 172.21.15.123:0/2214955188 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940078f0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 -- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0724a0 msgr2=0x7f8b9c1588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c1588d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009d90 tx=0x7f8b9402a560 comp rx=0 tx=0).stop 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 -- 172.21.15.123:0/2214955188 shutdown_connections 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c1588d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2214955188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c0c9a30 0x7f8b9c15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 -- 172.21.15.123:0/2214955188 >> 172.21.15.123:0/2214955188 conn(0x7f8b9c06ed00 msgr2=0x7f8b9c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 -- 172.21.15.123:0/2214955188 shutdown_connections 2024-09-19T09:53:40.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.151+0000 7f8ba088d640 1 -- 172.21.15.123:0/2214955188 wait complete. 2024-09-19T09:53:40.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.152+0000 7f8ba088d640 1 Processor -- start 2024-09-19T09:53:40.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.152+0000 7f8ba088d640 1 -- start start 2024-09-19T09:53:40.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8ba088d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8ba088d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0c9a30 0x7f8b9c1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8ba088d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c14edd0 0x7f8b9c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8ba088d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c1583b0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8ba088d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c1580d0 con 0x7f8b9c0c9a30 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8ba088d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c071c80 con 0x7f8b9c14edd0 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58436/0 (socket says 172.21.15.123:58436) 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 -- 172.21.15.123:0/2024365115 learned_addr learned my addr 172.21.15.123:0/2024365115 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b99d9b640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0c9a30 0x7f8b9c1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9ad9d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c14edd0 0x7f8b9c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 -- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c14edd0 msgr2=0x7f8b9c151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c14edd0 0x7f8b9c151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 -- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0c9a30 msgr2=0x7f8b9c1f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0c9a30 0x7f8b9c1f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b9a59c640 1 -- 172.21.15.123:0/2024365115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c1528f0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.153+0000 7f8b99d9b640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0c9a30 0x7f8b9c1f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.154+0000 7f8b9a59c640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c154f80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c730 tx=0x7f8b8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.154+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c017070 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.154+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c005ad0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.154+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c007070 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.154+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c0c8a90 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.154+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c1f29f0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.155+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c071f50 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.155+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b8c01a070 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.156+0000 7f8b8affd640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8b7c06c2b0 0x7f8b7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.156+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f8b8c08a7b0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.156+0000 7f8b99d9b640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8b7c06c2b0 0x7f8b7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.156+0000 7f8b99d9b640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8b7c06c2b0 0x7f8b7c06e770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c06fad0 tx=0x7f8b90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.160+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8b8c0588e0 con 0x7f8b9c0724a0 2024-09-19T09:53:40.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.326+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8b9c14d8c0 con 0x7f8b7c06c2b0 2024-09-19T09:53:40.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.326+0000 7f8b8affd640 1 -- 172.21.15.123:0/2024365115 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8b9c14d8c0 con 0x7f8b7c06c2b0 2024-09-19T09:53:40.330 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T09:53:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8b7c06c2b0 msgr2=0x7f8b7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8b7c06c2b0 0x7f8b7c06e770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c06fad0 tx=0x7f8b90008040 comp rx=0 tx=0).stop 2024-09-19T09:53:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 msgr2=0x7f8b9c154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c154f80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c730 tx=0x7f8b8c00cbf0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 shutdown_connections 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8b7c06c2b0 0x7f8b7c06e770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9c14edd0 0x7f8b9c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b9c0c9a30 0x7f8b9c1f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 --2- 172.21.15.123:0/2024365115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b9c0724a0 0x7f8b9c154f80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 >> 172.21.15.123:0/2024365115 conn(0x7f8b9c06ed00 msgr2=0x7f8b9c0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 shutdown_connections 2024-09-19T09:53:40.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.329+0000 7f8ba088d640 1 -- 172.21.15.123:0/2024365115 wait complete. 2024-09-19T09:53:40.343 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T09:53:40.343 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:40.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.445+0000 7fda77a84640 1 Processor -- start 2024-09-19T09:53:40.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda77a84640 1 -- start start 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda77a84640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 0x7fda700c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda77a84640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda700c8220 con 0x7fda70152e80 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda77a84640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda700c8d30 con 0x7fda700c9b30 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda77a84640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fda70159d30 con 0x7fda700c5890 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda75820640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fda70152e80 0x7fda70159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59860/0 (socket says 172.21.15.123:59860) 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.446+0000 7fda75820640 1 -- 172.21.15.123:0/73047558 learned_addr learned my addr 172.21.15.123:0/73047558 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 0x7fda700c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227637338 0 0) 0x7fda700c8220 con 0x7fda70152e80 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda5c003520 con 0x7fda70152e80 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3594829187 0 0) 0x7fda5c003520 con 0x7fda70152e80 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 msgr2=0x7fda700c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 0x7fda700c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 >> v1:172.21.15.194:6789/0 conn(0x7fda700c9b30 legacy=0x7fda700ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda700c8490 con 0x7fda70152e80 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7fda6c001670 con 0x7fda70152e80 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 >> v1:172.21.15.123:6789/0 conn(0x7fda70152e80 legacy=0x7fda70159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 0x7fda5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda5c003f20 0x7fda5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c004d40 0x7fda5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fda70159d30 con 0x7fda5c003f20 2024-09-19T09:53:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c00ba20 con 0x7fda5c004d40 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fda5c00bc20 con 0x7fda700c5890 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda5c003f20 0x7fda5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda75820640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 0x7fda5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda76021640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c004d40 0x7fda5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 -- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 msgr2=0x7fda5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda700c5890 0x7fda5c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 -- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c004d40 msgr2=0x7fda5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c004d40 0x7fda5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.447+0000 7fda7501f640 1 -- 172.21.15.123:0/73047558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c003520 con 0x7fda5c003f20 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.448+0000 7fda7501f640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda5c003f20 0x7fda5c004800 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda7006e5b0 tx=0x7fda5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc07455e12bfdc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.448+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60036070 con 0x7fda5c003f20 2024-09-19T09:53:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.448+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda60031400 con 0x7fda5c003f20 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.448+0000 7fda7481e640 1 -- 172.21.15.123:0/73047558 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60009690 con 0x7fda5c003f20 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda77a84640 1 -- 172.21.15.123:0/73047558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda5c003f20 msgr2=0x7fda5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda77a84640 1 --2- 172.21.15.123:0/73047558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda5c003f20 0x7fda5c004800 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda7006e5b0 tx=0x7fda5c005830 comp rx=0 tx=0).stop 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda76021640 1 -- 172.21.15.123:0/73047558 reap_dead start 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda77a84640 1 -- 172.21.15.123:0/73047558 shutdown_connections 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda77a84640 1 -- 172.21.15.123:0/73047558 >> 172.21.15.123:0/73047558 conn(0x7fda7006f0c0 msgr2=0x7fda7006f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda77a84640 1 -- 172.21.15.123:0/73047558 shutdown_connections 2024-09-19T09:53:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.449+0000 7fda77a84640 1 -- 172.21.15.123:0/73047558 wait complete. 2024-09-19T09:53:40.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.450+0000 7fda77a84640 1 Processor -- start 2024-09-19T09:53:40.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.450+0000 7fda77a84640 1 -- start start 2024-09-19T09:53:40.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c003f20 0x7fda70145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700cbeb0 0x7fda701e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda701e2160 0x7fda701e3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fda70158e20 con 0x7fda700cbeb0 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fda700c8a50 con 0x7fda5c003f20 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fda7015c300 con 0x7fda701e2160 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700cbeb0 0x7fda701e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700cbeb0 0x7fda701e2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58444/0 (socket says 172.21.15.123:58444) 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 -- 172.21.15.123:0/3908686034 learned_addr learned my addr 172.21.15.123:0/3908686034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda75820640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c003f20 0x7fda70145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda76021640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda701e2160 0x7fda701e3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 -- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda701e2160 msgr2=0x7fda701e3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda701e2160 0x7fda701e3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 -- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c003f20 msgr2=0x7fda70145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda5c003f20 0x7fda70145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 -- 172.21.15.123:0/3908686034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda701e4230 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda7501f640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700cbeb0 0x7fda701e2b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda6002aa90 tx=0x7fda60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60040020 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda60003a40 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda700cdcb0 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.451+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60036040 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.452+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda700ce270 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.452+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda70150a20 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda60043020 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda667fc640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fda5406c2e0 0x7fda5406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fda600abc00 con 0x7fda700cbeb0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda75820640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fda5406c2e0 0x7fda5406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda667fc640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7fda54074660 0x7fda54076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 --> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda60008eb0 con 0x7fda54074660 2024-09-19T09:53:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.453+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda600b2050 con 0x7fda700cbeb0 2024-09-19T09:53:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.454+0000 7fda75820640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fda5406c2e0 0x7fda5406e7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fda6c001eb0 tx=0x7fda6c001e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.454+0000 7fda76021640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7fda54074660 0x7fda54076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.454+0000 7fda76021640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7fda54074660 0x7fda54076ae0 crc :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.455+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== osd.5 v2:172.21.15.194:6824/3240582688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda60008eb0 con 0x7fda54074660 2024-09-19T09:53:40.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.471+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 --> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda700c5460 con 0x7fda54074660 2024-09-19T09:53:40.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda667fc640 1 -- 172.21.15.123:0/3908686034 <== osd.5 v2:172.21.15.194:6824/3240582688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda700c5460 con 0x7fda54074660 2024-09-19T09:53:40.475 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:40.475 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:40.475 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7fda54074660 msgr2=0x7fda54076ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.194:6824/3240582688,v1:172.21.15.194:6825/3240582688] conn(0x7fda54074660 0x7fda54076ae0 crc :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fda5406c2e0 msgr2=0x7fda5406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fda5406c2e0 0x7fda5406e7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fda6c001eb0 tx=0x7fda6c001e20 comp rx=0 tx=0).stop 2024-09-19T09:53:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700cbeb0 msgr2=0x7fda701e2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 --2- 172.21.15.123:0/3908686034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda700cbeb0 0x7fda701e2b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda6002aa90 tx=0x7fda60004730 comp rx=0 tx=0).stop 2024-09-19T09:53:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda76021640 1 -- 172.21.15.123:0/3908686034 reap_dead start 2024-09-19T09:53:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 shutdown_connections 2024-09-19T09:53:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 >> 172.21.15.123:0/3908686034 conn(0x7fda7006f0c0 msgr2=0x7fda7006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 shutdown_connections 2024-09-19T09:53:40.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.472+0000 7fda77a84640 1 -- 172.21.15.123:0/3908686034 wait complete. 2024-09-19T09:53:40.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T09:53:40.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.584+0000 7f7b1c98d640 1 Processor -- start 2024-09-19T09:53:40.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.584+0000 7f7b1c98d640 1 -- start start 2024-09-19T09:53:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b1c98d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b181551d0 0x7f7b1815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b1c98d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b1815f300 0x7f7b1806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b1c98d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815e620 con 0x7f7b181555b0 2024-09-19T09:53:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b1c98d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7b180c5c50 con 0x7f7b1815f300 2024-09-19T09:53:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b1c98d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1815b5f0 con 0x7f7b181551d0 2024-09-19T09:53:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b16d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b1815f300 0x7f7b1806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b16d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b1815f300 0x7f7b1806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58450/0 (socket says 172.21.15.123:58450) 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b15d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7b181555b0 0x7f7b180ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59862/0 (socket says 172.21.15.123:59862) 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.585+0000 7f7b16d9d640 1 -- 172.21.15.123:0/1585662805 learned_addr learned my addr 172.21.15.123:0/1585662805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b1659c640 1 --2- 172.21.15.123:0/1585662805 >> v2:172.21.15.194:3300/0 conn(0x7f7b181551d0 0x7f7b1815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b16d9d640 1 -- 172.21.15.123:0/1585662805 >> v2:172.21.15.194:3300/0 conn(0x7f7b181551d0 msgr2=0x7f7b1815edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b16d9d640 1 --2- 172.21.15.123:0/1585662805 >> v2:172.21.15.194:3300/0 conn(0x7f7b181551d0 0x7f7b1815edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b16d9d640 1 -- 172.21.15.123:0/1585662805 >> v1:172.21.15.123:6789/0 conn(0x7f7b181555b0 legacy=0x7f7b180ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b16d9d640 1 -- 172.21.15.123:0/1585662805 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1815b8d0 con 0x7f7b1815f300 2024-09-19T09:53:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b1559a640 1 -- 172.21.15.123:0/1585662805 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194757839 0 0) 0x7f7b0c001110 con 0x7f7b181555b0 2024-09-19T09:53:40.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.586+0000 7f7b16d9d640 1 --2- 172.21.15.123:0/1585662805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815f300 0x7f7b1806c6d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b1806d4c0 tx=0x7f7b0802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6f6760ba1cf10c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1559a640 1 -- 172.21.15.123:0/1585662805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08037070 con 0x7f7b1815f300 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1559a640 1 -- 172.21.15.123:0/1585662805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0802ae50 con 0x7f7b1815f300 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1559a640 1 -- 172.21.15.123:0/1585662805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08032860 con 0x7f7b1815f300 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 -- 172.21.15.123:0/1585662805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815f300 msgr2=0x7f7b1806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/1585662805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815f300 0x7f7b1806c6d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b1806d4c0 tx=0x7f7b0802a300 comp rx=0 tx=0).stop 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 -- 172.21.15.123:0/1585662805 shutdown_connections 2024-09-19T09:53:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/1585662805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815f300 0x7f7b1806c6d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/1585662805 >> v2:172.21.15.194:3300/0 conn(0x7f7b181551d0 0x7f7b1815edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 -- 172.21.15.123:0/1585662805 >> 172.21.15.123:0/1585662805 conn(0x7f7b180d0e10 msgr2=0x7f7b180d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 -- 172.21.15.123:0/1585662805 shutdown_connections 2024-09-19T09:53:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.587+0000 7f7b1c98d640 1 -- 172.21.15.123:0/1585662805 wait complete. 2024-09-19T09:53:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 Processor -- start 2024-09-19T09:53:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 -- start start 2024-09-19T09:53:40.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b181551d0 0x7f7b180c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 0x7f7b180c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b1815f300 0x7f7b18145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1815e8a0 con 0x7f7b181555b0 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1815be90 con 0x7f7b1815f300 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1c98d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7b180cd240 con 0x7f7b181551d0 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b15d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 0x7f7b180c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b15d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 0x7f7b180c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58460/0 (socket says 172.21.15.123:58460) 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b15d9b640 1 -- 172.21.15.123:0/281477586 learned_addr learned my addr 172.21.15.123:0/281477586 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.589+0000 7f7b1659c640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b181551d0 0x7f7b180c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b16d9d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b1815f300 0x7f7b18145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b15d9b640 1 -- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b181551d0 msgr2=0x7f7b180c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b15d9b640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b181551d0 0x7f7b180c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b15d9b640 1 -- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b1815f300 msgr2=0x7f7b18145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b15d9b640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b1815f300 0x7f7b18145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b15d9b640 1 -- 172.21.15.123:0/281477586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1815da70 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b16d9d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b1815f300 0x7f7b18145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b15d9b640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 0x7f7b180c6f30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c780 tx=0x7f7b0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c018070 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0072d0 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1815dd50 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0047e0 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.590+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1815e310 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.591+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1815b080 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.591+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7b0c01b070 con 0x7f7b181555b0 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.592+0000 7f7b06ffd640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7af806c2b0 0x7f7af806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.592+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7b0c08a710 con 0x7f7b181555b0 2024-09-19T09:53:40.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.592+0000 7f7b1659c640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7af806c2b0 0x7f7af806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.592+0000 7f7b1659c640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7af806c2b0 0x7f7af806e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b10003b80 tx=0x7f7b100098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.596+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7b1815e620 con 0x7f7b181555b0 2024-09-19T09:53:40.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.763+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7b180cb060 con 0x7f7af806c2b0 2024-09-19T09:53:40.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.763+0000 7f7b06ffd640 1 -- 172.21.15.123:0/281477586 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7b180cb060 con 0x7f7af806c2b0 2024-09-19T09:53:40.766 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T09:53:40.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7af806c2b0 msgr2=0x7f7af806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7af806c2b0 0x7f7af806e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b10003b80 tx=0x7f7b100098d0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 msgr2=0x7f7b180c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 0x7f7b180c6f30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c780 tx=0x7f7b0c00cc40 comp rx=0 tx=0).stop 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 shutdown_connections 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b1815f300 0x7f7b18145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b181555b0 0x7f7b180c6f30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7af806c2b0 0x7f7af806e770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 --2- 172.21.15.123:0/281477586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b181551d0 0x7f7b180c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 >> 172.21.15.123:0/281477586 conn(0x7f7b180d0e10 msgr2=0x7f7b180d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 shutdown_connections 2024-09-19T09:53:40.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.765+0000 7f7b1c98d640 1 -- 172.21.15.123:0/281477586 wait complete. 2024-09-19T09:53:40.779 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T09:53:40.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:40.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.880+0000 7fa82af0a640 1 Processor -- start 2024-09-19T09:53:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.880+0000 7fa82af0a640 1 -- start start 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa82af0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa824153030 0x7fa82415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa82af0a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa82415d150 0x7fa8240cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa82af0a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8240c41e0 con 0x7fa8240b4c50 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa82af0a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa8240c44c0 con 0x7fa824153030 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa82af0a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7fa8240c47a0 con 0x7fa82415d150 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa828ca6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa824153030 0x7fa82415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa81bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa8240b4c50 0x7fa8240c95b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59864/0 (socket says 172.21.15.123:59864) 2024-09-19T09:53:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa828ca6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa824153030 0x7fa82415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58472/0 (socket says 172.21.15.123:58472) 2024-09-19T09:53:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.881+0000 7fa81bfff640 1 -- 172.21.15.123:0/474153687 learned_addr learned my addr 172.21.15.123:0/474153687 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa828ca6640 1 -- 172.21.15.123:0/474153687 >> v2:172.21.15.194:3300/0 conn(0x7fa82415d150 msgr2=0x7fa8240cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa828ca6640 1 --2- 172.21.15.123:0/474153687 >> v2:172.21.15.194:3300/0 conn(0x7fa82415d150 0x7fa8240cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa828ca6640 1 -- 172.21.15.123:0/474153687 >> v1:172.21.15.123:6789/0 conn(0x7fa8240b4c50 legacy=0x7fa8240c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa828ca6640 1 -- 172.21.15.123:0/474153687 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8240c4a80 con 0x7fa824153030 2024-09-19T09:53:40.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa828ca6640 1 --2- 172.21.15.123:0/474153687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa824153030 0x7fa82415cc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa824076350 tx=0x7fa82002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b051c706d07edf13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa81b7fe640 1 -- 172.21.15.123:0/474153687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820037070 con 0x7fa824153030 2024-09-19T09:53:40.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa81b7fe640 1 -- 172.21.15.123:0/474153687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820032440 con 0x7fa824153030 2024-09-19T09:53:40.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.882+0000 7fa81b7fe640 1 -- 172.21.15.123:0/474153687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820032810 con 0x7fa824153030 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 -- 172.21.15.123:0/474153687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa824153030 msgr2=0x7fa82415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 --2- 172.21.15.123:0/474153687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa824153030 0x7fa82415cc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa824076350 tx=0x7fa82002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 -- 172.21.15.123:0/474153687 shutdown_connections 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 --2- 172.21.15.123:0/474153687 >> v2:172.21.15.194:3300/0 conn(0x7fa82415d150 0x7fa8240cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 --2- 172.21.15.123:0/474153687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa824153030 0x7fa82415cc10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 -- 172.21.15.123:0/474153687 >> 172.21.15.123:0/474153687 conn(0x7fa82406f530 msgr2=0x7fa82406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 -- 172.21.15.123:0/474153687 shutdown_connections 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.883+0000 7fa82af0a640 1 -- 172.21.15.123:0/474153687 wait complete. 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.884+0000 7fa82af0a640 1 Processor -- start 2024-09-19T09:53:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.884+0000 7fa82af0a640 1 -- start start 2024-09-19T09:53:40.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa82af0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8240b4c50 0x7fa82415bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa82af0a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa824153030 0x7fa82415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa82af0a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa82415d150 0x7fa8241e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa82af0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa8240c3ea0 con 0x7fa8240b4c50 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa82af0a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa8240c9cc0 con 0x7fa824153030 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa82af0a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fa824158e20 con 0x7fa82415d150 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8240b4c50 0x7fa82415bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8240b4c50 0x7fa82415bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58486/0 (socket says 172.21.15.123:58486) 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 -- 172.21.15.123:0/4166710588 learned_addr learned my addr 172.21.15.123:0/4166710588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa81bfff640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa824153030 0x7fa82415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa8294a7640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa82415d150 0x7fa8241e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 -- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa82415d150 msgr2=0x7fa8241e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa82415d150 0x7fa8241e3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 -- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa824153030 msgr2=0x7fa82415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa824153030 0x7fa82415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa828ca6640 1 -- 172.21.15.123:0/4166710588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8241ef7b0 con 0x7fa8240b4c50 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.885+0000 7fa81bfff640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa824153030 0x7fa82415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.886+0000 7fa828ca6640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8240b4c50 0x7fa82415bb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa820000c00 tx=0x7fa8200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.886+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820041070 con 0x7fa8240b4c50 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.886+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82003c890 con 0x7fa8240b4c50 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.886+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8241efa70 con 0x7fa8240b4c50 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.886+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820037040 con 0x7fa8240b4c50 2024-09-19T09:53:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.886+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82415a2c0 con 0x7fa8240b4c50 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.887+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa824153410 con 0x7fa8240b4c50 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.887+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa820044070 con 0x7fa8240b4c50 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8197fa640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81006c2b0 0x7fa81006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fa8200ac050 con 0x7fa8240b4c50 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa81bfff640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81006c2b0 0x7fa81006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8197fa640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7fa8100745d0 0x7fa810076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 --> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa82000af30 con 0x7fa8100745d0 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa8200b3050 con 0x7fa8240b4c50 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8294a7640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7fa8100745d0 0x7fa810076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa81bfff640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81006c2b0 0x7fa81006e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8241526b0 tx=0x7fa814009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.888+0000 7fa8294a7640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7fa8100745d0 0x7fa810076a50 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:40.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.889+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== osd.6 v2:172.21.15.194:6800/2256990025 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa82000af30 con 0x7fa8100745d0 2024-09-19T09:53:40.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.902+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 --> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa8240cbd00 con 0x7fa8100745d0 2024-09-19T09:53:40.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.902+0000 7fa8197fa640 1 -- 172.21.15.123:0/4166710588 <== osd.6 v2:172.21.15.194:6800/2256990025 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa8240cbd00 con 0x7fa8100745d0 2024-09-19T09:53:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:40.906 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:40.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7fa8100745d0 msgr2=0x7fa810076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.194:6800/2256990025,v1:172.21.15.194:6801/2256990025] conn(0x7fa8100745d0 0x7fa810076a50 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81006c2b0 msgr2=0x7fa81006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fa81006c2b0 0x7fa81006e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8241526b0 tx=0x7fa814009040 comp rx=0 tx=0).stop 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8240b4c50 msgr2=0x7fa82415bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 --2- 172.21.15.123:0/4166710588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8240b4c50 0x7fa82415bb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa820000c00 tx=0x7fa8200046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa8294a7640 1 -- 172.21.15.123:0/4166710588 reap_dead start 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 shutdown_connections 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 >> 172.21.15.123:0/4166710588 conn(0x7fa82406f530 msgr2=0x7fa824159420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 shutdown_connections 2024-09-19T09:53:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:40.903+0000 7fa82af0a640 1 -- 172.21.15.123:0/4166710588 wait complete. 2024-09-19T09:53:40.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T09:53:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.013+0000 7fc76db5f640 1 Processor -- start 2024-09-19T09:53:41.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.013+0000 7fc76db5f640 1 -- start start 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc76db5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc768155640 0x7fc76815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc76db5f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc7680c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc76db5f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7680c0cb0 con 0x7fc76815f290 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc76db5f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc76815ee00 con 0x7fc768155640 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc76db5f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc76815f690 con 0x7fc7680c78f0 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc7677fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc768155640 0x7fc76815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc75ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc76815f290 0x7fc768071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59870/0 (socket says 172.21.15.123:59870) 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc75ffff640 1 -- 172.21.15.123:0/529355517 learned_addr learned my addr 172.21.15.123:0/529355517 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc767fff640 1 --2- 172.21.15.123:0/529355517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc7680c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc7677fe640 1 -- 172.21.15.123:0/529355517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 msgr2=0x7fc7680c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc7677fe640 1 --2- 172.21.15.123:0/529355517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc7680c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc7677fe640 1 -- 172.21.15.123:0/529355517 >> v1:172.21.15.123:6789/0 conn(0x7fc76815f290 legacy=0x7fc768071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc7677fe640 1 -- 172.21.15.123:0/529355517 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7680c8130 con 0x7fc768155640 2024-09-19T09:53:41.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.014+0000 7fc766ffd640 1 -- 172.21.15.123:0/529355517 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603717640 0 0) 0x7fc7680c0cb0 con 0x7fc76815f290 2024-09-19T09:53:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.015+0000 7fc7677fe640 1 --2- 172.21.15.123:0/529355517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc768155640 0x7fc76815b1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7580097a0 tx=0x7fc75802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d0a61a1351b6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.015+0000 7fc766ffd640 1 -- 172.21.15.123:0/529355517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758037070 con 0x7fc768155640 2024-09-19T09:53:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.015+0000 7fc766ffd640 1 -- 172.21.15.123:0/529355517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc758032440 con 0x7fc768155640 2024-09-19T09:53:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.015+0000 7fc766ffd640 1 -- 172.21.15.123:0/529355517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758032810 con 0x7fc768155640 2024-09-19T09:53:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 -- 172.21.15.123:0/529355517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc768155640 msgr2=0x7fc76815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 --2- 172.21.15.123:0/529355517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc768155640 0x7fc76815b1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7580097a0 tx=0x7fc75802a180 comp rx=0 tx=0).stop 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 -- 172.21.15.123:0/529355517 shutdown_connections 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 --2- 172.21.15.123:0/529355517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc7680c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 --2- 172.21.15.123:0/529355517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc768155640 0x7fc76815b1c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 -- 172.21.15.123:0/529355517 >> 172.21.15.123:0/529355517 conn(0x7fc768073880 msgr2=0x7fc768073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 -- 172.21.15.123:0/529355517 shutdown_connections 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.016+0000 7fc76db5f640 1 -- 172.21.15.123:0/529355517 wait complete. 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.017+0000 7fc76db5f640 1 Processor -- start 2024-09-19T09:53:41.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.017+0000 7fc76db5f640 1 -- start start 2024-09-19T09:53:41.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc76815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768155640 0x7fc7681f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 0x7fc76814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc76815e7b0 con 0x7fc76815f290 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc7680c86f0 con 0x7fc768155640 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fc76815ea90 con 0x7fc7680c78f0 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 0x7fc76814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 0x7fc76814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58500/0 (socket says 172.21.15.123:58500) 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 -- 172.21.15.123:0/1528337104 learned_addr learned my addr 172.21.15.123:0/1528337104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc7677fe640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc76815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc75ffff640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768155640 0x7fc7681f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 -- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 msgr2=0x7fc76815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc76815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 -- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768155640 msgr2=0x7fc7681f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768155640 0x7fc7681f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 -- 172.21.15.123:0/1528337104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76815acc0 con 0x7fc76815f290 2024-09-19T09:53:41.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc7677fe640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc76815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc767fff640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 0x7fc76814b3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc76000ec40 tx=0x7fc76000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760018020 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76000ee50 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76815af60 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600146c0 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.018+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76814c8e0 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.019+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76814c410 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.020+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc760005d10 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.020+0000 7fc764ff9640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc74806c2b0 0x7fc74806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.020+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fc76008bdb0 con 0x7fc76815f290 2024-09-19T09:53:41.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.020+0000 7fc7677fe640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc74806c2b0 0x7fc74806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.021+0000 7fc7677fe640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc74806c2b0 0x7fc74806e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc758034000 tx=0x7fc75802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.025+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc760022070 con 0x7fc76815f290 2024-09-19T09:53:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.197+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc7680ca950 con 0x7fc74806c2b0 2024-09-19T09:53:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.197+0000 7fc764ff9640 1 -- 172.21.15.123:0/1528337104 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc7680ca950 con 0x7fc74806c2b0 2024-09-19T09:53:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc74806c2b0 msgr2=0x7fc74806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc74806c2b0 0x7fc74806e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc758034000 tx=0x7fc75802e000 comp rx=0 tx=0).stop 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 msgr2=0x7fc76814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 0x7fc76814b3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc76000ec40 tx=0x7fc76000c490 comp rx=0 tx=0).stop 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 shutdown_connections 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc76815f290 0x7fc76814b3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc768155640 0x7fc7681f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fc74806c2b0 0x7fc74806e770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 --2- 172.21.15.123:0/1528337104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7680c78f0 0x7fc76815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 >> 172.21.15.123:0/1528337104 conn(0x7fc768073880 msgr2=0x7fc76815d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 shutdown_connections 2024-09-19T09:53:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.199+0000 7fc76db5f640 1 -- 172.21.15.123:0/1528337104 wait complete. 2024-09-19T09:53:41.214 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T09:53:41.214 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:53:41.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.313+0000 7f6883c6e640 1 Processor -- start 2024-09-19T09:53:41.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.313+0000 7f6883c6e640 1 -- start start 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6883c6e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f687c1554a0 0x7f687c0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6883c6e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f687c0c48b0 0x7f687c0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6883c6e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c0caf40 0x7f687c15e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6883c6e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f687c0c9c90 con 0x7f687c1554a0 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6883c6e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f687c0c9f30 con 0x7f687c0c48b0 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6883c6e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f687c0ca1d0 con 0x7f687c0caf40 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f687c1554a0 0x7f687c0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f687c1554a0 0x7f687c0cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58516/0 (socket says 172.21.15.123:58516) 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 -- 172.21.15.123:0/3464014996 learned_addr learned my addr 172.21.15.123:0/3464014996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f688220b640 1 --2- 172.21.15.123:0/3464014996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c0caf40 0x7f687c15e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881209640 1 --2- 172.21.15.123:0/3464014996 >> v2:172.21.15.194:3300/0 conn(0x7f687c0c48b0 0x7f687c0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 -- 172.21.15.123:0/3464014996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c0caf40 msgr2=0x7f687c15e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 --2- 172.21.15.123:0/3464014996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c0caf40 0x7f687c15e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 -- 172.21.15.123:0/3464014996 >> v2:172.21.15.194:3300/0 conn(0x7f687c0c48b0 msgr2=0x7f687c0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 --2- 172.21.15.123:0/3464014996 >> v2:172.21.15.194:3300/0 conn(0x7f687c0c48b0 0x7f687c0cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881a0a640 1 -- 172.21.15.123:0/3464014996 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687c0709d0 con 0x7f687c1554a0 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.314+0000 7f6881209640 1 --2- 172.21.15.123:0/3464014996 >> v2:172.21.15.194:3300/0 conn(0x7f687c0c48b0 0x7f687c0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6881a0a640 1 --2- 172.21.15.123:0/3464014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c1554a0 0x7f687c0cb640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f687c0c6630 tx=0x7f687802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2a898df4b12231 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6880a08640 1 -- 172.21.15.123:0/3464014996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878037070 con 0x7f687c1554a0 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6880a08640 1 -- 172.21.15.123:0/3464014996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878032440 con 0x7f687c1554a0 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6880a08640 1 -- 172.21.15.123:0/3464014996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878032810 con 0x7f687c1554a0 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 -- 172.21.15.123:0/3464014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c1554a0 msgr2=0x7f687c0cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3464014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c1554a0 0x7f687c0cb640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f687c0c6630 tx=0x7f687802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 -- 172.21.15.123:0/3464014996 shutdown_connections 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3464014996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c0caf40 0x7f687c15e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3464014996 >> v2:172.21.15.194:3300/0 conn(0x7f687c0c48b0 0x7f687c0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3464014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c1554a0 0x7f687c0cb640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.315+0000 7f6883c6e640 1 -- 172.21.15.123:0/3464014996 >> 172.21.15.123:0/3464014996 conn(0x7f687c06f530 msgr2=0x7f687c06f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.316+0000 7f6883c6e640 1 -- 172.21.15.123:0/3464014996 shutdown_connections 2024-09-19T09:53:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.316+0000 7f6883c6e640 1 -- 172.21.15.123:0/3464014996 wait complete. 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 Processor -- start 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 -- start start 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687c0c48b0 0x7f687c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c0caf40 0x7f687c14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c1554a0 0x7f687c150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f687c071270 con 0x7f687c0caf40 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f687c070f90 con 0x7f687c0c48b0 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.317+0000 7f6883c6e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f687c071550 con 0x7f687c1554a0 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c0caf40 0x7f687c14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c0caf40 0x7f687c14f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58528/0 (socket says 172.21.15.123:58528) 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 -- 172.21.15.123:0/3880345991 learned_addr learned my addr 172.21.15.123:0/3880345991 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881a0a640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687c0c48b0 0x7f687c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f688220b640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c1554a0 0x7f687c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 -- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c1554a0 msgr2=0x7f687c150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c1554a0 0x7f687c150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 -- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687c0c48b0 msgr2=0x7f687c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687c0c48b0 0x7f687c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 -- 172.21.15.123:0/3880345991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687c1530f0 con 0x7f687c0caf40 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f688220b640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f687c1554a0 0x7f687c150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6881209640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c0caf40 0x7f687c14f790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f686c00c7f0 tx=0x7f686c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c015070 con 0x7f687c0caf40 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686c007820 con 0x7f687c0caf40 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c007bd0 con 0x7f687c0caf40 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687c1533d0 con 0x7f687c0caf40 2024-09-19T09:53:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.318+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687c153990 con 0x7f687c0caf40 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.319+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f687c0c95b0 con 0x7f687c0caf40 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.319+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f686c018070 con 0x7f687c0caf40 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f68727fc640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f686006c2b0 0x7f686006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f686c08b490 con 0x7f687c0caf40 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f6881a0a640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f686006c2b0 0x7f686006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f68727fc640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7f6860074630 0x7f6860076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 --> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f686c01de50 con 0x7f6860074630 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f686c092050 con 0x7f687c0caf40 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f6881a0a640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f686006c2b0 0x7f686006e770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6878034000 tx=0x7f687802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.320+0000 7f688220b640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7f6860074630 0x7f6860076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.321+0000 7f688220b640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7f6860074630 0x7f6860076ab0 crc :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.321+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== osd.7 v2:172.21.15.194:6816/125762816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f686c01de50 con 0x7f6860074630 2024-09-19T09:53:41.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.336+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 --> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f687c0ca4c0 con 0x7f6860074630 2024-09-19T09:53:41.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f68727fc640 1 -- 172.21.15.123:0/3880345991 <== osd.7 v2:172.21.15.194:6816/125762816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f687c0ca4c0 con 0x7f6860074630 2024-09-19T09:53:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-19T09:53:41.340 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T09:53:41.340 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-19T09:53:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7f6860074630 msgr2=0x7f6860076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.194:6816/125762816,v1:172.21.15.194:6817/125762816] conn(0x7f6860074630 0x7f6860076ab0 crc :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f686006c2b0 msgr2=0x7f686006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f686006c2b0 0x7f686006e770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6878034000 tx=0x7f687802e000 comp rx=0 tx=0).stop 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c0caf40 msgr2=0x7f687c14f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 --2- 172.21.15.123:0/3880345991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687c0caf40 0x7f687c14f790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f686c00c7f0 tx=0x7f686c00ccb0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f688220b640 1 -- 172.21.15.123:0/3880345991 reap_dead start 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 shutdown_connections 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 >> 172.21.15.123:0/3880345991 conn(0x7f687c06f530 msgr2=0x7f687c0c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 shutdown_connections 2024-09-19T09:53:41.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.337+0000 7f6883c6e640 1 -- 172.21.15.123:0/3880345991 wait complete. 2024-09-19T09:53:41.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T09:53:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.447+0000 7eff7b3d6640 1 Processor -- start 2024-09-19T09:53:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.447+0000 7eff7b3d6640 1 -- start start 2024-09-19T09:53:41.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff7b3d6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 0x7eff740ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff7b3d6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7eff7415b080 0x7eff740cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff7b3d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7415e620 con 0x7eff741551d0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff7b3d6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7eff740c5c50 con 0x7eff7415b080 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff7b3d6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7eff7415b5f0 con 0x7eff741555b0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff79172640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7eff741551d0 0x7eff7415edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59874/0 (socket says 172.21.15.123:59874) 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff79172640 1 -- 172.21.15.123:0/2667726109 learned_addr learned my addr 172.21.15.123:0/2667726109 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 0x7eff740ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff79973640 1 --2- 172.21.15.123:0/2667726109 >> v2:172.21.15.194:3300/0 conn(0x7eff7415b080 0x7eff740cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860733668 0 0) 0x7eff70001110 con 0x7eff741551d0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff60003520 con 0x7eff741551d0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 974383628 0 0) 0x7eff60003520 con 0x7eff741551d0 2024-09-19T09:53:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 msgr2=0x7eff740ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 0x7eff740ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 >> v2:172.21.15.194:3300/0 conn(0x7eff7415b080 msgr2=0x7eff740cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 --2- 172.21.15.123:0/2667726109 >> v2:172.21.15.194:3300/0 conn(0x7eff7415b080 0x7eff740cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7415b8d0 con 0x7eff741551d0 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7eff70001840 con 0x7eff741551d0 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 >> v1:172.21.15.123:6789/0 conn(0x7eff741551d0 legacy=0x7eff7415edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 0x7eff600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff60003f30 0x7eff60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60004d40 0x7eff600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff7415b5f0 con 0x7eff60003f30 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7eff6000b9c0 con 0x7eff60004d40 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7eff6000bb70 con 0x7eff741555b0 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff60003f30 0x7eff60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff79172640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 0x7eff600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff79973640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60004d40 0x7eff600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 -- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 msgr2=0x7eff600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff741555b0 0x7eff600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 -- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60004d40 msgr2=0x7eff600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60004d40 0x7eff600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.449+0000 7eff78971640 1 -- 172.21.15.123:0/2667726109 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff60003520 con 0x7eff60003f30 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff78971640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff60003f30 0x7eff60004800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff64009ac0 tx=0x7eff60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72469071a45192c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64036070 con 0x7eff60003f30 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff64031400 con 0x7eff60003f30 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff6bfff640 1 -- 172.21.15.123:0/2667726109 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64009690 con 0x7eff60003f30 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff7b3d6640 1 -- 172.21.15.123:0/2667726109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff60003f30 msgr2=0x7eff60004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/2667726109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff60003f30 0x7eff60004800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff64009ac0 tx=0x7eff60005830 comp rx=0 tx=0).stop 2024-09-19T09:53:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff79973640 1 -- 172.21.15.123:0/2667726109 reap_dead start 2024-09-19T09:53:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff7b3d6640 1 -- 172.21.15.123:0/2667726109 shutdown_connections 2024-09-19T09:53:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff7b3d6640 1 -- 172.21.15.123:0/2667726109 >> 172.21.15.123:0/2667726109 conn(0x7eff740d0e10 msgr2=0x7eff740d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff7b3d6640 1 -- 172.21.15.123:0/2667726109 shutdown_connections 2024-09-19T09:53:41.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.450+0000 7eff7b3d6640 1 -- 172.21.15.123:0/2667726109 wait complete. 2024-09-19T09:53:41.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.451+0000 7eff7b3d6640 1 Processor -- start 2024-09-19T09:53:41.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 -- start start 2024-09-19T09:53:41.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60003f30 0x7eff7414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff740b6ba0 0x7eff7415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 0x7eff741f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff7415e8a0 con 0x7eff7415dc30 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7eff7415be90 con 0x7eff60003f30 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff7b3d6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7eff7415f4d0 con 0x7eff740b6ba0 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff79973640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 0x7eff741f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff79973640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 0x7eff741f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58560/0 (socket says 172.21.15.123:58560) 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff79973640 1 -- 172.21.15.123:0/1733854230 learned_addr learned my addr 172.21.15.123:0/1733854230 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff78971640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff740b6ba0 0x7eff7415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.452+0000 7eff79172640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60003f30 0x7eff7414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff79973640 1 -- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff740b6ba0 msgr2=0x7eff7415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff79973640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff740b6ba0 0x7eff7415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff79973640 1 -- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60003f30 msgr2=0x7eff7414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff79973640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60003f30 0x7eff7414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff79973640 1 -- 172.21.15.123:0/1733854230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7415e0c0 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff79973640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 0x7eff741f4160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff7408e790 tx=0x7eff6c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00fde0 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c01d070 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff740b4ff0 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c015670 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.453+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff740b55b0 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.454+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7415edc0 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.454+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7eff6c015810 con 0x7eff7415dc30 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.455+0000 7eff69ffb640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7eff5806c2e0 0x7eff5806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.455+0000 7eff79172640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7eff5806c2e0 0x7eff5806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.455+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7eff6c08beb0 con 0x7eff7415dc30 2024-09-19T09:53:41.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.455+0000 7eff79172640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7eff5806c2e0 0x7eff5806e7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff70001050 tx=0x7eff70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.459+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7eff6c010040 con 0x7eff7415dc30 2024-09-19T09:53:41.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.628+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7eff740cb310 con 0x7eff5806c2e0 2024-09-19T09:53:41.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.628+0000 7eff69ffb640 1 -- 172.21.15.123:0/1733854230 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7eff740cb310 con 0x7eff5806c2e0 2024-09-19T09:53:41.632 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T09:53:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7eff5806c2e0 msgr2=0x7eff5806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7eff5806c2e0 0x7eff5806e7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff70001050 tx=0x7eff70009040 comp rx=0 tx=0).stop 2024-09-19T09:53:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 msgr2=0x7eff741f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 0x7eff741f4160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff7408e790 tx=0x7eff6c00f580 comp rx=0 tx=0).stop 2024-09-19T09:53:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 shutdown_connections 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7415dc30 0x7eff741f4160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7eff5806c2e0 0x7eff5806e7a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff740b6ba0 0x7eff7415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 --2- 172.21.15.123:0/1733854230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff60003f30 0x7eff7414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 >> 172.21.15.123:0/1733854230 conn(0x7eff740d0e10 msgr2=0x7eff740ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 shutdown_connections 2024-09-19T09:53:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.631+0000 7eff7b3d6640 1 -- 172.21.15.123:0/1733854230 wait complete. 2024-09-19T09:53:41.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:53:41.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.741+0000 7f818e81e640 1 Processor -- start 2024-09-19T09:53:41.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.741+0000 7f818e81e640 1 -- start start 2024-09-19T09:53:41.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.741+0000 7f818e81e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8188155650 0x7f81880cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.741+0000 7f818e81e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 0x7f81880ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.741+0000 7f818e81e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818815c240 con 0x7f81880c7f40 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818e81e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f8188155a30 con 0x7f8188155650 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818e81e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f818815b3e0 con 0x7f81880cbf00 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 0x7f81880ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f8187fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8188155650 0x7f81880cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 0x7f81880ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.123:36994/0 (socket says 172.21.15.123:36994) 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 -- 172.21.15.123:0/621517877 learned_addr learned my addr 172.21.15.123:0/621517877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 -- 172.21.15.123:0/621517877 >> v2:172.21.15.194:3300/0 conn(0x7f8188155650 msgr2=0x7f81880cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 --2- 172.21.15.123:0/621517877 >> v2:172.21.15.194:3300/0 conn(0x7f8188155650 0x7f81880cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 -- 172.21.15.123:0/621517877 >> v1:172.21.15.194:6789/0 conn(0x7f81880c7f40 legacy=0x7f81880cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f818cdbb640 1 -- 172.21.15.123:0/621517877 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818815b6c0 con 0x7f81880cbf00 2024-09-19T09:53:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.742+0000 7f8187fff640 1 --2- 172.21.15.123:0/621517877 >> v2:172.21.15.194:3300/0 conn(0x7f8188155650 0x7f81880cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.743+0000 7f818cdbb640 1 --2- 172.21.15.123:0/621517877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 0x7f81880ccd90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f818002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d459c938d3efbfc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.743+0000 7f8186ffd640 1 -- 172.21.15.123:0/621517877 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180036070 con 0x7f81880cbf00 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.743+0000 7f8186ffd640 1 -- 172.21.15.123:0/621517877 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180031600 con 0x7f81880cbf00 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.743+0000 7f8186ffd640 1 -- 172.21.15.123:0/621517877 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800319d0 con 0x7f81880cbf00 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 -- 172.21.15.123:0/621517877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 msgr2=0x7f81880ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 --2- 172.21.15.123:0/621517877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 0x7f81880ccd90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f818002a710 comp rx=0 tx=0).stop 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 -- 172.21.15.123:0/621517877 shutdown_connections 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 --2- 172.21.15.123:0/621517877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880cbf00 0x7f81880ccd90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 --2- 172.21.15.123:0/621517877 >> v2:172.21.15.194:3300/0 conn(0x7f8188155650 0x7f81880cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 -- 172.21.15.123:0/621517877 >> 172.21.15.123:0/621517877 conn(0x7f81880cd5c0 msgr2=0x7f81880cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 -- 172.21.15.123:0/621517877 shutdown_connections 2024-09-19T09:53:41.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.744+0000 7f818e81e640 1 -- 172.21.15.123:0/621517877 wait complete. 2024-09-19T09:53:41.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.745+0000 7f818e81e640 1 Processor -- start 2024-09-19T09:53:41.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.745+0000 7f818e81e640 1 -- start start 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880c7f40 0x7f81881e4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81880cbf00 0x7f8188154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 0x7f81881e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f818815bf60 con 0x7f8188155650 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f818815bc80 con 0x7f81880cbf00 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f81880ce430 con 0x7f81880c7f40 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 0x7f81881e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f8187fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880c7f40 0x7f81881e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 0x7f81881e5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58568/0 (socket says 172.21.15.123:58568) 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 -- 172.21.15.123:0/4176754141 learned_addr learned my addr 172.21.15.123:0/4176754141 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f81877fe640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81880cbf00 0x7f8188154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 -- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880c7f40 msgr2=0x7f81881e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880c7f40 0x7f81881e4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 -- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81880cbf00 msgr2=0x7f8188154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81880cbf00 0x7f8188154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 -- 172.21.15.123:0/4176754141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81881f50c0 con 0x7f8188155650 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f8187fff640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880c7f40 0x7f81881e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818cdbb640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 0x7f81881e5df0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f8180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180036050 con 0x7f8188155650 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180042070 con 0x7f8188155650 2024-09-19T09:53:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.746+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81881e5630 con 0x7f8188155650 2024-09-19T09:53:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.747+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180009510 con 0x7f8188155650 2024-09-19T09:53:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.747+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81880c42a0 con 0x7f8188155650 2024-09-19T09:53:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.747+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81880d0460 con 0x7f8188155650 2024-09-19T09:53:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.748+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8180007bf0 con 0x7f8188155650 2024-09-19T09:53:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.748+0000 7f8184ff9640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f817406c2e0 0x7f817406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.749+0000 7f8187fff640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f817406c2e0 0x7f817406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.749+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f81800ac260 con 0x7f8188155650 2024-09-19T09:53:41.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.749+0000 7f8187fff640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f817406c2e0 0x7f817406e7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8178009560 tx=0x7f8178009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.753+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f81881f50c0 con 0x7f8188155650 2024-09-19T09:53:41.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.923+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f818806c680 con 0x7f817406c2e0 2024-09-19T09:53:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.928+0000 7f8184ff9640 1 -- 172.21.15.123:0/4176754141 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253638 (secure 0 0 0) 0x7f818806c680 con 0x7f817406c2e0 2024-09-19T09:53:41.935 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:53:41.936 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:53:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f817406c2e0 msgr2=0x7f817406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f817406c2e0 0x7f817406e7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8178009560 tx=0x7f8178009190 comp rx=0 tx=0).stop 2024-09-19T09:53:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 msgr2=0x7f81881e5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 0x7f81881e5df0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f8180004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 shutdown_connections 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8188155650 0x7f81881e5df0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81880cbf00 0x7f8188154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f817406c2e0 0x7f817406e7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 --2- 172.21.15.123:0/4176754141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81880c7f40 0x7f81881e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 >> 172.21.15.123:0/4176754141 conn(0x7f81880cd5c0 msgr2=0x7f81880c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 shutdown_connections 2024-09-19T09:53:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:53:41.932+0000 7f818e81e640 1 -- 172.21.15.123:0/4176754141 wait complete. 2024-09-19T09:53:41.946 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-09-19T09:53:40.895321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210088440,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":140,"num_read_kb":201,"num_write":6764600,"num_write_kb":83163786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447627,"ondisk_log_size":447627,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4660864,"kb_used_data":412416,"kb_used_omap":12,"kb_used_meta":4248307,"kb_avail":750313856,"statfs":{"total":773094113280,"available":768321388544,"internally_reserved":0,"allocated":422313984,"data_stored":420924292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":4350266929},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":173,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002795"},"pg_stats":[{"pgid":"3.3f","version":"25'5963","reported_seq":5984,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.801951+0000","last_change":"2024-09-19T09:42:37.525877+0000","last_active":"2024-09-19T09:53:35.801951+0000","last_peered":"2024-09-19T09:53:35.801951+0000","last_clean":"2024-09-19T09:53:35.801951+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:53:35.801951+0000","last_undegraded":"2024-09-19T09:53:35.801951+0000","last_fullsized":"2024-09-19T09:53:35.801951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5963,"log_dups_size":0,"ondisk_log_size":5963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:50.642319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90667,"num_write_kb":1126123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'8758","reported_seq":8779,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.700729+0000","last_change":"2024-09-19T09:42:37.518874+0000","last_active":"2024-09-19T09:53:35.700729+0000","last_peered":"2024-09-19T09:53:35.700729+0000","last_clean":"2024-09-19T09:53:35.700729+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:53:35.700729+0000","last_undegraded":"2024-09-19T09:53:35.700729+0000","last_fullsized":"2024-09-19T09:53:35.700729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8758,"log_dups_size":0,"ondisk_log_size":8758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:39.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133411,"num_write_kb":1655568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7063","reported_seq":7085,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.763267+0000","last_change":"2024-09-19T09:42:37.519523+0000","last_active":"2024-09-19T09:53:35.763267+0000","last_peered":"2024-09-19T09:53:35.763267+0000","last_clean":"2024-09-19T09:53:35.763267+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:53:35.763267+0000","last_undegraded":"2024-09-19T09:53:35.763267+0000","last_fullsized":"2024-09-19T09:53:35.763267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107453,"num_write_kb":1318687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'6131","reported_seq":6152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.777403+0000","last_change":"2024-09-19T09:42:37.523231+0000","last_active":"2024-09-19T09:53:35.777403+0000","last_peered":"2024-09-19T09:53:35.777403+0000","last_clean":"2024-09-19T09:53:35.777403+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:53:35.777403+0000","last_undegraded":"2024-09-19T09:53:35.777403+0000","last_fullsized":"2024-09-19T09:53:35.777403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6131,"log_dups_size":0,"ondisk_log_size":6131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:31.433892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93226,"num_write_kb":1192949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'8356","reported_seq":8376,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.740189+0000","last_change":"2024-09-19T09:42:37.526893+0000","last_active":"2024-09-19T09:53:35.740189+0000","last_peered":"2024-09-19T09:53:35.740189+0000","last_clean":"2024-09-19T09:53:35.740189+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:53:35.740189+0000","last_undegraded":"2024-09-19T09:53:35.740189+0000","last_fullsized":"2024-09-19T09:53:35.740189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8356,"log_dups_size":0,"ondisk_log_size":8356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.741287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127203,"num_write_kb":1494052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6133","reported_seq":6153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.864895+0000","last_change":"2024-09-19T09:42:37.518927+0000","last_active":"2024-09-19T09:53:35.864895+0000","last_peered":"2024-09-19T09:53:35.864895+0000","last_clean":"2024-09-19T09:53:35.864895+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:53:35.864895+0000","last_undegraded":"2024-09-19T09:53:35.864895+0000","last_fullsized":"2024-09-19T09:53:35.864895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6133,"log_dups_size":0,"ondisk_log_size":6133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:59.923192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93163,"num_write_kb":1116253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'6607","reported_seq":6627,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.685302+0000","last_change":"2024-09-19T09:42:37.524795+0000","last_active":"2024-09-19T09:53:35.685302+0000","last_peered":"2024-09-19T09:53:35.685302+0000","last_clean":"2024-09-19T09:53:35.685302+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:53:35.685302+0000","last_undegraded":"2024-09-19T09:53:35.685302+0000","last_fullsized":"2024-09-19T09:53:35.685302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6607,"log_dups_size":0,"ondisk_log_size":6607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.116924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100493,"num_write_kb":1261887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'7473","reported_seq":7493,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.814156+0000","last_change":"2024-09-19T09:42:37.514682+0000","last_active":"2024-09-19T09:53:35.814156+0000","last_peered":"2024-09-19T09:53:35.814156+0000","last_clean":"2024-09-19T09:53:35.814156+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:53:35.814156+0000","last_undegraded":"2024-09-19T09:53:35.814156+0000","last_fullsized":"2024-09-19T09:53:35.814156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7473,"log_dups_size":0,"ondisk_log_size":7473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:07.271369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113853,"num_write_kb":1361930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'8252","reported_seq":8272,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.861374+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:53:35.861374+0000","last_peered":"2024-09-19T09:53:35.861374+0000","last_clean":"2024-09-19T09:53:35.861374+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:53:35.861374+0000","last_undegraded":"2024-09-19T09:53:35.861374+0000","last_fullsized":"2024-09-19T09:53:35.861374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8252,"log_dups_size":0,"ondisk_log_size":8252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:49.841988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125203,"num_write_kb":1603079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'7735","reported_seq":7755,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.842869+0000","last_change":"2024-09-19T09:42:37.517125+0000","last_active":"2024-09-19T09:53:35.842869+0000","last_peered":"2024-09-19T09:53:35.842869+0000","last_clean":"2024-09-19T09:53:35.842869+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:53:35.842869+0000","last_undegraded":"2024-09-19T09:53:35.842869+0000","last_fullsized":"2024-09-19T09:53:35.842869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7735,"log_dups_size":0,"ondisk_log_size":7735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:33.465161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117401,"num_write_kb":1489402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'6682","reported_seq":6702,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.775396+0000","last_change":"2024-09-19T09:42:37.522126+0000","last_active":"2024-09-19T09:53:35.775396+0000","last_peered":"2024-09-19T09:53:35.775396+0000","last_clean":"2024-09-19T09:53:35.775396+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:53:35.775396+0000","last_undegraded":"2024-09-19T09:53:35.775396+0000","last_fullsized":"2024-09-19T09:53:35.775396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6682,"log_dups_size":0,"ondisk_log_size":6682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:48.774653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101709,"num_write_kb":1228477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'5923","reported_seq":5943,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.866692+0000","last_change":"2024-09-19T09:42:37.514293+0000","last_active":"2024-09-19T09:53:35.866692+0000","last_peered":"2024-09-19T09:53:35.866692+0000","last_clean":"2024-09-19T09:53:35.866692+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:53:35.866692+0000","last_undegraded":"2024-09-19T09:53:35.866692+0000","last_fullsized":"2024-09-19T09:53:35.866692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5923,"log_dups_size":0,"ondisk_log_size":5923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:51.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90039,"num_write_kb":1066111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'6238","reported_seq":6258,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.783965+0000","last_change":"2024-09-19T09:42:37.512570+0000","last_active":"2024-09-19T09:53:35.783965+0000","last_peered":"2024-09-19T09:53:35.783965+0000","last_clean":"2024-09-19T09:53:35.783965+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:53:35.783965+0000","last_undegraded":"2024-09-19T09:53:35.783965+0000","last_fullsized":"2024-09-19T09:53:35.783965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6238,"log_dups_size":0,"ondisk_log_size":6238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:00.269521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94800,"num_write_kb":1191870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'7101","reported_seq":7122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.787667+0000","last_change":"2024-09-19T09:42:37.514230+0000","last_active":"2024-09-19T09:53:35.787667+0000","last_peered":"2024-09-19T09:53:35.787667+0000","last_clean":"2024-09-19T09:53:35.787667+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:53:35.787667+0000","last_undegraded":"2024-09-19T09:53:35.787667+0000","last_fullsized":"2024-09-19T09:53:35.787667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7101,"log_dups_size":0,"ondisk_log_size":7101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107699,"num_write_kb":1339564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'7242","reported_seq":7262,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.724122+0000","last_change":"2024-09-19T09:42:37.515565+0000","last_active":"2024-09-19T09:53:35.724122+0000","last_peered":"2024-09-19T09:53:35.724122+0000","last_clean":"2024-09-19T09:53:35.724122+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:53:35.724122+0000","last_undegraded":"2024-09-19T09:53:35.724122+0000","last_fullsized":"2024-09-19T09:53:35.724122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7242,"log_dups_size":0,"ondisk_log_size":7242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:15.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109960,"num_write_kb":1298661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'6074","reported_seq":6094,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.833665+0000","last_change":"2024-09-19T09:42:37.519375+0000","last_active":"2024-09-19T09:53:35.833665+0000","last_peered":"2024-09-19T09:53:35.833665+0000","last_clean":"2024-09-19T09:53:35.833665+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:53:35.833665+0000","last_undegraded":"2024-09-19T09:53:35.833665+0000","last_fullsized":"2024-09-19T09:53:35.833665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6074,"log_dups_size":0,"ondisk_log_size":6074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:27.553854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92239,"num_write_kb":1166043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8317","reported_seq":8337,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.873342+0000","last_change":"2024-09-19T09:42:37.521964+0000","last_active":"2024-09-19T09:53:35.873342+0000","last_peered":"2024-09-19T09:53:35.873342+0000","last_clean":"2024-09-19T09:53:35.873342+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:53:35.873342+0000","last_undegraded":"2024-09-19T09:53:35.873342+0000","last_fullsized":"2024-09-19T09:53:35.873342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8317,"log_dups_size":0,"ondisk_log_size":8317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:35.603419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126488,"num_write_kb":1557261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'5649","reported_seq":5669,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.717066+0000","last_change":"2024-09-19T09:42:37.512104+0000","last_active":"2024-09-19T09:53:35.717066+0000","last_peered":"2024-09-19T09:53:35.717066+0000","last_clean":"2024-09-19T09:53:35.717066+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:53:35.717066+0000","last_undegraded":"2024-09-19T09:53:35.717066+0000","last_fullsized":"2024-09-19T09:53:35.717066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5649,"log_dups_size":0,"ondisk_log_size":5649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:42.037101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85570,"num_write_kb":1023683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'6873","reported_seq":6893,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.745788+0000","last_change":"2024-09-19T09:42:37.527034+0000","last_active":"2024-09-19T09:53:35.745788+0000","last_peered":"2024-09-19T09:53:35.745788+0000","last_clean":"2024-09-19T09:53:35.745788+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:53:35.745788+0000","last_undegraded":"2024-09-19T09:53:35.745788+0000","last_fullsized":"2024-09-19T09:53:35.745788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:51.701928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104491,"num_write_kb":1253325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'6781","reported_seq":6801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.781199+0000","last_change":"2024-09-19T09:42:37.513480+0000","last_active":"2024-09-19T09:53:35.781199+0000","last_peered":"2024-09-19T09:53:35.781199+0000","last_clean":"2024-09-19T09:53:35.781199+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:53:35.781199+0000","last_undegraded":"2024-09-19T09:53:35.781199+0000","last_fullsized":"2024-09-19T09:53:35.781199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:34.198868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103096,"num_write_kb":1273163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'7069","reported_seq":7090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.834359+0000","last_change":"2024-09-19T09:42:37.522000+0000","last_active":"2024-09-19T09:53:35.834359+0000","last_peered":"2024-09-19T09:53:35.834359+0000","last_clean":"2024-09-19T09:53:35.834359+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:53:35.834359+0000","last_undegraded":"2024-09-19T09:53:35.834359+0000","last_fullsized":"2024-09-19T09:53:35.834359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7069,"log_dups_size":0,"ondisk_log_size":7069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107113,"num_write_kb":1305966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'7493","reported_seq":7513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.871658+0000","last_change":"2024-09-19T09:42:37.524133+0000","last_active":"2024-09-19T09:53:35.871658+0000","last_peered":"2024-09-19T09:53:35.871658+0000","last_clean":"2024-09-19T09:53:35.871658+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:53:35.871658+0000","last_undegraded":"2024-09-19T09:53:35.871658+0000","last_fullsized":"2024-09-19T09:53:35.871658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7493,"log_dups_size":0,"ondisk_log_size":7493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:34.633826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113925,"num_write_kb":1408486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'6884","reported_seq":6904,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.801271+0000","last_change":"2024-09-19T09:42:37.513953+0000","last_active":"2024-09-19T09:53:35.801271+0000","last_peered":"2024-09-19T09:53:35.801271+0000","last_clean":"2024-09-19T09:53:35.801271+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:53:35.801271+0000","last_undegraded":"2024-09-19T09:53:35.801271+0000","last_fullsized":"2024-09-19T09:53:35.801271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6884,"log_dups_size":0,"ondisk_log_size":6884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:03.271752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104459,"num_write_kb":1263249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'6119","reported_seq":6140,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.833744+0000","last_change":"2024-09-19T09:42:37.516151+0000","last_active":"2024-09-19T09:53:35.833744+0000","last_peered":"2024-09-19T09:53:35.833744+0000","last_clean":"2024-09-19T09:53:35.833744+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:53:35.833744+0000","last_undegraded":"2024-09-19T09:53:35.833744+0000","last_fullsized":"2024-09-19T09:53:35.833744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6119,"log_dups_size":0,"ondisk_log_size":6119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:21.693314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93016,"num_write_kb":1127551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'8002","reported_seq":8023,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.677107+0000","last_change":"2024-09-19T09:42:37.511491+0000","last_active":"2024-09-19T09:53:35.677107+0000","last_peered":"2024-09-19T09:53:35.677107+0000","last_clean":"2024-09-19T09:53:35.677107+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:53:35.677107+0000","last_undegraded":"2024-09-19T09:53:35.677107+0000","last_fullsized":"2024-09-19T09:53:35.677107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8002,"log_dups_size":0,"ondisk_log_size":8002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:38.223858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121789,"num_write_kb":1510406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'6222","reported_seq":6243,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.812362+0000","last_change":"2024-09-19T09:42:37.520883+0000","last_active":"2024-09-19T09:53:35.812362+0000","last_peered":"2024-09-19T09:53:35.812362+0000","last_clean":"2024-09-19T09:53:35.812362+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:53:35.812362+0000","last_undegraded":"2024-09-19T09:53:35.812362+0000","last_fullsized":"2024-09-19T09:53:35.812362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.548108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94313,"num_write_kb":1157877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'7393","reported_seq":7414,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.771996+0000","last_change":"2024-09-19T09:42:37.510489+0000","last_active":"2024-09-19T09:53:35.771996+0000","last_peered":"2024-09-19T09:53:35.771996+0000","last_clean":"2024-09-19T09:53:35.771996+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:53:35.771996+0000","last_undegraded":"2024-09-19T09:53:35.771996+0000","last_fullsized":"2024-09-19T09:53:35.771996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7393,"log_dups_size":0,"ondisk_log_size":7393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:41.244844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112469,"num_write_kb":1393395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'6316","reported_seq":6337,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.811294+0000","last_change":"2024-09-19T09:42:37.513866+0000","last_active":"2024-09-19T09:53:35.811294+0000","last_peered":"2024-09-19T09:53:35.811294+0000","last_clean":"2024-09-19T09:53:35.811294+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:53:35.811294+0000","last_undegraded":"2024-09-19T09:53:35.811294+0000","last_fullsized":"2024-09-19T09:53:35.811294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6316,"log_dups_size":0,"ondisk_log_size":6316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:13.130239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96072,"num_write_kb":1169122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'5905","reported_seq":5927,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.823089+0000","last_change":"2024-09-19T09:42:37.515818+0000","last_active":"2024-09-19T09:53:35.823089+0000","last_peered":"2024-09-19T09:53:35.823089+0000","last_clean":"2024-09-19T09:53:35.823089+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:53:35.823089+0000","last_undegraded":"2024-09-19T09:53:35.823089+0000","last_fullsized":"2024-09-19T09:53:35.823089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5905,"log_dups_size":0,"ondisk_log_size":5905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89887,"num_write_kb":1118423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'8492","reported_seq":8513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.847970+0000","last_change":"2024-09-19T09:42:37.517932+0000","last_active":"2024-09-19T09:53:35.847970+0000","last_peered":"2024-09-19T09:53:35.847970+0000","last_clean":"2024-09-19T09:53:35.847970+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:53:35.847970+0000","last_undegraded":"2024-09-19T09:53:35.847970+0000","last_fullsized":"2024-09-19T09:53:35.847970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8492,"log_dups_size":0,"ondisk_log_size":8492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.666541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129293,"num_write_kb":1558943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'7307","reported_seq":7328,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.769467+0000","last_change":"2024-09-19T09:42:37.513591+0000","last_active":"2024-09-19T09:53:35.769467+0000","last_peered":"2024-09-19T09:53:35.769467+0000","last_clean":"2024-09-19T09:53:35.769467+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:53:35.769467+0000","last_undegraded":"2024-09-19T09:53:35.769467+0000","last_fullsized":"2024-09-19T09:53:35.769467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7307,"log_dups_size":0,"ondisk_log_size":7307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:06.758796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111025,"num_write_kb":1382740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'8646","reported_seq":8667,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.781548+0000","last_change":"2024-09-19T09:42:37.515074+0000","last_active":"2024-09-19T09:53:35.781548+0000","last_peered":"2024-09-19T09:53:35.781548+0000","last_clean":"2024-09-19T09:53:35.781548+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:53:35.781548+0000","last_undegraded":"2024-09-19T09:53:35.781548+0000","last_fullsized":"2024-09-19T09:53:35.781548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8646,"log_dups_size":0,"ondisk_log_size":8646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:01.285787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131457,"num_write_kb":1608657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'5972","reported_seq":5992,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.684878+0000","last_change":"2024-09-19T09:42:37.516285+0000","last_active":"2024-09-19T09:53:35.684878+0000","last_peered":"2024-09-19T09:53:35.684878+0000","last_clean":"2024-09-19T09:53:35.684878+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:53:35.684878+0000","last_undegraded":"2024-09-19T09:53:35.684878+0000","last_fullsized":"2024-09-19T09:53:35.684878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:38.060859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90903,"num_write_kb":1098126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1242","reported_seq":1264,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:39.669842+0000","last_change":"2024-09-19T09:42:36.506929+0000","last_active":"2024-09-19T09:52:39.669842+0000","last_peered":"2024-09-19T09:52:39.669842+0000","last_clean":"2024-09-19T09:52:39.669842+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:52:39.669842+0000","last_undegraded":"2024-09-19T09:52:39.669842+0000","last_fullsized":"2024-09-19T09:52:39.669842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:54.957615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":5249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5283","reported_seq":5304,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.831174+0000","last_change":"2024-09-19T09:42:37.514425+0000","last_active":"2024-09-19T09:53:35.831174+0000","last_peered":"2024-09-19T09:53:35.831174+0000","last_clean":"2024-09-19T09:53:35.831174+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:53:35.831174+0000","last_undegraded":"2024-09-19T09:53:35.831174+0000","last_fullsized":"2024-09-19T09:53:35.831174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80097,"num_write_kb":999347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'43","reported_seq":65,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.506874+0000","last_change":"2024-09-19T09:42:36.491069+0000","last_active":"2024-09-19T09:52:45.506874+0000","last_peered":"2024-09-19T09:52:45.506874+0000","last_clean":"2024-09-19T09:52:45.506874+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:52:45.506874+0000","last_undegraded":"2024-09-19T09:52:45.506874+0000","last_fullsized":"2024-09-19T09:52:45.506874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:27.026464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":16406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:29.642711+0000","last_change":"2024-09-19T09:42:36.506784+0000","last_active":"2024-09-19T09:52:29.642711+0000","last_peered":"2024-09-19T09:52:29.642711+0000","last_clean":"2024-09-19T09:52:29.642711+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:52:29.642711+0000","last_undegraded":"2024-09-19T09:52:29.642711+0000","last_fullsized":"2024-09-19T09:52:29.642711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:48.236142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'6896","reported_seq":6916,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.789461+0000","last_change":"2024-09-19T09:42:37.519054+0000","last_active":"2024-09-19T09:53:35.789461+0000","last_peered":"2024-09-19T09:53:35.789461+0000","last_clean":"2024-09-19T09:53:35.789461+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:53:35.789461+0000","last_undegraded":"2024-09-19T09:53:35.789461+0000","last_fullsized":"2024-09-19T09:53:35.789461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6896,"log_dups_size":0,"ondisk_log_size":6896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:33.392693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104648,"num_write_kb":1287559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'31","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:44.798938+0000","last_change":"2024-09-19T09:42:36.500639+0000","last_active":"2024-09-19T09:52:44.798938+0000","last_peered":"2024-09-19T09:52:44.798938+0000","last_clean":"2024-09-19T09:52:44.798938+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:52:44.798938+0000","last_undegraded":"2024-09-19T09:52:44.798938+0000","last_fullsized":"2024-09-19T09:52:44.798938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:49.225762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'8134","reported_seq":8154,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.751917+0000","last_change":"2024-09-19T09:42:37.515825+0000","last_active":"2024-09-19T09:53:35.751917+0000","last_peered":"2024-09-19T09:53:35.751917+0000","last_clean":"2024-09-19T09:53:35.751917+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:53:35.751917+0000","last_undegraded":"2024-09-19T09:53:35.751917+0000","last_fullsized":"2024-09-19T09:53:35.751917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8134,"log_dups_size":0,"ondisk_log_size":8134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:32.032814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123619,"num_write_kb":1504166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:21.261469+0000","last_change":"2024-09-19T09:42:36.494598+0000","last_active":"2024-09-19T09:52:21.261469+0000","last_peered":"2024-09-19T09:52:21.261469+0000","last_clean":"2024-09-19T09:52:21.261469+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:52:21.261469+0000","last_undegraded":"2024-09-19T09:52:21.261469+0000","last_fullsized":"2024-09-19T09:52:21.261469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:34.487415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'6995","reported_seq":7015,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.863460+0000","last_change":"2024-09-19T09:42:37.525453+0000","last_active":"2024-09-19T09:53:35.863460+0000","last_peered":"2024-09-19T09:53:35.863460+0000","last_clean":"2024-09-19T09:53:35.863460+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:53:35.863460+0000","last_undegraded":"2024-09-19T09:53:35.863460+0000","last_fullsized":"2024-09-19T09:53:35.863460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6995,"log_dups_size":0,"ondisk_log_size":6995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.778031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106286,"num_write_kb":1265589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'27","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.513741+0000","last_change":"2024-09-19T09:42:36.503708+0000","last_active":"2024-09-19T09:52:45.513741+0000","last_peered":"2024-09-19T09:52:45.513741+0000","last_clean":"2024-09-19T09:52:45.513741+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:52:45.513741+0000","last_undegraded":"2024-09-19T09:52:45.513741+0000","last_fullsized":"2024-09-19T09:52:45.513741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.225619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'6106","reported_seq":6127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.842263+0000","last_change":"2024-09-19T09:42:37.521852+0000","last_active":"2024-09-19T09:53:35.842263+0000","last_peered":"2024-09-19T09:53:35.842263+0000","last_clean":"2024-09-19T09:53:35.842263+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:53:35.842263+0000","last_undegraded":"2024-09-19T09:53:35.842263+0000","last_fullsized":"2024-09-19T09:53:35.842263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6106,"log_dups_size":0,"ondisk_log_size":6106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92578,"num_write_kb":1120610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'146","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.930558+0000","last_change":"2024-09-19T09:42:36.496027+0000","last_active":"2024-09-19T09:52:45.930558+0000","last_peered":"2024-09-19T09:52:45.930558+0000","last_clean":"2024-09-19T09:52:45.930558+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:52:45.930558+0000","last_undegraded":"2024-09-19T09:52:45.930558+0000","last_fullsized":"2024-09-19T09:52:45.930558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:43.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8082020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":7957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9209","reported_seq":9229,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.869664+0000","last_change":"2024-09-19T09:42:37.523241+0000","last_active":"2024-09-19T09:53:35.869664+0000","last_peered":"2024-09-19T09:53:35.869664+0000","last_clean":"2024-09-19T09:53:35.869664+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:53:35.869664+0000","last_undegraded":"2024-09-19T09:53:35.869664+0000","last_fullsized":"2024-09-19T09:53:35.869664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":9209,"log_dups_size":0,"ondisk_log_size":9209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.244940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140136,"num_write_kb":1697056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'235","reported_seq":257,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.518883+0000","last_change":"2024-09-19T09:42:36.501621+0000","last_active":"2024-09-19T09:52:45.518883+0000","last_peered":"2024-09-19T09:52:45.518883+0000","last_clean":"2024-09-19T09:52:45.518883+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:52:45.518883+0000","last_undegraded":"2024-09-19T09:52:45.518883+0000","last_fullsized":"2024-09-19T09:52:45.518883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:38.297331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'6643","reported_seq":6663,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.770825+0000","last_change":"2024-09-19T09:42:37.524575+0000","last_active":"2024-09-19T09:53:35.770825+0000","last_peered":"2024-09-19T09:53:35.770825+0000","last_clean":"2024-09-19T09:53:35.770825+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:53:35.770825+0000","last_undegraded":"2024-09-19T09:53:35.770825+0000","last_fullsized":"2024-09-19T09:53:35.770825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6643,"log_dups_size":0,"ondisk_log_size":6643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:09.458059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100932,"num_write_kb":1211662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'18","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.529309+0000","last_change":"2024-09-19T09:53:39.529337+0000","last_active":"2024-09-19T09:53:39.529309+0000","last_peered":"2024-09-19T09:53:39.529309+0000","last_clean":"2024-09-19T09:53:39.529309+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:53:39.529309+0000","last_undegraded":"2024-09-19T09:53:39.529309+0000","last_fullsized":"2024-09-19T09:53:39.529309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'18","last_scrub_stamp":"2024-09-19T09:53:39.529243+0000","last_deep_scrub":"25'18","last_deep_scrub_stamp":"2024-09-19T09:53:39.529243+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.529243+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:28.598014+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'6603","reported_seq":6624,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.795636+0000","last_change":"2024-09-19T09:42:37.523294+0000","last_active":"2024-09-19T09:53:35.795636+0000","last_peered":"2024-09-19T09:53:35.795636+0000","last_clean":"2024-09-19T09:53:35.795636+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:53:35.795636+0000","last_undegraded":"2024-09-19T09:53:35.795636+0000","last_fullsized":"2024-09-19T09:53:35.795636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6603,"log_dups_size":0,"ondisk_log_size":6603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100178,"num_write_kb":1211527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542370+0000","last_change":"2024-09-19T09:42:36.502174+0000","last_active":"2024-09-19T09:52:45.542370+0000","last_peered":"2024-09-19T09:52:45.542370+0000","last_clean":"2024-09-19T09:52:45.542370+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:52:45.542370+0000","last_undegraded":"2024-09-19T09:52:45.542370+0000","last_fullsized":"2024-09-19T09:52:45.542370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:05.371521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'7772","reported_seq":7792,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.804039+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:53:35.804039+0000","last_peered":"2024-09-19T09:53:35.804039+0000","last_clean":"2024-09-19T09:53:35.804039+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:53:35.804039+0000","last_undegraded":"2024-09-19T09:53:35.804039+0000","last_fullsized":"2024-09-19T09:53:35.804039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7772,"log_dups_size":0,"ondisk_log_size":7772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.654074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118022,"num_write_kb":1435104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.519810+0000","last_change":"2024-09-19T09:42:36.490641+0000","last_active":"2024-09-19T09:52:45.519810+0000","last_peered":"2024-09-19T09:52:45.519810+0000","last_clean":"2024-09-19T09:52:45.519810+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:52:45.519810+0000","last_undegraded":"2024-09-19T09:52:45.519810+0000","last_fullsized":"2024-09-19T09:52:45.519810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:52.873561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'7347","reported_seq":7367,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.727276+0000","last_change":"2024-09-19T09:42:37.515790+0000","last_active":"2024-09-19T09:53:35.727276+0000","last_peered":"2024-09-19T09:53:35.727276+0000","last_clean":"2024-09-19T09:53:35.727276+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:53:35.727276+0000","last_undegraded":"2024-09-19T09:53:35.727276+0000","last_fullsized":"2024-09-19T09:53:35.727276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7347,"log_dups_size":0,"ondisk_log_size":7347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:32.010300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111551,"num_write_kb":1366296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'36","reported_seq":58,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.490639+0000","last_change":"2024-09-19T09:42:36.497207+0000","last_active":"2024-09-19T09:52:45.490639+0000","last_peered":"2024-09-19T09:52:45.490639+0000","last_clean":"2024-09-19T09:52:45.490639+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:52:45.490639+0000","last_undegraded":"2024-09-19T09:52:45.490639+0000","last_fullsized":"2024-09-19T09:52:45.490639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'6691","reported_seq":6711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.762330+0000","last_change":"2024-09-19T09:42:37.523443+0000","last_active":"2024-09-19T09:53:35.762330+0000","last_peered":"2024-09-19T09:53:35.762330+0000","last_clean":"2024-09-19T09:53:35.762330+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:53:35.762330+0000","last_undegraded":"2024-09-19T09:53:35.762330+0000","last_fullsized":"2024-09-19T09:53:35.762330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6691,"log_dups_size":0,"ondisk_log_size":6691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:33.364667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101427,"num_write_kb":1285780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'17","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.520111+0000","last_change":"2024-09-19T09:42:36.493180+0000","last_active":"2024-09-19T09:52:45.520111+0000","last_peered":"2024-09-19T09:52:45.520111+0000","last_clean":"2024-09-19T09:52:45.520111+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:52:45.520111+0000","last_undegraded":"2024-09-19T09:52:45.520111+0000","last_fullsized":"2024-09-19T09:52:45.520111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:45.106902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'6802","reported_seq":6816,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.705194+0000","last_change":"2024-09-19T09:43:20.619746+0000","last_active":"2024-09-19T09:53:35.705194+0000","last_peered":"2024-09-19T09:53:35.705194+0000","last_clean":"2024-09-19T09:53:35.705194+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:53:35.705194+0000","last_undegraded":"2024-09-19T09:53:35.705194+0000","last_fullsized":"2024-09-19T09:53:35.705194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6802,"log_dups_size":0,"ondisk_log_size":6802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:39.025798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103611,"num_write_kb":1225908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"25'19","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.525331+0000","last_change":"2024-09-19T09:42:36.502407+0000","last_active":"2024-09-19T09:52:45.525331+0000","last_peered":"2024-09-19T09:52:45.525331+0000","last_clean":"2024-09-19T09:52:45.525331+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:52:45.525331+0000","last_undegraded":"2024-09-19T09:52:45.525331+0000","last_fullsized":"2024-09-19T09:52:45.525331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:28.422883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'8081","reported_seq":8101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.837574+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:53:35.837574+0000","last_peered":"2024-09-19T09:53:35.837574+0000","last_clean":"2024-09-19T09:53:35.837574+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:53:35.837574+0000","last_undegraded":"2024-09-19T09:53:35.837574+0000","last_fullsized":"2024-09-19T09:53:35.837574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8081,"log_dups_size":0,"ondisk_log_size":8081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:48.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122842,"num_write_kb":1473778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'14","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:39.088249+0000","last_change":"2024-09-19T09:42:36.498645+0000","last_active":"2024-09-19T09:51:39.088249+0000","last_peered":"2024-09-19T09:51:39.088249+0000","last_clean":"2024-09-19T09:51:39.088249+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:51:39.088249+0000","last_undegraded":"2024-09-19T09:51:39.088249+0000","last_fullsized":"2024-09-19T09:51:39.088249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:17.277914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'7130","reported_seq":7144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.769075+0000","last_change":"2024-09-19T09:43:20.619216+0000","last_active":"2024-09-19T09:53:35.769075+0000","last_peered":"2024-09-19T09:53:35.769075+0000","last_clean":"2024-09-19T09:53:35.769075+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:53:35.769075+0000","last_undegraded":"2024-09-19T09:53:35.769075+0000","last_fullsized":"2024-09-19T09:53:35.769075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7130,"log_dups_size":0,"ondisk_log_size":7130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:14.168619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108281,"num_write_kb":1344761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:51:34.636798+0000","last_change":"2024-09-19T09:42:36.500769+0000","last_active":"2024-09-19T09:51:34.636798+0000","last_peered":"2024-09-19T09:51:34.636798+0000","last_clean":"2024-09-19T09:51:34.636798+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:51:34.636798+0000","last_undegraded":"2024-09-19T09:51:34.636798+0000","last_fullsized":"2024-09-19T09:51:34.636798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:04.887931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'6859","reported_seq":6879,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.814116+0000","last_change":"2024-09-19T09:42:37.525927+0000","last_active":"2024-09-19T09:53:35.814116+0000","last_peered":"2024-09-19T09:53:35.814116+0000","last_clean":"2024-09-19T09:53:35.814116+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:53:35.814116+0000","last_undegraded":"2024-09-19T09:53:35.814116+0000","last_fullsized":"2024-09-19T09:53:35.814116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6859,"log_dups_size":0,"ondisk_log_size":6859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:28.690470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104241,"num_write_kb":1288428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.775818+0000","last_change":"2024-09-19T09:42:31.072618+0000","last_active":"2024-09-19T09:50:37.775818+0000","last_peered":"2024-09-19T09:50:37.775818+0000","last_clean":"2024-09-19T09:50:37.775818+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:50:37.775818+0000","last_undegraded":"2024-09-19T09:50:37.775818+0000","last_fullsized":"2024-09-19T09:50:37.775818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:29.446260+0000","last_clean_scrub_stamp":"2024-09-19T09:42:29.446260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:39.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:50:58.592828+0000","last_change":"2024-09-19T09:42:36.499476+0000","last_active":"2024-09-19T09:50:58.592828+0000","last_peered":"2024-09-19T09:50:58.592828+0000","last_clean":"2024-09-19T09:50:58.592828+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:50:58.592828+0000","last_undegraded":"2024-09-19T09:50:58.592828+0000","last_fullsized":"2024-09-19T09:50:58.592828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:07.246100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'7194","reported_seq":7215,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.808072+0000","last_change":"2024-09-19T09:42:37.520809+0000","last_active":"2024-09-19T09:53:35.808072+0000","last_peered":"2024-09-19T09:53:35.808072+0000","last_clean":"2024-09-19T09:53:35.808072+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:53:35.808072+0000","last_undegraded":"2024-09-19T09:53:35.808072+0000","last_fullsized":"2024-09-19T09:53:35.808072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7194,"log_dups_size":0,"ondisk_log_size":7194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:16.431795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109665,"num_write_kb":1344078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'51","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.542830+0000","last_change":"2024-09-19T09:42:36.503981+0000","last_active":"2024-09-19T09:52:45.542830+0000","last_peered":"2024-09-19T09:52:45.542830+0000","last_clean":"2024-09-19T09:52:45.542830+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:52:45.542830+0000","last_undegraded":"2024-09-19T09:52:45.542830+0000","last_fullsized":"2024-09-19T09:52:45.542830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:20.448624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'6526","reported_seq":6548,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.795183+0000","last_change":"2024-09-19T09:42:37.513731+0000","last_active":"2024-09-19T09:53:35.795183+0000","last_peered":"2024-09-19T09:53:35.795183+0000","last_clean":"2024-09-19T09:53:35.795183+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:53:35.795183+0000","last_undegraded":"2024-09-19T09:53:35.795183+0000","last_fullsized":"2024-09-19T09:53:35.795183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6526,"log_dups_size":0,"ondisk_log_size":6526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99242,"num_write_kb":1260349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'26","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.541286+0000","last_change":"2024-09-19T09:42:36.500408+0000","last_active":"2024-09-19T09:52:45.541286+0000","last_peered":"2024-09-19T09:52:45.541286+0000","last_clean":"2024-09-19T09:52:45.541286+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:52:45.541286+0000","last_undegraded":"2024-09-19T09:52:45.541286+0000","last_fullsized":"2024-09-19T09:52:45.541286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:37.699627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":24,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'6593","reported_seq":6614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.748996+0000","last_change":"2024-09-19T09:42:37.510631+0000","last_active":"2024-09-19T09:53:35.748996+0000","last_peered":"2024-09-19T09:53:35.748996+0000","last_clean":"2024-09-19T09:53:35.748996+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:53:35.748996+0000","last_undegraded":"2024-09-19T09:53:35.748996+0000","last_fullsized":"2024-09-19T09:53:35.748996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6593,"log_dups_size":0,"ondisk_log_size":6593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:22.899461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99779,"num_write_kb":1243684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'20","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.527624+0000","last_change":"2024-09-19T09:42:36.501739+0000","last_active":"2024-09-19T09:52:45.527624+0000","last_peered":"2024-09-19T09:52:45.527624+0000","last_clean":"2024-09-19T09:52:45.527624+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:52:45.527624+0000","last_undegraded":"2024-09-19T09:52:45.527624+0000","last_fullsized":"2024-09-19T09:52:45.527624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:49.019560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6382","reported_seq":6403,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.782378+0000","last_change":"2024-09-19T09:42:37.518466+0000","last_active":"2024-09-19T09:53:35.782378+0000","last_peered":"2024-09-19T09:53:35.782378+0000","last_clean":"2024-09-19T09:53:35.782378+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:53:35.782378+0000","last_undegraded":"2024-09-19T09:53:35.782378+0000","last_fullsized":"2024-09-19T09:53:35.782378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6382,"log_dups_size":0,"ondisk_log_size":6382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:05.195852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97075,"num_write_kb":1245753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'17","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516603+0000","last_change":"2024-09-19T09:42:36.492955+0000","last_active":"2024-09-19T09:52:45.516603+0000","last_peered":"2024-09-19T09:52:45.516603+0000","last_clean":"2024-09-19T09:52:45.516603+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:52:45.516603+0000","last_undegraded":"2024-09-19T09:52:45.516603+0000","last_fullsized":"2024-09-19T09:52:45.516603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:21.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5988","reported_seq":6009,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.799293+0000","last_change":"2024-09-19T09:42:37.523879+0000","last_active":"2024-09-19T09:53:35.799293+0000","last_peered":"2024-09-19T09:53:35.799293+0000","last_clean":"2024-09-19T09:53:35.799293+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:53:35.799293+0000","last_undegraded":"2024-09-19T09:53:35.799293+0000","last_fullsized":"2024-09-19T09:53:35.799293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5988,"log_dups_size":0,"ondisk_log_size":5988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:15.807508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90916,"num_write_kb":1171530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.521454+0000","last_change":"2024-09-19T09:42:36.505711+0000","last_active":"2024-09-19T09:52:45.521454+0000","last_peered":"2024-09-19T09:52:45.521454+0000","last_clean":"2024-09-19T09:52:45.521454+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:52:45.521454+0000","last_undegraded":"2024-09-19T09:52:45.521454+0000","last_fullsized":"2024-09-19T09:52:45.521454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:43.906436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7106","reported_seq":7127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.731363+0000","last_change":"2024-09-19T09:42:37.511343+0000","last_active":"2024-09-19T09:53:35.731363+0000","last_peered":"2024-09-19T09:53:35.731363+0000","last_clean":"2024-09-19T09:53:35.731363+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:53:35.731363+0000","last_undegraded":"2024-09-19T09:53:35.731363+0000","last_fullsized":"2024-09-19T09:53:35.731363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7106,"log_dups_size":0,"ondisk_log_size":7106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:45.794450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107857,"num_write_kb":1353549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'251","reported_seq":274,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:21.625776+0000","last_change":"2024-09-19T09:42:36.490691+0000","last_active":"2024-09-19T09:53:21.625776+0000","last_peered":"2024-09-19T09:53:21.625776+0000","last_clean":"2024-09-19T09:53:21.625776+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:53:21.625776+0000","last_undegraded":"2024-09-19T09:53:21.625776+0000","last_fullsized":"2024-09-19T09:53:21.625776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:23.874222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'6910","reported_seq":6931,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.735173+0000","last_change":"2024-09-19T09:42:37.523654+0000","last_active":"2024-09-19T09:53:35.735173+0000","last_peered":"2024-09-19T09:53:35.735173+0000","last_clean":"2024-09-19T09:53:35.735173+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:53:35.735173+0000","last_undegraded":"2024-09-19T09:53:35.735173+0000","last_fullsized":"2024-09-19T09:53:35.735173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6910,"log_dups_size":0,"ondisk_log_size":6910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:33.294264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104946,"num_write_kb":1269889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.558520+0000","last_change":"2024-09-19T09:42:36.504486+0000","last_active":"2024-09-19T09:52:45.558520+0000","last_peered":"2024-09-19T09:52:45.558520+0000","last_clean":"2024-09-19T09:52:45.558520+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:52:45.558520+0000","last_undegraded":"2024-09-19T09:52:45.558520+0000","last_fullsized":"2024-09-19T09:52:45.558520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:04.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'5820","reported_seq":5842,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.751737+0000","last_change":"2024-09-19T09:42:37.513558+0000","last_active":"2024-09-19T09:53:35.751737+0000","last_peered":"2024-09-19T09:53:35.751737+0000","last_clean":"2024-09-19T09:53:35.751737+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:53:35.751737+0000","last_undegraded":"2024-09-19T09:53:35.751737+0000","last_fullsized":"2024-09-19T09:53:35.751737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5820,"log_dups_size":0,"ondisk_log_size":5820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88305,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'14","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.515790+0000","last_change":"2024-09-19T09:42:36.505676+0000","last_active":"2024-09-19T09:52:45.515790+0000","last_peered":"2024-09-19T09:52:45.515790+0000","last_clean":"2024-09-19T09:52:45.515790+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:52:45.515790+0000","last_undegraded":"2024-09-19T09:52:45.515790+0000","last_fullsized":"2024-09-19T09:52:45.515790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:57.649511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'6612","reported_seq":6633,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.758419+0000","last_change":"2024-09-19T09:42:37.510864+0000","last_active":"2024-09-19T09:53:35.758419+0000","last_peered":"2024-09-19T09:53:35.758419+0000","last_clean":"2024-09-19T09:53:35.758419+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:53:35.758419+0000","last_undegraded":"2024-09-19T09:53:35.758419+0000","last_fullsized":"2024-09-19T09:53:35.758419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6612,"log_dups_size":0,"ondisk_log_size":6612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:26.532825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100566,"num_write_kb":1195835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'15","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.515453+0000","last_change":"2024-09-19T09:42:36.498533+0000","last_active":"2024-09-19T09:52:45.515453+0000","last_peered":"2024-09-19T09:52:45.515453+0000","last_clean":"2024-09-19T09:52:45.515453+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:52:45.515453+0000","last_undegraded":"2024-09-19T09:52:45.515453+0000","last_fullsized":"2024-09-19T09:52:45.515453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:51.963409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'6882","reported_seq":6896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.694766+0000","last_change":"2024-09-19T09:43:20.620289+0000","last_active":"2024-09-19T09:53:35.694766+0000","last_peered":"2024-09-19T09:53:35.694766+0000","last_clean":"2024-09-19T09:53:35.694766+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:53:35.694766+0000","last_undegraded":"2024-09-19T09:53:35.694766+0000","last_fullsized":"2024-09-19T09:53:35.694766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6882,"log_dups_size":0,"ondisk_log_size":6882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:36.817715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104802,"num_write_kb":1303037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"25'20","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.544760+0000","last_change":"2024-09-19T09:42:36.500262+0000","last_active":"2024-09-19T09:52:45.544760+0000","last_peered":"2024-09-19T09:52:45.544760+0000","last_clean":"2024-09-19T09:52:45.544760+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:52:45.544760+0000","last_undegraded":"2024-09-19T09:52:45.544760+0000","last_fullsized":"2024-09-19T09:52:45.544760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:56.213413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'5981","reported_seq":6001,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.783080+0000","last_change":"2024-09-19T09:42:37.519358+0000","last_active":"2024-09-19T09:53:35.783080+0000","last_peered":"2024-09-19T09:53:35.783080+0000","last_clean":"2024-09-19T09:53:35.783080+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:53:35.783080+0000","last_undegraded":"2024-09-19T09:53:35.783080+0000","last_fullsized":"2024-09-19T09:53:35.783080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5981,"log_dups_size":0,"ondisk_log_size":5981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:22.389426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91144,"num_write_kb":1060104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'181","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.516531+0000","last_change":"2024-09-19T09:42:36.503773+0000","last_active":"2024-09-19T09:52:45.516531+0000","last_peered":"2024-09-19T09:52:45.516531+0000","last_clean":"2024-09-19T09:52:45.516531+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:52:45.516531+0000","last_undegraded":"2024-09-19T09:52:45.516531+0000","last_fullsized":"2024-09-19T09:52:45.516531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:13.302507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'6191","reported_seq":6212,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.672194+0000","last_change":"2024-09-19T09:42:37.515245+0000","last_active":"2024-09-19T09:53:35.672194+0000","last_peered":"2024-09-19T09:53:35.672194+0000","last_clean":"2024-09-19T09:53:35.672194+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:53:35.672194+0000","last_undegraded":"2024-09-19T09:53:35.672194+0000","last_fullsized":"2024-09-19T09:53:35.672194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":6191,"log_dups_size":0,"ondisk_log_size":6191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:35.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94126,"num_write_kb":1169732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'8374","reported_seq":8388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.780720+0000","last_change":"2024-09-19T09:43:20.620403+0000","last_active":"2024-09-19T09:53:35.780720+0000","last_peered":"2024-09-19T09:53:35.780720+0000","last_clean":"2024-09-19T09:53:35.780720+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:53:35.780720+0000","last_undegraded":"2024-09-19T09:53:35.780720+0000","last_fullsized":"2024-09-19T09:53:35.780720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8374,"log_dups_size":0,"ondisk_log_size":8374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:34.693485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127388,"num_write_kb":1561891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'7","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:41.359906+0000","last_change":"2024-09-19T09:42:36.503802+0000","last_active":"2024-09-19T09:52:41.359906+0000","last_peered":"2024-09-19T09:52:41.359906+0000","last_clean":"2024-09-19T09:52:41.359906+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:52:41.359906+0000","last_undegraded":"2024-09-19T09:52:41.359906+0000","last_fullsized":"2024-09-19T09:52:41.359906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:29.314541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5056","reported_seq":5076,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.809964+0000","last_change":"2024-09-19T09:42:37.521437+0000","last_active":"2024-09-19T09:53:35.809964+0000","last_peered":"2024-09-19T09:53:35.809964+0000","last_clean":"2024-09-19T09:53:35.809964+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:53:35.809964+0000","last_undegraded":"2024-09-19T09:53:35.809964+0000","last_fullsized":"2024-09-19T09:53:35.809964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":5056,"log_dups_size":0,"ondisk_log_size":5056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:18.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76792,"num_write_kb":903119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'48","reported_seq":70,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.508070+0000","last_change":"2024-09-19T09:42:36.506908+0000","last_active":"2024-09-19T09:52:45.508070+0000","last_peered":"2024-09-19T09:52:45.508070+0000","last_clean":"2024-09-19T09:52:45.508070+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:52:45.508070+0000","last_undegraded":"2024-09-19T09:52:45.508070+0000","last_fullsized":"2024-09-19T09:52:45.508070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:26.652695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":16399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'8300","reported_seq":8322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.842296+0000","last_change":"2024-09-19T09:42:37.521715+0000","last_active":"2024-09-19T09:53:35.842296+0000","last_peered":"2024-09-19T09:53:35.842296+0000","last_clean":"2024-09-19T09:53:35.842296+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:53:35.842296+0000","last_undegraded":"2024-09-19T09:53:35.842296+0000","last_fullsized":"2024-09-19T09:53:35.842296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8300,"log_dups_size":0,"ondisk_log_size":8300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125930,"num_write_kb":1569689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'26","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:52:45.539717+0000","last_change":"2024-09-19T09:42:36.503173+0000","last_active":"2024-09-19T09:52:45.539717+0000","last_peered":"2024-09-19T09:52:45.539717+0000","last_clean":"2024-09-19T09:52:45.539717+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:52:45.539717+0000","last_undegraded":"2024-09-19T09:52:45.539717+0000","last_fullsized":"2024-09-19T09:52:45.539717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.519792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'7286","reported_seq":7307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.716805+0000","last_change":"2024-09-19T09:42:37.512546+0000","last_active":"2024-09-19T09:53:35.716805+0000","last_peered":"2024-09-19T09:53:35.716805+0000","last_clean":"2024-09-19T09:53:35.716805+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:53:35.716805+0000","last_undegraded":"2024-09-19T09:53:35.716805+0000","last_fullsized":"2024-09-19T09:53:35.716805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7286,"log_dups_size":0,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:00.680565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110915,"num_write_kb":1387536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'21","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:00.169739+0000","last_change":"2024-09-19T09:42:36.504963+0000","last_active":"2024-09-19T09:53:00.169739+0000","last_peered":"2024-09-19T09:53:00.169739+0000","last_clean":"2024-09-19T09:53:00.169739+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:53:00.169739+0000","last_undegraded":"2024-09-19T09:53:00.169739+0000","last_fullsized":"2024-09-19T09:53:00.169739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:35.474051+0000","last_clean_scrub_stamp":"2024-09-19T09:42:35.474051+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6761782,"num_write_kb":82954764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":444923,"ondisk_log_size":444923,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":209498072,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":2659,"num_write_kb":206606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":419061760,"data_stored":418996220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2587,"ondisk_log_size":2587,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509577,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705108,"kb_used_data":78660,"kb_used_omap":1,"kb_used_meta":626430,"kb_avail":93666732,"statfs":{"total":96636764160,"available":95914733568,"internally_reserved":0,"allocated":80547840,"data_stored":80376143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":641464778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443924,"kb_used_data":61700,"kb_used_omap":1,"kb_used_meta":382206,"kb_avail":93927916,"statfs":{"total":96636764160,"available":96182185984,"internally_reserved":0,"allocated":63180800,"data_stored":63008649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":391379398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509576,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653352,"kb_used_data":49112,"kb_used_omap":1,"kb_used_meta":604222,"kb_avail":93718488,"statfs":{"total":96636764160,"available":95967731712,"internally_reserved":0,"allocated":50290688,"data_stored":50118553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618723781},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509576,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":679896,"kb_used_data":57608,"kb_used_omap":1,"kb_used_meta":622270,"kb_avail":93691944,"statfs":{"total":96636764160,"available":95940550656,"internally_reserved":0,"allocated":58990592,"data_stored":58813799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":637204933},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509573,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":649708,"kb_used_data":41308,"kb_used_omap":1,"kb_used_meta":608382,"kb_avail":93722132,"statfs":{"total":96636764160,"available":95971463168,"internally_reserved":0,"allocated":42299392,"data_stored":42125209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":622983623},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435372,"kb_used_data":57308,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93936468,"statfs":{"total":96636764160,"available":96190943232,"internally_reserved":0,"allocated":58683392,"data_stored":58507155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":387119557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509576,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":672412,"kb_used_data":45900,"kb_used_omap":1,"kb_used_meta":626494,"kb_avail":93699428,"statfs":{"total":96636764160,"available":95948214272,"internally_reserved":0,"allocated":47001600,"data_stored":46821767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":641530310},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421092,"kb_used_data":20820,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93950748,"statfs":{"total":96636764160,"available":96205565952,"internally_reserved":0,"allocated":21319680,"data_stored":21153017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":409860549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58425344,"data_stored":58413738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":21059600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42041344,"data_stored":42031792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58732544,"data_stored":58720382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50032640,"data_stored":50025136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:53:41.953 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.953 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.953 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.953 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.953 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.954 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.955 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.956 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.957 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.958 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.958 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.958 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.958 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.958 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.958 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.959 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.960 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.961 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T09:42:29.446260+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=29, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.962 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.963 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.964 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.965 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.966 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.966 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.966 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-19T09:42:35.474051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:53:41.966 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T09:54:01.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:54:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.083+0000 7f7da0227640 1 Processor -- start 2024-09-19T09:54:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.084+0000 7f7da0227640 1 -- start start 2024-09-19T09:54:02.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7da0227640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d98155650 0x7f7d980cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:02.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7da0227640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9815c240 con 0x7f7d980cbf00 2024-09-19T09:54:02.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7da0227640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d98155a30 con 0x7f7d980c7f40 2024-09-19T09:54:02.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7da0227640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9815b3e0 con 0x7f7d98155650 2024-09-19T09:54:02.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9dfc3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d98155650 0x7f7d980cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:02.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9dfc3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d98155650 0x7f7d980cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38144/0 (socket says 172.21.15.123:38144) 2024-09-19T09:54:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9e7c4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7d980cbf00 0x7f7d98165b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34196/0 (socket says 172.21.15.123:34196) 2024-09-19T09:54:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9dfc3640 1 -- 172.21.15.123:0/1827214348 learned_addr learned my addr 172.21.15.123:0/1827214348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9dfc3640 1 -- 172.21.15.123:0/1827214348 >> v1:172.21.15.194:6789/0 conn(0x7f7d980c7f40 legacy=0x7f7d980cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9cfc1640 1 -- 172.21.15.123:0/1827214348 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676931640 0 0) 0x7f7d9815c240 con 0x7f7d980cbf00 2024-09-19T09:54:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9dfc3640 1 -- 172.21.15.123:0/1827214348 >> v1:172.21.15.123:6789/0 conn(0x7f7d980cbf00 legacy=0x7f7d98165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.085+0000 7f7d9dfc3640 1 -- 172.21.15.123:0/1827214348 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9815b6c0 con 0x7f7d98155650 2024-09-19T09:54:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.086+0000 7f7d9dfc3640 1 --2- 172.21.15.123:0/1827214348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980cc850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009870 tx=0x7f7d9402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c36c3654e0fa82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.086+0000 7f7d9cfc1640 1 -- 172.21.15.123:0/1827214348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94037070 con 0x7f7d98155650 2024-09-19T09:54:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.086+0000 7f7d9cfc1640 1 -- 172.21.15.123:0/1827214348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9402ae50 con 0x7f7d98155650 2024-09-19T09:54:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.086+0000 7f7d9cfc1640 1 -- 172.21.15.123:0/1827214348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94032860 con 0x7f7d98155650 2024-09-19T09:54:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 -- 172.21.15.123:0/1827214348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 msgr2=0x7f7d980cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 --2- 172.21.15.123:0/1827214348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980cc850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009870 tx=0x7f7d9402a300 comp rx=0 tx=0).stop 2024-09-19T09:54:02.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 -- 172.21.15.123:0/1827214348 shutdown_connections 2024-09-19T09:54:02.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 --2- 172.21.15.123:0/1827214348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980cc850 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 -- 172.21.15.123:0/1827214348 >> 172.21.15.123:0/1827214348 conn(0x7f7d980cd5c0 msgr2=0x7f7d980cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:02.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 -- 172.21.15.123:0/1827214348 shutdown_connections 2024-09-19T09:54:02.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.087+0000 7f7da0227640 1 -- 172.21.15.123:0/1827214348 wait complete. 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.088+0000 7f7da0227640 1 Processor -- start 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.088+0000 7f7da0227640 1 -- start start 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d980c7f40 0x7f7d9815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d980cbf00 0x7f7d981f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9815bf60 con 0x7f7d98155650 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9815bc80 con 0x7f7d980c7f40 2024-09-19T09:54:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7d980ce430 con 0x7f7d980cbf00 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38146/0 (socket says 172.21.15.123:38146) 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 -- 172.21.15.123:0/1874992899 learned_addr learned my addr 172.21.15.123:0/1874992899 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9d7c2640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d980cbf00 0x7f7d981f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9dfc3640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d980c7f40 0x7f7d9815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 -- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d980cbf00 msgr2=0x7f7d981f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d980cbf00 0x7f7d981f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 -- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d980c7f40 msgr2=0x7f7d9815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d980c7f40 0x7f7d9815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 -- 172.21.15.123:0/1874992899 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d980c7820 con 0x7f7d98155650 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9dfc3640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d980c7f40 0x7f7d9815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d9e7c4640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980c6920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c810 tx=0x7f7d9000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90018070 con 0x7f7d98155650 2024-09-19T09:54:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9000a640 con 0x7f7d98155650 2024-09-19T09:54:02.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d981f0e50 con 0x7f7d98155650 2024-09-19T09:54:02.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000aa30 con 0x7f7d98155650 2024-09-19T09:54:02.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.089+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d980c4cf0 con 0x7f7d98155650 2024-09-19T09:54:02.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.091+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d980d0460 con 0x7f7d98155650 2024-09-19T09:54:02.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.091+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d9001b070 con 0x7f7d98155650 2024-09-19T09:54:02.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.091+0000 7f7d8a7fc640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d7c06c2b0 0x7f7d7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:02.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.091+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7d9008aa20 con 0x7f7d98155650 2024-09-19T09:54:02.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.091+0000 7f7d9dfc3640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d7c06c2b0 0x7f7d7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:02.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.092+0000 7f7d9dfc3640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d7c06c2b0 0x7f7d7c06e770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d94034000 tx=0x7f7d9402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.096+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7d900591a0 con 0x7f7d98155650 2024-09-19T09:54:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.258+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d980b6690 con 0x7f7d7c06c2b0 2024-09-19T09:54:02.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.263+0000 7f7d8a7fc640 1 -- 172.21.15.123:0/1874992899 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254465 (secure 0 0 0) 0x7f7d980b6690 con 0x7f7d7c06c2b0 2024-09-19T09:54:02.269 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:54:02.270 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d7c06c2b0 msgr2=0x7f7d7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d7c06c2b0 0x7f7d7c06e770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d94034000 tx=0x7f7d9402e000 comp rx=0 tx=0).stop 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 msgr2=0x7f7d980c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980c6920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c810 tx=0x7f7d9000ccd0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 shutdown_connections 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d98155650 0x7f7d980c6920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7d7c06c2b0 0x7f7d7c06e770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d980cbf00 0x7f7d981f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 --2- 172.21.15.123:0/1874992899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d980c7f40 0x7f7d9815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.266+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 >> 172.21.15.123:0/1874992899 conn(0x7f7d980cd5c0 msgr2=0x7f7d980ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.267+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 shutdown_connections 2024-09-19T09:54:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:02.267+0000 7f7da0227640 1 -- 172.21.15.123:0/1874992899 wait complete. 2024-09-19T09:54:02.280 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-19T09:54:00.900799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210088516,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":140,"num_read_kb":201,"num_write":6764601,"num_write_kb":83163787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447696,"ondisk_log_size":447696,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4660864,"kb_used_data":412416,"kb_used_omap":12,"kb_used_meta":4248307,"kb_avail":750313856,"statfs":{"total":773094113280,"available":768321388544,"internally_reserved":0,"allocated":422313984,"data_stored":420924368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":4350266929},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"3.3f","version":"25'5963","reported_seq":5993,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.368874+0000","last_change":"2024-09-19T09:53:52.368902+0000","last_active":"2024-09-19T09:53:52.368874+0000","last_peered":"2024-09-19T09:53:52.368874+0000","last_clean":"2024-09-19T09:53:52.368874+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:53:52.368874+0000","last_undegraded":"2024-09-19T09:53:52.368874+0000","last_fullsized":"2024-09-19T09:53:52.368874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5963","last_scrub_stamp":"2024-09-19T09:53:52.368778+0000","last_deep_scrub":"25'5963","last_deep_scrub_stamp":"2024-09-19T09:53:52.368778+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.368778+0000","objects_scrubbed":0,"log_size":5963,"log_dups_size":0,"ondisk_log_size":5963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:17.686193+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90667,"num_write_kb":1126123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'8758","reported_seq":8788,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.230745+0000","last_change":"2024-09-19T09:53:50.230773+0000","last_active":"2024-09-19T09:53:50.230745+0000","last_peered":"2024-09-19T09:53:50.230745+0000","last_clean":"2024-09-19T09:53:50.230745+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:53:50.230745+0000","last_undegraded":"2024-09-19T09:53:50.230745+0000","last_fullsized":"2024-09-19T09:53:50.230745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8758","last_scrub_stamp":"2024-09-19T09:53:50.230639+0000","last_deep_scrub":"25'8758","last_deep_scrub_stamp":"2024-09-19T09:53:50.230639+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.230639+0000","objects_scrubbed":0,"log_size":8758,"log_dups_size":0,"ondisk_log_size":8758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:48.743714+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133411,"num_write_kb":1655568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7063","reported_seq":7093,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.560346+0000","last_change":"2024-09-19T09:53:46.560373+0000","last_active":"2024-09-19T09:53:46.560346+0000","last_peered":"2024-09-19T09:53:46.560346+0000","last_clean":"2024-09-19T09:53:46.560346+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:53:46.560346+0000","last_undegraded":"2024-09-19T09:53:46.560346+0000","last_fullsized":"2024-09-19T09:53:46.560346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7063","last_scrub_stamp":"2024-09-19T09:53:46.560208+0000","last_deep_scrub":"25'7063","last_deep_scrub_stamp":"2024-09-19T09:53:46.560208+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.560208+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:17.072343+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107453,"num_write_kb":1318687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'6131","reported_seq":6161,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.109484+0000","last_change":"2024-09-19T09:53:52.109524+0000","last_active":"2024-09-19T09:53:52.109484+0000","last_peered":"2024-09-19T09:53:52.109484+0000","last_clean":"2024-09-19T09:53:52.109484+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:53:52.109484+0000","last_undegraded":"2024-09-19T09:53:52.109484+0000","last_fullsized":"2024-09-19T09:53:52.109484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6131","last_scrub_stamp":"2024-09-19T09:53:52.109385+0000","last_deep_scrub":"25'6131","last_deep_scrub_stamp":"2024-09-19T09:53:52.109385+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.109385+0000","objects_scrubbed":0,"log_size":6131,"log_dups_size":0,"ondisk_log_size":6131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:50.668122+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93226,"num_write_kb":1192949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'8356","reported_seq":8385,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:54.423723+0000","last_change":"2024-09-19T09:53:54.423750+0000","last_active":"2024-09-19T09:53:54.423723+0000","last_peered":"2024-09-19T09:53:54.423723+0000","last_clean":"2024-09-19T09:53:54.423723+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:53:54.423723+0000","last_undegraded":"2024-09-19T09:53:54.423723+0000","last_fullsized":"2024-09-19T09:53:54.423723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8356","last_scrub_stamp":"2024-09-19T09:53:54.423630+0000","last_deep_scrub":"25'8356","last_deep_scrub_stamp":"2024-09-19T09:53:54.423630+0000","last_clean_scrub_stamp":"2024-09-19T09:53:54.423630+0000","objects_scrubbed":0,"log_size":8356,"log_dups_size":0,"ondisk_log_size":8356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.828193+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127203,"num_write_kb":1494052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6133","reported_seq":6162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.087114+0000","last_change":"2024-09-19T09:53:48.087141+0000","last_active":"2024-09-19T09:53:48.087114+0000","last_peered":"2024-09-19T09:53:48.087114+0000","last_clean":"2024-09-19T09:53:48.087114+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:53:48.087114+0000","last_undegraded":"2024-09-19T09:53:48.087114+0000","last_fullsized":"2024-09-19T09:53:48.087114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6133","last_scrub_stamp":"2024-09-19T09:53:48.086993+0000","last_deep_scrub":"25'6133","last_deep_scrub_stamp":"2024-09-19T09:53:48.086993+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.086993+0000","objects_scrubbed":0,"log_size":6133,"log_dups_size":0,"ondisk_log_size":6133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:01.838893+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93163,"num_write_kb":1116253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'6607","reported_seq":6637,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.375628+0000","last_change":"2024-09-19T09:53:51.375656+0000","last_active":"2024-09-19T09:53:51.375628+0000","last_peered":"2024-09-19T09:53:51.375628+0000","last_clean":"2024-09-19T09:53:51.375628+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:53:51.375628+0000","last_undegraded":"2024-09-19T09:53:51.375628+0000","last_fullsized":"2024-09-19T09:53:51.375628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6607","last_scrub_stamp":"2024-09-19T09:53:51.375522+0000","last_deep_scrub":"25'6607","last_deep_scrub_stamp":"2024-09-19T09:53:51.375522+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.375522+0000","objects_scrubbed":0,"log_size":6607,"log_dups_size":0,"ondisk_log_size":6607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:38.376087+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100493,"num_write_kb":1261887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'7473","reported_seq":7502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.329035+0000","last_change":"2024-09-19T09:53:48.329057+0000","last_active":"2024-09-19T09:53:48.329035+0000","last_peered":"2024-09-19T09:53:48.329035+0000","last_clean":"2024-09-19T09:53:48.329035+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:53:48.329035+0000","last_undegraded":"2024-09-19T09:53:48.329035+0000","last_fullsized":"2024-09-19T09:53:48.329035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7473","last_scrub_stamp":"2024-09-19T09:53:48.328955+0000","last_deep_scrub":"25'7473","last_deep_scrub_stamp":"2024-09-19T09:53:48.328955+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.328955+0000","objects_scrubbed":0,"log_size":7473,"log_dups_size":0,"ondisk_log_size":7473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:11.370164+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113853,"num_write_kb":1361930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'8252","reported_seq":8273,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.870442+0000","last_change":"2024-09-19T09:42:37.527030+0000","last_active":"2024-09-19T09:53:35.870442+0000","last_peered":"2024-09-19T09:53:35.870442+0000","last_clean":"2024-09-19T09:53:35.870442+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:53:35.870442+0000","last_undegraded":"2024-09-19T09:53:35.870442+0000","last_fullsized":"2024-09-19T09:53:35.870442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8252,"log_dups_size":0,"ondisk_log_size":8252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125203,"num_write_kb":1603079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'7736","reported_seq":7765,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.173717+0000","last_change":"2024-09-19T09:53:50.173759+0000","last_active":"2024-09-19T09:53:50.173717+0000","last_peered":"2024-09-19T09:53:50.173717+0000","last_clean":"2024-09-19T09:53:50.173717+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:53:50.173717+0000","last_undegraded":"2024-09-19T09:53:50.173717+0000","last_fullsized":"2024-09-19T09:53:50.173717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7736","last_scrub_stamp":"2024-09-19T09:53:50.173600+0000","last_deep_scrub":"25'7736","last_deep_scrub_stamp":"2024-09-19T09:53:50.173600+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.173600+0000","objects_scrubbed":0,"log_size":7736,"log_dups_size":0,"ondisk_log_size":7736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.172593+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117401,"num_write_kb":1489402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'6682","reported_seq":6711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.189988+0000","last_change":"2024-09-19T09:53:52.190063+0000","last_active":"2024-09-19T09:53:52.189988+0000","last_peered":"2024-09-19T09:53:52.189988+0000","last_clean":"2024-09-19T09:53:52.189988+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:53:52.189988+0000","last_undegraded":"2024-09-19T09:53:52.189988+0000","last_fullsized":"2024-09-19T09:53:52.189988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6682","last_scrub_stamp":"2024-09-19T09:53:52.189878+0000","last_deep_scrub":"25'6682","last_deep_scrub_stamp":"2024-09-19T09:53:52.189878+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.189878+0000","objects_scrubbed":0,"log_size":6682,"log_dups_size":0,"ondisk_log_size":6682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:50.212595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101709,"num_write_kb":1228477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'5923","reported_seq":5952,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.483764+0000","last_change":"2024-09-19T09:53:42.483791+0000","last_active":"2024-09-19T09:53:42.483764+0000","last_peered":"2024-09-19T09:53:42.483764+0000","last_clean":"2024-09-19T09:53:42.483764+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:53:42.483764+0000","last_undegraded":"2024-09-19T09:53:42.483764+0000","last_fullsized":"2024-09-19T09:53:42.483764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5923","last_scrub_stamp":"2024-09-19T09:53:42.483680+0000","last_deep_scrub":"25'5923","last_deep_scrub_stamp":"2024-09-19T09:53:42.483680+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.483680+0000","objects_scrubbed":0,"log_size":5923,"log_dups_size":0,"ondisk_log_size":5923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.933005+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90039,"num_write_kb":1066111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'6238","reported_seq":6267,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.314481+0000","last_change":"2024-09-19T09:53:45.314542+0000","last_active":"2024-09-19T09:53:45.314481+0000","last_peered":"2024-09-19T09:53:45.314481+0000","last_clean":"2024-09-19T09:53:45.314481+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:53:45.314481+0000","last_undegraded":"2024-09-19T09:53:45.314481+0000","last_fullsized":"2024-09-19T09:53:45.314481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6238","last_scrub_stamp":"2024-09-19T09:53:45.314371+0000","last_deep_scrub":"25'6238","last_deep_scrub_stamp":"2024-09-19T09:53:45.314371+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.314371+0000","objects_scrubbed":0,"log_size":6238,"log_dups_size":0,"ondisk_log_size":6238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:57.003916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94800,"num_write_kb":1191870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'7101","reported_seq":7130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.638416+0000","last_change":"2024-09-19T09:53:43.638462+0000","last_active":"2024-09-19T09:53:43.638416+0000","last_peered":"2024-09-19T09:53:43.638416+0000","last_clean":"2024-09-19T09:53:43.638416+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:53:43.638416+0000","last_undegraded":"2024-09-19T09:53:43.638416+0000","last_fullsized":"2024-09-19T09:53:43.638416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7101","last_scrub_stamp":"2024-09-19T09:53:43.638313+0000","last_deep_scrub":"25'7101","last_deep_scrub_stamp":"2024-09-19T09:53:43.638313+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.638313+0000","objects_scrubbed":0,"log_size":7101,"log_dups_size":0,"ondisk_log_size":7101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:03.426263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107699,"num_write_kb":1339564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'7242","reported_seq":7271,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.231642+0000","last_change":"2024-09-19T09:53:48.231665+0000","last_active":"2024-09-19T09:53:48.231642+0000","last_peered":"2024-09-19T09:53:48.231642+0000","last_clean":"2024-09-19T09:53:48.231642+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:53:48.231642+0000","last_undegraded":"2024-09-19T09:53:48.231642+0000","last_fullsized":"2024-09-19T09:53:48.231642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7242","last_scrub_stamp":"2024-09-19T09:53:48.231565+0000","last_deep_scrub":"25'7242","last_deep_scrub_stamp":"2024-09-19T09:53:48.231565+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.231565+0000","objects_scrubbed":0,"log_size":7242,"log_dups_size":0,"ondisk_log_size":7242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:09.188481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109960,"num_write_kb":1298661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'6074","reported_seq":6103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.123401+0000","last_change":"2024-09-19T09:53:49.123426+0000","last_active":"2024-09-19T09:53:49.123401+0000","last_peered":"2024-09-19T09:53:49.123401+0000","last_clean":"2024-09-19T09:53:49.123401+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:53:49.123401+0000","last_undegraded":"2024-09-19T09:53:49.123401+0000","last_fullsized":"2024-09-19T09:53:49.123401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6074","last_scrub_stamp":"2024-09-19T09:53:49.123302+0000","last_deep_scrub":"25'6074","last_deep_scrub_stamp":"2024-09-19T09:53:49.123302+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.123302+0000","objects_scrubbed":0,"log_size":6074,"log_dups_size":0,"ondisk_log_size":6074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:08.937474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92239,"num_write_kb":1166043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8317","reported_seq":8346,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.105682+0000","last_change":"2024-09-19T09:53:51.105779+0000","last_active":"2024-09-19T09:53:51.105682+0000","last_peered":"2024-09-19T09:53:51.105682+0000","last_clean":"2024-09-19T09:53:51.105682+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:53:51.105682+0000","last_undegraded":"2024-09-19T09:53:51.105682+0000","last_fullsized":"2024-09-19T09:53:51.105682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8317","last_scrub_stamp":"2024-09-19T09:53:51.105551+0000","last_deep_scrub":"25'8317","last_deep_scrub_stamp":"2024-09-19T09:53:51.105551+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.105551+0000","objects_scrubbed":0,"log_size":8317,"log_dups_size":0,"ondisk_log_size":8317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:53.288066+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126488,"num_write_kb":1557261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'5649","reported_seq":5678,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.901323+0000","last_change":"2024-09-19T09:53:43.901348+0000","last_active":"2024-09-19T09:53:43.901323+0000","last_peered":"2024-09-19T09:53:43.901323+0000","last_clean":"2024-09-19T09:53:43.901323+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:53:43.901323+0000","last_undegraded":"2024-09-19T09:53:43.901323+0000","last_fullsized":"2024-09-19T09:53:43.901323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5649","last_scrub_stamp":"2024-09-19T09:53:43.901189+0000","last_deep_scrub":"25'5649","last_deep_scrub_stamp":"2024-09-19T09:53:43.901189+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.901189+0000","objects_scrubbed":0,"log_size":5649,"log_dups_size":0,"ondisk_log_size":5649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:15.970231+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85570,"num_write_kb":1023683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'6873","reported_seq":6902,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:55.444654+0000","last_change":"2024-09-19T09:53:55.444678+0000","last_active":"2024-09-19T09:53:55.444654+0000","last_peered":"2024-09-19T09:53:55.444654+0000","last_clean":"2024-09-19T09:53:55.444654+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:53:55.444654+0000","last_undegraded":"2024-09-19T09:53:55.444654+0000","last_fullsized":"2024-09-19T09:53:55.444654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6873","last_scrub_stamp":"2024-09-19T09:53:55.444563+0000","last_deep_scrub":"25'6873","last_deep_scrub_stamp":"2024-09-19T09:53:55.444563+0000","last_clean_scrub_stamp":"2024-09-19T09:53:55.444563+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:45.778734+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104491,"num_write_kb":1253325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'6781","reported_seq":6811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.179134+0000","last_change":"2024-09-19T09:53:46.179134+0000","last_active":"2024-09-19T09:53:46.179134+0000","last_peered":"2024-09-19T09:53:46.179134+0000","last_clean":"2024-09-19T09:53:46.179134+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:53:46.179134+0000","last_undegraded":"2024-09-19T09:53:46.179134+0000","last_fullsized":"2024-09-19T09:53:46.179134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6781","last_scrub_stamp":"2024-09-19T09:53:46.178986+0000","last_deep_scrub":"25'6781","last_deep_scrub_stamp":"2024-09-19T09:53:46.178986+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.178986+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:52.155341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103096,"num_write_kb":1273163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'7069","reported_seq":7099,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.473383+0000","last_change":"2024-09-19T09:53:49.473383+0000","last_active":"2024-09-19T09:53:49.473383+0000","last_peered":"2024-09-19T09:53:49.473383+0000","last_clean":"2024-09-19T09:53:49.473383+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:53:49.473383+0000","last_undegraded":"2024-09-19T09:53:49.473383+0000","last_fullsized":"2024-09-19T09:53:49.473383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7069","last_scrub_stamp":"2024-09-19T09:53:49.473279+0000","last_deep_scrub":"25'7069","last_deep_scrub_stamp":"2024-09-19T09:53:49.473279+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.473279+0000","objects_scrubbed":0,"log_size":7069,"log_dups_size":0,"ondisk_log_size":7069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:52.399265+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107113,"num_write_kb":1305966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'7493","reported_seq":7523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:54.121389+0000","last_change":"2024-09-19T09:53:54.121414+0000","last_active":"2024-09-19T09:53:54.121389+0000","last_peered":"2024-09-19T09:53:54.121389+0000","last_clean":"2024-09-19T09:53:54.121389+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:53:54.121389+0000","last_undegraded":"2024-09-19T09:53:54.121389+0000","last_fullsized":"2024-09-19T09:53:54.121389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7493","last_scrub_stamp":"2024-09-19T09:53:54.121280+0000","last_deep_scrub":"25'7493","last_deep_scrub_stamp":"2024-09-19T09:53:54.121280+0000","last_clean_scrub_stamp":"2024-09-19T09:53:54.121280+0000","objects_scrubbed":0,"log_size":7493,"log_dups_size":0,"ondisk_log_size":7493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:29.004389+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113925,"num_write_kb":1408486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'6884","reported_seq":6914,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.361857+0000","last_change":"2024-09-19T09:53:47.361857+0000","last_active":"2024-09-19T09:53:47.361857+0000","last_peered":"2024-09-19T09:53:47.361857+0000","last_clean":"2024-09-19T09:53:47.361857+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:53:47.361857+0000","last_undegraded":"2024-09-19T09:53:47.361857+0000","last_fullsized":"2024-09-19T09:53:47.361857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6884","last_scrub_stamp":"2024-09-19T09:53:47.361746+0000","last_deep_scrub":"25'6884","last_deep_scrub_stamp":"2024-09-19T09:53:47.361746+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.361746+0000","objects_scrubbed":0,"log_size":6884,"log_dups_size":0,"ondisk_log_size":6884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:27.972243+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104459,"num_write_kb":1263249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'6119","reported_seq":6149,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.116386+0000","last_change":"2024-09-19T09:53:46.116413+0000","last_active":"2024-09-19T09:53:46.116386+0000","last_peered":"2024-09-19T09:53:46.116386+0000","last_clean":"2024-09-19T09:53:46.116386+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:53:46.116386+0000","last_undegraded":"2024-09-19T09:53:46.116386+0000","last_fullsized":"2024-09-19T09:53:46.116386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6119","last_scrub_stamp":"2024-09-19T09:53:46.116252+0000","last_deep_scrub":"25'6119","last_deep_scrub_stamp":"2024-09-19T09:53:46.116252+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.116252+0000","objects_scrubbed":0,"log_size":6119,"log_dups_size":0,"ondisk_log_size":6119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:35.750241+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93016,"num_write_kb":1127551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'8002","reported_seq":8032,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.281147+0000","last_change":"2024-09-19T09:53:43.281176+0000","last_active":"2024-09-19T09:53:43.281147+0000","last_peered":"2024-09-19T09:53:43.281147+0000","last_clean":"2024-09-19T09:53:43.281147+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:53:43.281147+0000","last_undegraded":"2024-09-19T09:53:43.281147+0000","last_fullsized":"2024-09-19T09:53:43.281147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8002","last_scrub_stamp":"2024-09-19T09:53:43.281052+0000","last_deep_scrub":"25'8002","last_deep_scrub_stamp":"2024-09-19T09:53:43.281052+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.281052+0000","objects_scrubbed":0,"log_size":8002,"log_dups_size":0,"ondisk_log_size":8002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.766100+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121789,"num_write_kb":1510406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'6222","reported_seq":6252,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.141555+0000","last_change":"2024-09-19T09:53:51.141581+0000","last_active":"2024-09-19T09:53:51.141555+0000","last_peered":"2024-09-19T09:53:51.141555+0000","last_clean":"2024-09-19T09:53:51.141555+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:53:51.141555+0000","last_undegraded":"2024-09-19T09:53:51.141555+0000","last_fullsized":"2024-09-19T09:53:51.141555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6222","last_scrub_stamp":"2024-09-19T09:53:51.141443+0000","last_deep_scrub":"25'6222","last_deep_scrub_stamp":"2024-09-19T09:53:51.141443+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.141443+0000","objects_scrubbed":0,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:54.978219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94313,"num_write_kb":1157877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'7393","reported_seq":7423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.130764+0000","last_change":"2024-09-19T09:53:45.130792+0000","last_active":"2024-09-19T09:53:45.130764+0000","last_peered":"2024-09-19T09:53:45.130764+0000","last_clean":"2024-09-19T09:53:45.130764+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:53:45.130764+0000","last_undegraded":"2024-09-19T09:53:45.130764+0000","last_fullsized":"2024-09-19T09:53:45.130764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7393","last_scrub_stamp":"2024-09-19T09:53:45.130660+0000","last_deep_scrub":"25'7393","last_deep_scrub_stamp":"2024-09-19T09:53:45.130660+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.130660+0000","objects_scrubbed":0,"log_size":7393,"log_dups_size":0,"ondisk_log_size":7393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:37.805628+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112469,"num_write_kb":1393395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'6316","reported_seq":6346,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.330095+0000","last_change":"2024-09-19T09:53:46.330128+0000","last_active":"2024-09-19T09:53:46.330095+0000","last_peered":"2024-09-19T09:53:46.330095+0000","last_clean":"2024-09-19T09:53:46.330095+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:53:46.330095+0000","last_undegraded":"2024-09-19T09:53:46.330095+0000","last_fullsized":"2024-09-19T09:53:46.330095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6316","last_scrub_stamp":"2024-09-19T09:53:46.330003+0000","last_deep_scrub":"25'6316","last_deep_scrub_stamp":"2024-09-19T09:53:46.330003+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.330003+0000","objects_scrubbed":0,"log_size":6316,"log_dups_size":0,"ondisk_log_size":6316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:06.489552+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96072,"num_write_kb":1169122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'5905","reported_seq":5935,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.601361+0000","last_change":"2024-09-19T09:53:45.601411+0000","last_active":"2024-09-19T09:53:45.601361+0000","last_peered":"2024-09-19T09:53:45.601361+0000","last_clean":"2024-09-19T09:53:45.601361+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:53:45.601361+0000","last_undegraded":"2024-09-19T09:53:45.601361+0000","last_fullsized":"2024-09-19T09:53:45.601361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5905","last_scrub_stamp":"2024-09-19T09:53:45.601244+0000","last_deep_scrub":"25'5905","last_deep_scrub_stamp":"2024-09-19T09:53:45.601244+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.601244+0000","objects_scrubbed":0,"log_size":5905,"log_dups_size":0,"ondisk_log_size":5905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:58.762559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89887,"num_write_kb":1118423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'8492","reported_seq":8522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.099126+0000","last_change":"2024-09-19T09:53:47.099169+0000","last_active":"2024-09-19T09:53:47.099126+0000","last_peered":"2024-09-19T09:53:47.099126+0000","last_clean":"2024-09-19T09:53:47.099126+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:53:47.099126+0000","last_undegraded":"2024-09-19T09:53:47.099126+0000","last_fullsized":"2024-09-19T09:53:47.099126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8492","last_scrub_stamp":"2024-09-19T09:53:47.098975+0000","last_deep_scrub":"25'8492","last_deep_scrub_stamp":"2024-09-19T09:53:47.098975+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.098975+0000","objects_scrubbed":0,"log_size":8492,"log_dups_size":0,"ondisk_log_size":8492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:50.376559+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129293,"num_write_kb":1558943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'7307","reported_seq":7337,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.947517+0000","last_change":"2024-09-19T09:53:44.947546+0000","last_active":"2024-09-19T09:53:44.947517+0000","last_peered":"2024-09-19T09:53:44.947517+0000","last_clean":"2024-09-19T09:53:44.947517+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:53:44.947517+0000","last_undegraded":"2024-09-19T09:53:44.947517+0000","last_fullsized":"2024-09-19T09:53:44.947517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7307","last_scrub_stamp":"2024-09-19T09:53:44.947416+0000","last_deep_scrub":"25'7307","last_deep_scrub_stamp":"2024-09-19T09:53:44.947416+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.947416+0000","objects_scrubbed":0,"log_size":7307,"log_dups_size":0,"ondisk_log_size":7307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:00.674614+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111025,"num_write_kb":1382740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'8646","reported_seq":8676,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.149325+0000","last_change":"2024-09-19T09:53:47.149353+0000","last_active":"2024-09-19T09:53:47.149325+0000","last_peered":"2024-09-19T09:53:47.149325+0000","last_clean":"2024-09-19T09:53:47.149325+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:53:47.149325+0000","last_undegraded":"2024-09-19T09:53:47.149325+0000","last_fullsized":"2024-09-19T09:53:47.149325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8646","last_scrub_stamp":"2024-09-19T09:53:47.149223+0000","last_deep_scrub":"25'8646","last_deep_scrub_stamp":"2024-09-19T09:53:47.149223+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.149223+0000","objects_scrubbed":0,"log_size":8646,"log_dups_size":0,"ondisk_log_size":8646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:41.692730+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131457,"num_write_kb":1608657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'5972","reported_seq":6001,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.525297+0000","last_change":"2024-09-19T09:53:43.525349+0000","last_active":"2024-09-19T09:53:43.525297+0000","last_peered":"2024-09-19T09:53:43.525297+0000","last_clean":"2024-09-19T09:53:43.525297+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:53:43.525297+0000","last_undegraded":"2024-09-19T09:53:43.525297+0000","last_fullsized":"2024-09-19T09:53:43.525297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5972","last_scrub_stamp":"2024-09-19T09:53:43.525191+0000","last_deep_scrub":"25'5972","last_deep_scrub_stamp":"2024-09-19T09:53:43.525191+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.525191+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:20.828060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90903,"num_write_kb":1098126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1243","reported_seq":1274,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.305106+0000","last_change":"2024-09-19T09:53:42.305130+0000","last_active":"2024-09-19T09:53:42.305106+0000","last_peered":"2024-09-19T09:53:42.305106+0000","last_clean":"2024-09-19T09:53:42.305106+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:53:42.305106+0000","last_undegraded":"2024-09-19T09:53:42.305106+0000","last_fullsized":"2024-09-19T09:53:42.305106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1243","last_scrub_stamp":"2024-09-19T09:53:42.305037+0000","last_deep_scrub":"25'1243","last_deep_scrub_stamp":"2024-09-19T09:53:42.305037+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.305037+0000","objects_scrubbed":1,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:14.618609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":5249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5283","reported_seq":5312,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.608046+0000","last_change":"2024-09-19T09:53:44.608100+0000","last_active":"2024-09-19T09:53:44.608046+0000","last_peered":"2024-09-19T09:53:44.608046+0000","last_clean":"2024-09-19T09:53:44.608046+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:53:44.608046+0000","last_undegraded":"2024-09-19T09:53:44.608046+0000","last_fullsized":"2024-09-19T09:53:44.608046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5283","last_scrub_stamp":"2024-09-19T09:53:44.607942+0000","last_deep_scrub":"25'5283","last_deep_scrub_stamp":"2024-09-19T09:53:44.607942+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.607942+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:28.220742+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80097,"num_write_kb":999347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'47","reported_seq":78,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.268352+0000","last_change":"2024-09-19T09:53:42.268383+0000","last_active":"2024-09-19T09:53:42.268352+0000","last_peered":"2024-09-19T09:53:42.268352+0000","last_clean":"2024-09-19T09:53:42.268352+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:53:42.268352+0000","last_undegraded":"2024-09-19T09:53:42.268352+0000","last_fullsized":"2024-09-19T09:53:42.268352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'47","last_scrub_stamp":"2024-09-19T09:53:42.268279+0000","last_deep_scrub":"25'47","last_deep_scrub_stamp":"2024-09-19T09:53:42.268279+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.268279+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:15.166931+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":16406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.336409+0000","last_change":"2024-09-19T09:53:41.336431+0000","last_active":"2024-09-19T09:53:41.336409+0000","last_peered":"2024-09-19T09:53:41.336409+0000","last_clean":"2024-09-19T09:53:41.336409+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:53:41.336409+0000","last_undegraded":"2024-09-19T09:53:41.336409+0000","last_fullsized":"2024-09-19T09:53:41.336409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-09-19T09:53:41.336288+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-09-19T09:53:41.336288+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.336288+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.532121+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'6896","reported_seq":6925,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.310840+0000","last_change":"2024-09-19T09:53:49.310923+0000","last_active":"2024-09-19T09:53:49.310840+0000","last_peered":"2024-09-19T09:53:49.310840+0000","last_clean":"2024-09-19T09:53:49.310840+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:53:49.310840+0000","last_undegraded":"2024-09-19T09:53:49.310840+0000","last_fullsized":"2024-09-19T09:53:49.310840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6896","last_scrub_stamp":"2024-09-19T09:53:49.310705+0000","last_deep_scrub":"25'6896","last_deep_scrub_stamp":"2024-09-19T09:53:49.310705+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.310705+0000","objects_scrubbed":0,"log_size":6896,"log_dups_size":0,"ondisk_log_size":6896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.346216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104648,"num_write_kb":1287559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'34","reported_seq":65,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.118199+0000","last_change":"2024-09-19T09:53:42.118237+0000","last_active":"2024-09-19T09:53:42.118199+0000","last_peered":"2024-09-19T09:53:42.118199+0000","last_clean":"2024-09-19T09:53:42.118199+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:53:42.118199+0000","last_undegraded":"2024-09-19T09:53:42.118199+0000","last_fullsized":"2024-09-19T09:53:42.118199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'34","last_scrub_stamp":"2024-09-19T09:53:42.118111+0000","last_deep_scrub":"25'34","last_deep_scrub_stamp":"2024-09-19T09:53:42.118111+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.118111+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:03.573257+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'8134","reported_seq":8163,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.183575+0000","last_change":"2024-09-19T09:53:49.183600+0000","last_active":"2024-09-19T09:53:49.183575+0000","last_peered":"2024-09-19T09:53:49.183575+0000","last_clean":"2024-09-19T09:53:49.183575+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:53:49.183575+0000","last_undegraded":"2024-09-19T09:53:49.183575+0000","last_fullsized":"2024-09-19T09:53:49.183575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8134","last_scrub_stamp":"2024-09-19T09:53:49.183491+0000","last_deep_scrub":"25'8134","last_deep_scrub_stamp":"2024-09-19T09:53:49.183491+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.183491+0000","objects_scrubbed":0,"log_size":8134,"log_dups_size":0,"ondisk_log_size":8134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:49.775968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123619,"num_write_kb":1504166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.243138+0000","last_change":"2024-09-19T09:53:43.243188+0000","last_active":"2024-09-19T09:53:43.243138+0000","last_peered":"2024-09-19T09:53:43.243138+0000","last_clean":"2024-09-19T09:53:43.243138+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:53:43.243138+0000","last_undegraded":"2024-09-19T09:53:43.243138+0000","last_fullsized":"2024-09-19T09:53:43.243138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-19T09:53:43.243039+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-19T09:53:43.243039+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.243039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:18.654377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'6995","reported_seq":7024,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:55.071723+0000","last_change":"2024-09-19T09:53:55.071752+0000","last_active":"2024-09-19T09:53:55.071723+0000","last_peered":"2024-09-19T09:53:55.071723+0000","last_clean":"2024-09-19T09:53:55.071723+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:53:55.071723+0000","last_undegraded":"2024-09-19T09:53:55.071723+0000","last_fullsized":"2024-09-19T09:53:55.071723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6995","last_scrub_stamp":"2024-09-19T09:53:55.071621+0000","last_deep_scrub":"25'6995","last_deep_scrub_stamp":"2024-09-19T09:53:55.071621+0000","last_clean_scrub_stamp":"2024-09-19T09:53:55.071621+0000","objects_scrubbed":0,"log_size":6995,"log_dups_size":0,"ondisk_log_size":6995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:29.013733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106286,"num_write_kb":1265589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'29","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.146719+0000","last_change":"2024-09-19T09:53:45.146770+0000","last_active":"2024-09-19T09:53:45.146719+0000","last_peered":"2024-09-19T09:53:45.146719+0000","last_clean":"2024-09-19T09:53:45.146719+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:53:45.146719+0000","last_undegraded":"2024-09-19T09:53:45.146719+0000","last_fullsized":"2024-09-19T09:53:45.146719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'29","last_scrub_stamp":"2024-09-19T09:53:45.146580+0000","last_deep_scrub":"25'29","last_deep_scrub_stamp":"2024-09-19T09:53:45.146580+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.146580+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:18.502466+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'6106","reported_seq":6135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.467216+0000","last_change":"2024-09-19T09:53:48.467239+0000","last_active":"2024-09-19T09:53:48.467216+0000","last_peered":"2024-09-19T09:53:48.467216+0000","last_clean":"2024-09-19T09:53:48.467216+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:53:48.467216+0000","last_undegraded":"2024-09-19T09:53:48.467216+0000","last_fullsized":"2024-09-19T09:53:48.467216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6106","last_scrub_stamp":"2024-09-19T09:53:48.467138+0000","last_deep_scrub":"25'6106","last_deep_scrub_stamp":"2024-09-19T09:53:48.467138+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.467138+0000","objects_scrubbed":0,"log_size":6106,"log_dups_size":0,"ondisk_log_size":6106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:20.977677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92578,"num_write_kb":1120610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'150","reported_seq":181,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.105432+0000","last_change":"2024-09-19T09:53:41.105460+0000","last_active":"2024-09-19T09:53:41.105432+0000","last_peered":"2024-09-19T09:53:41.105432+0000","last_clean":"2024-09-19T09:53:41.105432+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:53:41.105432+0000","last_undegraded":"2024-09-19T09:53:41.105432+0000","last_fullsized":"2024-09-19T09:53:41.105432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'150","last_scrub_stamp":"2024-09-19T09:53:41.105361+0000","last_deep_scrub":"25'150","last_deep_scrub_stamp":"2024-09-19T09:53:41.105361+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.105361+0000","objects_scrubbed":4,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:13.343915+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8082096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9209","reported_seq":9238,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.470034+0000","last_change":"2024-09-19T09:53:45.470081+0000","last_active":"2024-09-19T09:53:45.470034+0000","last_peered":"2024-09-19T09:53:45.470034+0000","last_clean":"2024-09-19T09:53:45.470034+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:53:45.470034+0000","last_undegraded":"2024-09-19T09:53:45.470034+0000","last_fullsized":"2024-09-19T09:53:45.470034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9209","last_scrub_stamp":"2024-09-19T09:53:45.469902+0000","last_deep_scrub":"25'9209","last_deep_scrub_stamp":"2024-09-19T09:53:45.469902+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.469902+0000","objects_scrubbed":0,"log_size":9209,"log_dups_size":0,"ondisk_log_size":9209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:28.415824+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140136,"num_write_kb":1697056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'240","reported_seq":271,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.226596+0000","last_change":"2024-09-19T09:53:44.226631+0000","last_active":"2024-09-19T09:53:44.226596+0000","last_peered":"2024-09-19T09:53:44.226596+0000","last_clean":"2024-09-19T09:53:44.226596+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:53:44.226596+0000","last_undegraded":"2024-09-19T09:53:44.226596+0000","last_fullsized":"2024-09-19T09:53:44.226596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'240","last_scrub_stamp":"2024-09-19T09:53:44.226515+0000","last_deep_scrub":"25'240","last_deep_scrub_stamp":"2024-09-19T09:53:44.226515+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.226515+0000","objects_scrubbed":6,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:58.689377+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'6643","reported_seq":6672,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.150719+0000","last_change":"2024-09-19T09:53:42.150743+0000","last_active":"2024-09-19T09:53:42.150719+0000","last_peered":"2024-09-19T09:53:42.150719+0000","last_clean":"2024-09-19T09:53:42.150719+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:53:42.150719+0000","last_undegraded":"2024-09-19T09:53:42.150719+0000","last_fullsized":"2024-09-19T09:53:42.150719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6643","last_scrub_stamp":"2024-09-19T09:53:42.150639+0000","last_deep_scrub":"25'6643","last_deep_scrub_stamp":"2024-09-19T09:53:42.150639+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.150639+0000","objects_scrubbed":0,"log_size":6643,"log_dups_size":0,"ondisk_log_size":6643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:21.465723+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100932,"num_write_kb":1211662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'18","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.529309+0000","last_change":"2024-09-19T09:53:39.529337+0000","last_active":"2024-09-19T09:53:39.529309+0000","last_peered":"2024-09-19T09:53:39.529309+0000","last_clean":"2024-09-19T09:53:39.529309+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:53:39.529309+0000","last_undegraded":"2024-09-19T09:53:39.529309+0000","last_fullsized":"2024-09-19T09:53:39.529309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'18","last_scrub_stamp":"2024-09-19T09:53:39.529243+0000","last_deep_scrub":"25'18","last_deep_scrub_stamp":"2024-09-19T09:53:39.529243+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.529243+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:28.598014+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'6603","reported_seq":6632,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.510778+0000","last_change":"2024-09-19T09:53:50.510806+0000","last_active":"2024-09-19T09:53:50.510778+0000","last_peered":"2024-09-19T09:53:50.510778+0000","last_clean":"2024-09-19T09:53:50.510778+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:53:50.510778+0000","last_undegraded":"2024-09-19T09:53:50.510778+0000","last_fullsized":"2024-09-19T09:53:50.510778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6603","last_scrub_stamp":"2024-09-19T09:53:50.510677+0000","last_deep_scrub":"25'6603","last_deep_scrub_stamp":"2024-09-19T09:53:50.510677+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.510677+0000","objects_scrubbed":0,"log_size":6603,"log_dups_size":0,"ondisk_log_size":6603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:15.336038+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100178,"num_write_kb":1211527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.083320+0000","last_change":"2024-09-19T09:53:44.083376+0000","last_active":"2024-09-19T09:53:44.083320+0000","last_peered":"2024-09-19T09:53:44.083320+0000","last_clean":"2024-09-19T09:53:44.083320+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:53:44.083320+0000","last_undegraded":"2024-09-19T09:53:44.083320+0000","last_fullsized":"2024-09-19T09:53:44.083320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-09-19T09:53:44.083186+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-09-19T09:53:44.083186+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.083186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:22.693601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'7772","reported_seq":7793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.804250+0000","last_change":"2024-09-19T09:42:37.527515+0000","last_active":"2024-09-19T09:53:35.804250+0000","last_peered":"2024-09-19T09:53:35.804250+0000","last_clean":"2024-09-19T09:53:35.804250+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:53:35.804250+0000","last_undegraded":"2024-09-19T09:53:35.804250+0000","last_fullsized":"2024-09-19T09:53:35.804250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":7772,"log_dups_size":0,"ondisk_log_size":7772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118022,"num_write_kb":1435104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.212210+0000","last_change":"2024-09-19T09:53:41.212233+0000","last_active":"2024-09-19T09:53:41.212210+0000","last_peered":"2024-09-19T09:53:41.212210+0000","last_clean":"2024-09-19T09:53:41.212210+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:53:41.212210+0000","last_undegraded":"2024-09-19T09:53:41.212210+0000","last_fullsized":"2024-09-19T09:53:41.212210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-09-19T09:53:41.212117+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-09-19T09:53:41.212117+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.212117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:20.436321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'7347","reported_seq":7376,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.204561+0000","last_change":"2024-09-19T09:53:49.204584+0000","last_active":"2024-09-19T09:53:49.204561+0000","last_peered":"2024-09-19T09:53:49.204561+0000","last_clean":"2024-09-19T09:53:49.204561+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:53:49.204561+0000","last_undegraded":"2024-09-19T09:53:49.204561+0000","last_fullsized":"2024-09-19T09:53:49.204561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7347","last_scrub_stamp":"2024-09-19T09:53:49.204473+0000","last_deep_scrub":"25'7347","last_deep_scrub_stamp":"2024-09-19T09:53:49.204473+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.204473+0000","objects_scrubbed":0,"log_size":7347,"log_dups_size":0,"ondisk_log_size":7347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.549385+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111551,"num_write_kb":1366296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'42","reported_seq":73,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.923420+0000","last_change":"2024-09-19T09:53:39.923474+0000","last_active":"2024-09-19T09:53:39.923420+0000","last_peered":"2024-09-19T09:53:39.923420+0000","last_clean":"2024-09-19T09:53:39.923420+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:53:39.923420+0000","last_undegraded":"2024-09-19T09:53:39.923420+0000","last_fullsized":"2024-09-19T09:53:39.923420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'42","last_scrub_stamp":"2024-09-19T09:53:39.923314+0000","last_deep_scrub":"25'42","last_deep_scrub_stamp":"2024-09-19T09:53:39.923314+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.923314+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:31.879696+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'6691","reported_seq":6720,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.366814+0000","last_change":"2024-09-19T09:53:50.366842+0000","last_active":"2024-09-19T09:53:50.366814+0000","last_peered":"2024-09-19T09:53:50.366814+0000","last_clean":"2024-09-19T09:53:50.366814+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:53:50.366814+0000","last_undegraded":"2024-09-19T09:53:50.366814+0000","last_fullsized":"2024-09-19T09:53:50.366814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6691","last_scrub_stamp":"2024-09-19T09:53:50.366683+0000","last_deep_scrub":"25'6691","last_deep_scrub_stamp":"2024-09-19T09:53:50.366683+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.366683+0000","objects_scrubbed":0,"log_size":6691,"log_dups_size":0,"ondisk_log_size":6691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:08.657128+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101427,"num_write_kb":1285780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'19","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.470246+0000","last_change":"2024-09-19T09:53:40.470246+0000","last_active":"2024-09-19T09:53:40.470246+0000","last_peered":"2024-09-19T09:53:40.470246+0000","last_clean":"2024-09-19T09:53:40.470246+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:53:40.470246+0000","last_undegraded":"2024-09-19T09:53:40.470246+0000","last_fullsized":"2024-09-19T09:53:40.470246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2024-09-19T09:53:40.470117+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2024-09-19T09:53:40.470117+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.470117+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:29.570904+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'6802","reported_seq":6825,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.243669+0000","last_change":"2024-09-19T09:53:51.243700+0000","last_active":"2024-09-19T09:53:51.243669+0000","last_peered":"2024-09-19T09:53:51.243669+0000","last_clean":"2024-09-19T09:53:51.243669+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:53:51.243669+0000","last_undegraded":"2024-09-19T09:53:51.243669+0000","last_fullsized":"2024-09-19T09:53:51.243669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6802","last_scrub_stamp":"2024-09-19T09:53:51.243568+0000","last_deep_scrub":"25'6802","last_deep_scrub_stamp":"2024-09-19T09:53:51.243568+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.243568+0000","objects_scrubbed":0,"log_size":6802,"log_dups_size":0,"ondisk_log_size":6802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:10.705240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103611,"num_write_kb":1225908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"25'21","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.866230+0000","last_change":"2024-09-19T09:53:42.866230+0000","last_active":"2024-09-19T09:53:42.866230+0000","last_peered":"2024-09-19T09:53:42.866230+0000","last_clean":"2024-09-19T09:53:42.866230+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:53:42.866230+0000","last_undegraded":"2024-09-19T09:53:42.866230+0000","last_fullsized":"2024-09-19T09:53:42.866230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2024-09-19T09:53:42.866124+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2024-09-19T09:53:42.866124+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.866124+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:08.320435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'8081","reported_seq":8102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:35.842456+0000","last_change":"2024-09-19T09:42:37.527500+0000","last_active":"2024-09-19T09:53:35.842456+0000","last_peered":"2024-09-19T09:53:35.842456+0000","last_clean":"2024-09-19T09:53:35.842456+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:53:35.842456+0000","last_undegraded":"2024-09-19T09:53:35.842456+0000","last_fullsized":"2024-09-19T09:53:35.842456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:42:36.478070+0000","last_clean_scrub_stamp":"2024-09-19T09:42:36.478070+0000","objects_scrubbed":0,"log_size":8081,"log_dups_size":0,"ondisk_log_size":8081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122842,"num_write_kb":1473778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.128775+0000","last_change":"2024-09-19T09:53:43.128775+0000","last_active":"2024-09-19T09:53:43.128775+0000","last_peered":"2024-09-19T09:53:43.128775+0000","last_clean":"2024-09-19T09:53:43.128775+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:53:43.128775+0000","last_undegraded":"2024-09-19T09:53:43.128775+0000","last_fullsized":"2024-09-19T09:53:43.128775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:43.128627+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:43.128627+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.128627+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:58.899895+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'7130","reported_seq":7153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.963533+0000","last_change":"2024-09-19T09:53:45.963561+0000","last_active":"2024-09-19T09:53:45.963533+0000","last_peered":"2024-09-19T09:53:45.963533+0000","last_clean":"2024-09-19T09:53:45.963533+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:53:45.963533+0000","last_undegraded":"2024-09-19T09:53:45.963533+0000","last_fullsized":"2024-09-19T09:53:45.963533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7130","last_scrub_stamp":"2024-09-19T09:53:45.963405+0000","last_deep_scrub":"25'7130","last_deep_scrub_stamp":"2024-09-19T09:53:45.963405+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.963405+0000","objects_scrubbed":0,"log_size":7130,"log_dups_size":0,"ondisk_log_size":7130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.304205+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108281,"num_write_kb":1344761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.906975+0000","last_change":"2024-09-19T09:53:41.906975+0000","last_active":"2024-09-19T09:53:41.906975+0000","last_peered":"2024-09-19T09:53:41.906975+0000","last_clean":"2024-09-19T09:53:41.906975+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:53:41.906975+0000","last_undegraded":"2024-09-19T09:53:41.906975+0000","last_fullsized":"2024-09-19T09:53:41.906975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:41.906839+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:41.906839+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.906839+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:33.324470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'6859","reported_seq":6889,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:53.380941+0000","last_change":"2024-09-19T09:53:53.380941+0000","last_active":"2024-09-19T09:53:53.380941+0000","last_peered":"2024-09-19T09:53:53.380941+0000","last_clean":"2024-09-19T09:53:53.380941+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:53:53.380941+0000","last_undegraded":"2024-09-19T09:53:53.380941+0000","last_fullsized":"2024-09-19T09:53:53.380941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6859","last_scrub_stamp":"2024-09-19T09:53:53.380809+0000","last_deep_scrub":"25'6859","last_deep_scrub_stamp":"2024-09-19T09:53:53.380809+0000","last_clean_scrub_stamp":"2024-09-19T09:53:53.380809+0000","objects_scrubbed":0,"log_size":6859,"log_dups_size":0,"ondisk_log_size":6859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:12.715015+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104241,"num_write_kb":1288428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":190,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.193758+0000","last_change":"2024-09-19T09:53:43.193800+0000","last_active":"2024-09-19T09:53:43.193758+0000","last_peered":"2024-09-19T09:53:43.193758+0000","last_clean":"2024-09-19T09:53:43.193758+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:53:43.193758+0000","last_undegraded":"2024-09-19T09:53:43.193758+0000","last_fullsized":"2024-09-19T09:53:43.193758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-09-19T09:53:43.193671+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-09-19T09:53:43.193671+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.193671+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:55.280864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.137783+0000","last_change":"2024-09-19T09:53:41.137815+0000","last_active":"2024-09-19T09:53:41.137783+0000","last_peered":"2024-09-19T09:53:41.137783+0000","last_clean":"2024-09-19T09:53:41.137783+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:53:41.137783+0000","last_undegraded":"2024-09-19T09:53:41.137783+0000","last_fullsized":"2024-09-19T09:53:41.137783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-09-19T09:53:41.137692+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-09-19T09:53:41.137692+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.137692+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:04.710702+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'7194","reported_seq":7224,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.310454+0000","last_change":"2024-09-19T09:53:51.310479+0000","last_active":"2024-09-19T09:53:51.310454+0000","last_peered":"2024-09-19T09:53:51.310454+0000","last_clean":"2024-09-19T09:53:51.310454+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:53:51.310454+0000","last_undegraded":"2024-09-19T09:53:51.310454+0000","last_fullsized":"2024-09-19T09:53:51.310454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7194","last_scrub_stamp":"2024-09-19T09:53:51.310356+0000","last_deep_scrub":"25'7194","last_deep_scrub_stamp":"2024-09-19T09:53:51.310356+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.310356+0000","objects_scrubbed":0,"log_size":7194,"log_dups_size":0,"ondisk_log_size":7194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:12.577632+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109665,"num_write_kb":1344078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'54","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.301470+0000","last_change":"2024-09-19T09:53:46.301499+0000","last_active":"2024-09-19T09:53:46.301470+0000","last_peered":"2024-09-19T09:53:46.301470+0000","last_clean":"2024-09-19T09:53:46.301470+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:53:46.301470+0000","last_undegraded":"2024-09-19T09:53:46.301470+0000","last_fullsized":"2024-09-19T09:53:46.301470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'54","last_scrub_stamp":"2024-09-19T09:53:46.301388+0000","last_deep_scrub":"25'54","last_deep_scrub_stamp":"2024-09-19T09:53:46.301388+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.301388+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:14.280813+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'6526","reported_seq":6556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.632208+0000","last_change":"2024-09-19T09:53:42.632252+0000","last_active":"2024-09-19T09:53:42.632208+0000","last_peered":"2024-09-19T09:53:42.632208+0000","last_clean":"2024-09-19T09:53:42.632208+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:53:42.632208+0000","last_undegraded":"2024-09-19T09:53:42.632208+0000","last_fullsized":"2024-09-19T09:53:42.632208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6526","last_scrub_stamp":"2024-09-19T09:53:42.632123+0000","last_deep_scrub":"25'6526","last_deep_scrub_stamp":"2024-09-19T09:53:42.632123+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.632123+0000","objects_scrubbed":0,"log_size":6526,"log_dups_size":0,"ondisk_log_size":6526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:07.465583+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99242,"num_write_kb":1260349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'27","reported_seq":83,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.854545+0000","last_change":"2024-09-19T09:53:40.854570+0000","last_active":"2024-09-19T09:53:40.854545+0000","last_peered":"2024-09-19T09:53:40.854545+0000","last_clean":"2024-09-19T09:53:40.854545+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:53:40.854545+0000","last_undegraded":"2024-09-19T09:53:40.854545+0000","last_fullsized":"2024-09-19T09:53:40.854545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'27","last_scrub_stamp":"2024-09-19T09:53:40.854471+0000","last_deep_scrub":"25'27","last_deep_scrub_stamp":"2024-09-19T09:53:40.854471+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.854471+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:48.024788+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":24,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'6593","reported_seq":6623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.137296+0000","last_change":"2024-09-19T09:53:46.137326+0000","last_active":"2024-09-19T09:53:46.137296+0000","last_peered":"2024-09-19T09:53:46.137296+0000","last_clean":"2024-09-19T09:53:46.137296+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:53:46.137296+0000","last_undegraded":"2024-09-19T09:53:46.137296+0000","last_fullsized":"2024-09-19T09:53:46.137296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6593","last_scrub_stamp":"2024-09-19T09:53:46.137199+0000","last_deep_scrub":"25'6593","last_deep_scrub_stamp":"2024-09-19T09:53:46.137199+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.137199+0000","objects_scrubbed":0,"log_size":6593,"log_dups_size":0,"ondisk_log_size":6593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:45.659855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99779,"num_write_kb":1243684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'22","reported_seq":54,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.062876+0000","last_change":"2024-09-19T09:53:43.062931+0000","last_active":"2024-09-19T09:53:43.062876+0000","last_peered":"2024-09-19T09:53:43.062876+0000","last_clean":"2024-09-19T09:53:43.062876+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:53:43.062876+0000","last_undegraded":"2024-09-19T09:53:43.062876+0000","last_fullsized":"2024-09-19T09:53:43.062876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'22","last_scrub_stamp":"2024-09-19T09:53:43.062768+0000","last_deep_scrub":"25'22","last_deep_scrub_stamp":"2024-09-19T09:53:43.062768+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.062768+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:07.932088+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6382","reported_seq":6412,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.513253+0000","last_change":"2024-09-19T09:53:44.513283+0000","last_active":"2024-09-19T09:53:44.513253+0000","last_peered":"2024-09-19T09:53:44.513253+0000","last_clean":"2024-09-19T09:53:44.513253+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:53:44.513253+0000","last_undegraded":"2024-09-19T09:53:44.513253+0000","last_fullsized":"2024-09-19T09:53:44.513253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6382","last_scrub_stamp":"2024-09-19T09:53:44.513152+0000","last_deep_scrub":"25'6382","last_deep_scrub_stamp":"2024-09-19T09:53:44.513152+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.513152+0000","objects_scrubbed":0,"log_size":6382,"log_dups_size":0,"ondisk_log_size":6382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:12.033615+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97075,"num_write_kb":1245753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'18","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.090491+0000","last_change":"2024-09-19T09:53:40.090522+0000","last_active":"2024-09-19T09:53:40.090491+0000","last_peered":"2024-09-19T09:53:40.090491+0000","last_clean":"2024-09-19T09:53:40.090491+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:53:40.090491+0000","last_undegraded":"2024-09-19T09:53:40.090491+0000","last_fullsized":"2024-09-19T09:53:40.090491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'18","last_scrub_stamp":"2024-09-19T09:53:40.090423+0000","last_deep_scrub":"25'18","last_deep_scrub_stamp":"2024-09-19T09:53:40.090423+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.090423+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:33.209448+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5988","reported_seq":6018,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:53.129102+0000","last_change":"2024-09-19T09:53:53.129139+0000","last_active":"2024-09-19T09:53:53.129102+0000","last_peered":"2024-09-19T09:53:53.129102+0000","last_clean":"2024-09-19T09:53:53.129102+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:53:53.129102+0000","last_undegraded":"2024-09-19T09:53:53.129102+0000","last_fullsized":"2024-09-19T09:53:53.129102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5988","last_scrub_stamp":"2024-09-19T09:53:53.128974+0000","last_deep_scrub":"25'5988","last_deep_scrub_stamp":"2024-09-19T09:53:53.128974+0000","last_clean_scrub_stamp":"2024-09-19T09:53:53.128974+0000","objects_scrubbed":0,"log_size":5988,"log_dups_size":0,"ondisk_log_size":5988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:26.452182+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90916,"num_write_kb":1171530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.345952+0000","last_change":"2024-09-19T09:53:48.345984+0000","last_active":"2024-09-19T09:53:48.345952+0000","last_peered":"2024-09-19T09:53:48.345952+0000","last_clean":"2024-09-19T09:53:48.345952+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:53:48.345952+0000","last_undegraded":"2024-09-19T09:53:48.345952+0000","last_fullsized":"2024-09-19T09:53:48.345952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:48.345862+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:48.345862+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.345862+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:23.441391+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7106","reported_seq":7136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.183930+0000","last_change":"2024-09-19T09:53:47.183972+0000","last_active":"2024-09-19T09:53:47.183930+0000","last_peered":"2024-09-19T09:53:47.183930+0000","last_clean":"2024-09-19T09:53:47.183930+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:53:47.183930+0000","last_undegraded":"2024-09-19T09:53:47.183930+0000","last_fullsized":"2024-09-19T09:53:47.183930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7106","last_scrub_stamp":"2024-09-19T09:53:47.183808+0000","last_deep_scrub":"25'7106","last_deep_scrub_stamp":"2024-09-19T09:53:47.183808+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.183808+0000","objects_scrubbed":0,"log_size":7106,"log_dups_size":0,"ondisk_log_size":7106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:52.970871+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107857,"num_write_kb":1353549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'251","reported_seq":283,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.102072+0000","last_change":"2024-09-19T09:53:39.102122+0000","last_active":"2024-09-19T09:53:39.102072+0000","last_peered":"2024-09-19T09:53:39.102072+0000","last_clean":"2024-09-19T09:53:39.102072+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:53:39.102072+0000","last_undegraded":"2024-09-19T09:53:39.102072+0000","last_fullsized":"2024-09-19T09:53:39.102072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'251","last_scrub_stamp":"2024-09-19T09:53:39.101982+0000","last_deep_scrub":"25'251","last_deep_scrub_stamp":"2024-09-19T09:53:39.101982+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.101982+0000","objects_scrubbed":1,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:28.149413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'6910","reported_seq":6940,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.348809+0000","last_change":"2024-09-19T09:53:52.348836+0000","last_active":"2024-09-19T09:53:52.348809+0000","last_peered":"2024-09-19T09:53:52.348809+0000","last_clean":"2024-09-19T09:53:52.348809+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:53:52.348809+0000","last_undegraded":"2024-09-19T09:53:52.348809+0000","last_fullsized":"2024-09-19T09:53:52.348809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6910","last_scrub_stamp":"2024-09-19T09:53:52.348661+0000","last_deep_scrub":"25'6910","last_deep_scrub_stamp":"2024-09-19T09:53:52.348661+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.348661+0000","objects_scrubbed":0,"log_size":6910,"log_dups_size":0,"ondisk_log_size":6910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:06.751027+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104946,"num_write_kb":1269889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'10","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.227735+0000","last_change":"2024-09-19T09:53:45.227763+0000","last_active":"2024-09-19T09:53:45.227735+0000","last_peered":"2024-09-19T09:53:45.227735+0000","last_clean":"2024-09-19T09:53:45.227735+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:53:45.227735+0000","last_undegraded":"2024-09-19T09:53:45.227735+0000","last_fullsized":"2024-09-19T09:53:45.227735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-09-19T09:53:45.227652+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-09-19T09:53:45.227652+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.227652+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:07.236564+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'5820","reported_seq":5850,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.602240+0000","last_change":"2024-09-19T09:53:41.602262+0000","last_active":"2024-09-19T09:53:41.602240+0000","last_peered":"2024-09-19T09:53:41.602240+0000","last_clean":"2024-09-19T09:53:41.602240+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:53:41.602240+0000","last_undegraded":"2024-09-19T09:53:41.602240+0000","last_fullsized":"2024-09-19T09:53:41.602240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5820","last_scrub_stamp":"2024-09-19T09:53:41.602151+0000","last_deep_scrub":"25'5820","last_deep_scrub_stamp":"2024-09-19T09:53:41.602151+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.602151+0000","objects_scrubbed":0,"log_size":5820,"log_dups_size":0,"ondisk_log_size":5820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:49.957783+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88305,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'15","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.314747+0000","last_change":"2024-09-19T09:53:47.314778+0000","last_active":"2024-09-19T09:53:47.314747+0000","last_peered":"2024-09-19T09:53:47.314747+0000","last_clean":"2024-09-19T09:53:47.314747+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:53:47.314747+0000","last_undegraded":"2024-09-19T09:53:47.314747+0000","last_fullsized":"2024-09-19T09:53:47.314747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-09-19T09:53:47.314625+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-09-19T09:53:47.314625+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.314625+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:07.117144+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'6612","reported_seq":6642,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.482148+0000","last_change":"2024-09-19T09:53:41.482175+0000","last_active":"2024-09-19T09:53:41.482148+0000","last_peered":"2024-09-19T09:53:41.482148+0000","last_clean":"2024-09-19T09:53:41.482148+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:53:41.482148+0000","last_undegraded":"2024-09-19T09:53:41.482148+0000","last_fullsized":"2024-09-19T09:53:41.482148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6612","last_scrub_stamp":"2024-09-19T09:53:41.482053+0000","last_deep_scrub":"25'6612","last_deep_scrub_stamp":"2024-09-19T09:53:41.482053+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.482053+0000","objects_scrubbed":0,"log_size":6612,"log_dups_size":0,"ondisk_log_size":6612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:22.854949+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100566,"num_write_kb":1195835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.103347+0000","last_change":"2024-09-19T09:53:42.103372+0000","last_active":"2024-09-19T09:53:42.103347+0000","last_peered":"2024-09-19T09:53:42.103347+0000","last_clean":"2024-09-19T09:53:42.103347+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:53:42.103347+0000","last_undegraded":"2024-09-19T09:53:42.103347+0000","last_fullsized":"2024-09-19T09:53:42.103347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:42.103272+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:42.103272+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.103272+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:12.339198+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'6882","reported_seq":6905,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.919999+0000","last_change":"2024-09-19T09:53:46.920049+0000","last_active":"2024-09-19T09:53:46.919999+0000","last_peered":"2024-09-19T09:53:46.919999+0000","last_clean":"2024-09-19T09:53:46.919999+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:53:46.919999+0000","last_undegraded":"2024-09-19T09:53:46.919999+0000","last_fullsized":"2024-09-19T09:53:46.919999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6882","last_scrub_stamp":"2024-09-19T09:53:46.919880+0000","last_deep_scrub":"25'6882","last_deep_scrub_stamp":"2024-09-19T09:53:46.919880+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.919880+0000","objects_scrubbed":0,"log_size":6882,"log_dups_size":0,"ondisk_log_size":6882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:59.179776+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104802,"num_write_kb":1303037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"25'22","reported_seq":54,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.137729+0000","last_change":"2024-09-19T09:53:44.137764+0000","last_active":"2024-09-19T09:53:44.137729+0000","last_peered":"2024-09-19T09:53:44.137729+0000","last_clean":"2024-09-19T09:53:44.137729+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:53:44.137729+0000","last_undegraded":"2024-09-19T09:53:44.137729+0000","last_fullsized":"2024-09-19T09:53:44.137729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'22","last_scrub_stamp":"2024-09-19T09:53:44.137621+0000","last_deep_scrub":"25'22","last_deep_scrub_stamp":"2024-09-19T09:53:44.137621+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.137621+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:11.402883+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'5981","reported_seq":6011,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.315789+0000","last_change":"2024-09-19T09:53:50.315817+0000","last_active":"2024-09-19T09:53:50.315789+0000","last_peered":"2024-09-19T09:53:50.315789+0000","last_clean":"2024-09-19T09:53:50.315789+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:53:50.315789+0000","last_undegraded":"2024-09-19T09:53:50.315789+0000","last_fullsized":"2024-09-19T09:53:50.315789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5981","last_scrub_stamp":"2024-09-19T09:53:50.315660+0000","last_deep_scrub":"25'5981","last_deep_scrub_stamp":"2024-09-19T09:53:50.315660+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.315660+0000","objects_scrubbed":0,"log_size":5981,"log_dups_size":0,"ondisk_log_size":5981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:53.240928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91144,"num_write_kb":1060104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'185","reported_seq":217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.253890+0000","last_change":"2024-09-19T09:53:44.253890+0000","last_active":"2024-09-19T09:53:44.253890+0000","last_peered":"2024-09-19T09:53:44.253890+0000","last_clean":"2024-09-19T09:53:44.253890+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:53:44.253890+0000","last_undegraded":"2024-09-19T09:53:44.253890+0000","last_fullsized":"2024-09-19T09:53:44.253890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'185","last_scrub_stamp":"2024-09-19T09:53:44.253618+0000","last_deep_scrub":"25'185","last_deep_scrub_stamp":"2024-09-19T09:53:44.253618+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.253618+0000","objects_scrubbed":4,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:48.772471+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'6191","reported_seq":6221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.164944+0000","last_change":"2024-09-19T09:53:48.164968+0000","last_active":"2024-09-19T09:53:48.164944+0000","last_peered":"2024-09-19T09:53:48.164944+0000","last_clean":"2024-09-19T09:53:48.164944+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:53:48.164944+0000","last_undegraded":"2024-09-19T09:53:48.164944+0000","last_fullsized":"2024-09-19T09:53:48.164944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6191","last_scrub_stamp":"2024-09-19T09:53:48.164814+0000","last_deep_scrub":"25'6191","last_deep_scrub_stamp":"2024-09-19T09:53:48.164814+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.164814+0000","objects_scrubbed":0,"log_size":6191,"log_dups_size":0,"ondisk_log_size":6191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:12.035535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94126,"num_write_kb":1169732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'8374","reported_seq":8397,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.910236+0000","last_change":"2024-09-19T09:53:47.910266+0000","last_active":"2024-09-19T09:53:47.910236+0000","last_peered":"2024-09-19T09:53:47.910236+0000","last_clean":"2024-09-19T09:53:47.910236+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:53:47.910236+0000","last_undegraded":"2024-09-19T09:53:47.910236+0000","last_fullsized":"2024-09-19T09:53:47.910236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8374","last_scrub_stamp":"2024-09-19T09:53:47.910136+0000","last_deep_scrub":"25'8374","last_deep_scrub_stamp":"2024-09-19T09:53:47.910136+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.910136+0000","objects_scrubbed":0,"log_size":8374,"log_dups_size":0,"ondisk_log_size":8374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:42.299339+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127388,"num_write_kb":1561891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.246744+0000","last_change":"2024-09-19T09:53:45.246775+0000","last_active":"2024-09-19T09:53:45.246744+0000","last_peered":"2024-09-19T09:53:45.246744+0000","last_clean":"2024-09-19T09:53:45.246744+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:53:45.246744+0000","last_undegraded":"2024-09-19T09:53:45.246744+0000","last_fullsized":"2024-09-19T09:53:45.246744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-09-19T09:53:45.246625+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-09-19T09:53:45.246625+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.246625+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:18.786923+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5056","reported_seq":5085,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.079311+0000","last_change":"2024-09-19T09:53:50.079338+0000","last_active":"2024-09-19T09:53:50.079311+0000","last_peered":"2024-09-19T09:53:50.079311+0000","last_clean":"2024-09-19T09:53:50.079311+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:53:50.079311+0000","last_undegraded":"2024-09-19T09:53:50.079311+0000","last_fullsized":"2024-09-19T09:53:50.079311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5056","last_scrub_stamp":"2024-09-19T09:53:50.079212+0000","last_deep_scrub":"25'5056","last_deep_scrub_stamp":"2024-09-19T09:53:50.079212+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.079212+0000","objects_scrubbed":0,"log_size":5056,"log_dups_size":0,"ondisk_log_size":5056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:14.016431+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76792,"num_write_kb":903119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'53","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.362128+0000","last_change":"2024-09-19T09:53:49.362162+0000","last_active":"2024-09-19T09:53:49.362128+0000","last_peered":"2024-09-19T09:53:49.362128+0000","last_clean":"2024-09-19T09:53:49.362128+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:53:49.362128+0000","last_undegraded":"2024-09-19T09:53:49.362128+0000","last_fullsized":"2024-09-19T09:53:49.362128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'53","last_scrub_stamp":"2024-09-19T09:53:49.362045+0000","last_deep_scrub":"25'53","last_deep_scrub_stamp":"2024-09-19T09:53:49.362045+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.362045+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:16.268942+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":16399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'8300","reported_seq":8330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.517919+0000","last_change":"2024-09-19T09:53:47.517942+0000","last_active":"2024-09-19T09:53:47.517919+0000","last_peered":"2024-09-19T09:53:47.517919+0000","last_clean":"2024-09-19T09:53:47.517919+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:53:47.517919+0000","last_undegraded":"2024-09-19T09:53:47.517919+0000","last_fullsized":"2024-09-19T09:53:47.517919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8300","last_scrub_stamp":"2024-09-19T09:53:47.517743+0000","last_deep_scrub":"25'8300","last_deep_scrub_stamp":"2024-09-19T09:53:47.517743+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.517743+0000","objects_scrubbed":0,"log_size":8300,"log_dups_size":0,"ondisk_log_size":8300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:00.510835+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125930,"num_write_kb":1569689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'28","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.384465+0000","last_change":"2024-09-19T09:53:40.384513+0000","last_active":"2024-09-19T09:53:40.384465+0000","last_peered":"2024-09-19T09:53:40.384465+0000","last_clean":"2024-09-19T09:53:40.384465+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:53:40.384465+0000","last_undegraded":"2024-09-19T09:53:40.384465+0000","last_fullsized":"2024-09-19T09:53:40.384465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'28","last_scrub_stamp":"2024-09-19T09:53:40.384385+0000","last_deep_scrub":"25'28","last_deep_scrub_stamp":"2024-09-19T09:53:40.384385+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.384385+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:47.412653+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'7286","reported_seq":7316,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.277427+0000","last_change":"2024-09-19T09:53:44.277453+0000","last_active":"2024-09-19T09:53:44.277427+0000","last_peered":"2024-09-19T09:53:44.277427+0000","last_clean":"2024-09-19T09:53:44.277427+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:53:44.277427+0000","last_undegraded":"2024-09-19T09:53:44.277427+0000","last_fullsized":"2024-09-19T09:53:44.277427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7286","last_scrub_stamp":"2024-09-19T09:53:44.277305+0000","last_deep_scrub":"25'7286","last_deep_scrub_stamp":"2024-09-19T09:53:44.277305+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.277305+0000","objects_scrubbed":0,"log_size":7286,"log_dups_size":0,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:20.260190+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110915,"num_write_kb":1387536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'25","reported_seq":57,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.568347+0000","last_change":"2024-09-19T09:53:40.568399+0000","last_active":"2024-09-19T09:53:40.568347+0000","last_peered":"2024-09-19T09:53:40.568347+0000","last_clean":"2024-09-19T09:53:40.568347+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:53:40.568347+0000","last_undegraded":"2024-09-19T09:53:40.568347+0000","last_fullsized":"2024-09-19T09:53:40.568347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'25","last_scrub_stamp":"2024-09-19T09:53:40.568257+0000","last_deep_scrub":"25'25","last_deep_scrub_stamp":"2024-09-19T09:53:40.568257+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.568257+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:30.131143+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6761782,"num_write_kb":82954764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":444924,"ondisk_log_size":444924,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":209498148,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":2660,"num_write_kb":206607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":419061760,"data_stored":418996296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2653,"ondisk_log_size":2653,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509581,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705108,"kb_used_data":78660,"kb_used_omap":1,"kb_used_meta":626430,"kb_avail":93666732,"statfs":{"total":96636764160,"available":95914733568,"internally_reserved":0,"allocated":80547840,"data_stored":80376143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":641464778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443924,"kb_used_data":61700,"kb_used_omap":1,"kb_used_meta":382206,"kb_avail":93927916,"statfs":{"total":96636764160,"available":96182185984,"internally_reserved":0,"allocated":63180800,"data_stored":63008649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":391379398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653352,"kb_used_data":49112,"kb_used_omap":1,"kb_used_meta":604222,"kb_avail":93718488,"statfs":{"total":96636764160,"available":95967731712,"internally_reserved":0,"allocated":50290688,"data_stored":50118553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618723781},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":679896,"kb_used_data":57608,"kb_used_omap":1,"kb_used_meta":622270,"kb_avail":93691944,"statfs":{"total":96636764160,"available":95940550656,"internally_reserved":0,"allocated":58990592,"data_stored":58813799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":637204933},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509577,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":649708,"kb_used_data":41308,"kb_used_omap":1,"kb_used_meta":608382,"kb_avail":93722132,"statfs":{"total":96636764160,"available":95971463168,"internally_reserved":0,"allocated":42299392,"data_stored":42125209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":622983623},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509580,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435372,"kb_used_data":57308,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93936468,"statfs":{"total":96636764160,"available":96190943232,"internally_reserved":0,"allocated":58683392,"data_stored":58507231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":387119557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509580,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":672412,"kb_used_data":45900,"kb_used_omap":1,"kb_used_meta":626494,"kb_avail":93699428,"statfs":{"total":96636764160,"available":95948214272,"internally_reserved":0,"allocated":47001600,"data_stored":46821767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":641530310},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421092,"kb_used_data":20820,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93950748,"statfs":{"total":96636764160,"available":96205565952,"internally_reserved":0,"allocated":21319680,"data_stored":21153017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":409860549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58425344,"data_stored":58413814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":21059600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42041344,"data_stored":42031792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58732544,"data_stored":58720382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50032640,"data_stored":50025136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:54:02.285 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:54:02.286 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:54:02.286 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T09:42:36.478070+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=9, tm_min=53, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T09:54:02.286 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T09:54:04.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:54:04.163 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:54:22.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:54:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.401+0000 7f56a5642640 1 Processor -- start 2024-09-19T09:54:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.401+0000 7f56a5642640 1 -- start start 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f56a5642640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56a014f9b0 0x7f56a00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f56a5642640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f56a00b4d00 0x7f56a0159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f56a5642640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a00c4020 con 0x7f56a00c9d70 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f56a5642640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f56a00c42c0 con 0x7f56a014f9b0 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f56a5642640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f56a0158f20 con 0x7f56a00b4d00 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f569effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56a014f9b0 0x7f56a00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f569effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56a014f9b0 0x7f56a00c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42838/0 (socket says 172.21.15.123:42838) 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f569e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f56a00c9d70 0x7f56a0071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32874/0 (socket says 172.21.15.123:32874) 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.402+0000 7f569effd640 1 -- 172.21.15.123:0/515779920 learned_addr learned my addr 172.21.15.123:0/515779920 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569f7fe640 1 --2- 172.21.15.123:0/515779920 >> v2:172.21.15.194:3300/0 conn(0x7f56a00b4d00 0x7f56a0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569effd640 1 -- 172.21.15.123:0/515779920 >> v2:172.21.15.194:3300/0 conn(0x7f56a00b4d00 msgr2=0x7f56a0159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569effd640 1 --2- 172.21.15.123:0/515779920 >> v2:172.21.15.194:3300/0 conn(0x7f56a00b4d00 0x7f56a0159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569effd640 1 -- 172.21.15.123:0/515779920 >> v1:172.21.15.123:6789/0 conn(0x7f56a00c9d70 legacy=0x7f56a0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569dffb640 1 -- 172.21.15.123:0/515779920 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839105072 0 0) 0x7f56a00c4020 con 0x7f56a00c9d70 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569effd640 1 -- 172.21.15.123:0/515779920 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a00c4560 con 0x7f56a014f9b0 2024-09-19T09:54:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569f7fe640 1 --2- 172.21.15.123:0/515779920 >> v2:172.21.15.194:3300/0 conn(0x7f56a00b4d00 0x7f56a0159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.403+0000 7f569effd640 1 --2- 172.21.15.123:0/515779920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a014f9b0 0x7f56a00c9830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56a0153570 tx=0x7f569002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aae39c5bdee16ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f569dffb640 1 -- 172.21.15.123:0/515779920 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690037070 con 0x7f56a014f9b0 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f569dffb640 1 -- 172.21.15.123:0/515779920 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569002ae50 con 0x7f56a014f9b0 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f569dffb640 1 -- 172.21.15.123:0/515779920 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690032860 con 0x7f56a014f9b0 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 -- 172.21.15.123:0/515779920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a014f9b0 msgr2=0x7f56a00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 --2- 172.21.15.123:0/515779920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a014f9b0 0x7f56a00c9830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56a0153570 tx=0x7f569002a300 comp rx=0 tx=0).stop 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 -- 172.21.15.123:0/515779920 shutdown_connections 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 --2- 172.21.15.123:0/515779920 >> v2:172.21.15.194:3300/0 conn(0x7f56a00b4d00 0x7f56a0159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 --2- 172.21.15.123:0/515779920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a014f9b0 0x7f56a00c9830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 -- 172.21.15.123:0/515779920 >> 172.21.15.123:0/515779920 conn(0x7f56a00ced20 msgr2=0x7f56a00cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 -- 172.21.15.123:0/515779920 shutdown_connections 2024-09-19T09:54:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.404+0000 7f56a5642640 1 -- 172.21.15.123:0/515779920 wait complete. 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 Processor -- start 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 -- start start 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56a00b4d00 0x7f56a01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 0x7f56a00caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a014f9b0 0x7f56a00caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56a014fd90 con 0x7f56a00c9d70 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f56a00c4b00 con 0x7f56a014f9b0 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.406+0000 7f56a5642640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f56a0071a30 con 0x7f56a00b4d00 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 0x7f56a00caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 0x7f56a00caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42848/0 (socket says 172.21.15.123:42848) 2024-09-19T09:54:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 -- 172.21.15.123:0/117797974 learned_addr learned my addr 172.21.15.123:0/117797974 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569effd640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56a00b4d00 0x7f56a01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569f7fe640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a014f9b0 0x7f56a00caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 -- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56a00b4d00 msgr2=0x7f56a01585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56a00b4d00 0x7f56a01585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 -- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a014f9b0 msgr2=0x7f56a00caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a014f9b0 0x7f56a00caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 -- 172.21.15.123:0/117797974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a00cc2f0 con 0x7f56a00c9d70 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f569e7fc640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 0x7f56a00caa50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f569400c430 tx=0x7f569400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56940074e0 con 0x7f56a00c9d70 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56940047e0 con 0x7f56a00c9d70 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5694004bd0 con 0x7f56a00c9d70 2024-09-19T09:54:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a0148f50 con 0x7f56a00c9d70 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.407+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a00cbd30 con 0x7f56a00c9d70 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.409+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a00b48b0 con 0x7f56a00c9d70 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.409+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5694011070 con 0x7f56a00c9d70 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.410+0000 7f56877fe640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f568c06c2b0 0x7f568c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.410+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f569408b030 con 0x7f56a00c9d70 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.410+0000 7f569effd640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f568c06c2b0 0x7f568c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.410+0000 7f569effd640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f568c06c2b0 0x7f568c06e770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5690034000 tx=0x7f569002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.414+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f56940590d0 con 0x7f56a00c9d70 2024-09-19T09:54:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.580+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 --> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56a0073620 con 0x7f568c06c2b0 2024-09-19T09:54:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.586+0000 7f56877fe640 1 -- 172.21.15.123:0/117797974 <== mgr.4107 v2:172.21.15.123:6824/2665176031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254602 (secure 0 0 0) 0x7f56a0073620 con 0x7f568c06c2b0 2024-09-19T09:54:22.592 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:54:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-19T09:54:22.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f568c06c2b0 msgr2=0x7f568c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f568c06c2b0 0x7f568c06e770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5690034000 tx=0x7f569002e000 comp rx=0 tx=0).stop 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 msgr2=0x7f56a00caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 0x7f56a00caa50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f569400c430 tx=0x7f569400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 shutdown_connections 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a014f9b0 0x7f56a00caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56a00c9d70 0x7f56a00caa50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f568c06c2b0 0x7f568c06e770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 --2- 172.21.15.123:0/117797974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56a00b4d00 0x7f56a01585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 >> 172.21.15.123:0/117797974 conn(0x7f56a00ced20 msgr2=0x7f56a00cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 shutdown_connections 2024-09-19T09:54:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.590+0000 7f56a5642640 1 -- 172.21.15.123:0/117797974 wait complete. 2024-09-19T09:54:22.604 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2024-09-19T09:54:20.906205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210088516,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":140,"num_read_kb":201,"num_write":6764601,"num_write_kb":83163787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447696,"ondisk_log_size":447696,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4660864,"kb_used_data":412416,"kb_used_omap":12,"kb_used_meta":4248307,"kb_avail":750313856,"statfs":{"total":773094113280,"available":768321388544,"internally_reserved":0,"allocated":422313984,"data_stored":420924368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":4350266929},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003111"},"pg_stats":[{"pgid":"3.3f","version":"25'5963","reported_seq":5993,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.368874+0000","last_change":"2024-09-19T09:53:52.368902+0000","last_active":"2024-09-19T09:53:52.368874+0000","last_peered":"2024-09-19T09:53:52.368874+0000","last_clean":"2024-09-19T09:53:52.368874+0000","last_became_active":"2024-09-19T09:42:37.525606+0000","last_became_peered":"2024-09-19T09:42:37.525606+0000","last_unstale":"2024-09-19T09:53:52.368874+0000","last_undegraded":"2024-09-19T09:53:52.368874+0000","last_fullsized":"2024-09-19T09:53:52.368874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5963","last_scrub_stamp":"2024-09-19T09:53:52.368778+0000","last_deep_scrub":"25'5963","last_deep_scrub_stamp":"2024-09-19T09:53:52.368778+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.368778+0000","objects_scrubbed":0,"log_size":5963,"log_dups_size":0,"ondisk_log_size":5963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:17.686193+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90667,"num_write_kb":1126123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"25'8758","reported_seq":8788,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.230745+0000","last_change":"2024-09-19T09:53:50.230773+0000","last_active":"2024-09-19T09:53:50.230745+0000","last_peered":"2024-09-19T09:53:50.230745+0000","last_clean":"2024-09-19T09:53:50.230745+0000","last_became_active":"2024-09-19T09:42:37.518579+0000","last_became_peered":"2024-09-19T09:42:37.518579+0000","last_unstale":"2024-09-19T09:53:50.230745+0000","last_undegraded":"2024-09-19T09:53:50.230745+0000","last_fullsized":"2024-09-19T09:53:50.230745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8758","last_scrub_stamp":"2024-09-19T09:53:50.230639+0000","last_deep_scrub":"25'8758","last_deep_scrub_stamp":"2024-09-19T09:53:50.230639+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.230639+0000","objects_scrubbed":0,"log_size":8758,"log_dups_size":0,"ondisk_log_size":8758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:48.743714+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133411,"num_write_kb":1655568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7063","reported_seq":7093,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.560346+0000","last_change":"2024-09-19T09:53:46.560373+0000","last_active":"2024-09-19T09:53:46.560346+0000","last_peered":"2024-09-19T09:53:46.560346+0000","last_clean":"2024-09-19T09:53:46.560346+0000","last_became_active":"2024-09-19T09:42:37.519236+0000","last_became_peered":"2024-09-19T09:42:37.519236+0000","last_unstale":"2024-09-19T09:53:46.560346+0000","last_undegraded":"2024-09-19T09:53:46.560346+0000","last_fullsized":"2024-09-19T09:53:46.560346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7063","last_scrub_stamp":"2024-09-19T09:53:46.560208+0000","last_deep_scrub":"25'7063","last_deep_scrub_stamp":"2024-09-19T09:53:46.560208+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.560208+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:17.072343+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107453,"num_write_kb":1318687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'6131","reported_seq":6161,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.109484+0000","last_change":"2024-09-19T09:53:52.109524+0000","last_active":"2024-09-19T09:53:52.109484+0000","last_peered":"2024-09-19T09:53:52.109484+0000","last_clean":"2024-09-19T09:53:52.109484+0000","last_became_active":"2024-09-19T09:42:37.522734+0000","last_became_peered":"2024-09-19T09:42:37.522734+0000","last_unstale":"2024-09-19T09:53:52.109484+0000","last_undegraded":"2024-09-19T09:53:52.109484+0000","last_fullsized":"2024-09-19T09:53:52.109484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6131","last_scrub_stamp":"2024-09-19T09:53:52.109385+0000","last_deep_scrub":"25'6131","last_deep_scrub_stamp":"2024-09-19T09:53:52.109385+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.109385+0000","objects_scrubbed":0,"log_size":6131,"log_dups_size":0,"ondisk_log_size":6131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:50.668122+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93226,"num_write_kb":1192949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'8356","reported_seq":8385,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:54.423723+0000","last_change":"2024-09-19T09:53:54.423750+0000","last_active":"2024-09-19T09:53:54.423723+0000","last_peered":"2024-09-19T09:53:54.423723+0000","last_clean":"2024-09-19T09:53:54.423723+0000","last_became_active":"2024-09-19T09:42:37.526331+0000","last_became_peered":"2024-09-19T09:42:37.526331+0000","last_unstale":"2024-09-19T09:53:54.423723+0000","last_undegraded":"2024-09-19T09:53:54.423723+0000","last_fullsized":"2024-09-19T09:53:54.423723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8356","last_scrub_stamp":"2024-09-19T09:53:54.423630+0000","last_deep_scrub":"25'8356","last_deep_scrub_stamp":"2024-09-19T09:53:54.423630+0000","last_clean_scrub_stamp":"2024-09-19T09:53:54.423630+0000","objects_scrubbed":0,"log_size":8356,"log_dups_size":0,"ondisk_log_size":8356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.828193+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127203,"num_write_kb":1494052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6133","reported_seq":6162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.087114+0000","last_change":"2024-09-19T09:53:48.087141+0000","last_active":"2024-09-19T09:53:48.087114+0000","last_peered":"2024-09-19T09:53:48.087114+0000","last_clean":"2024-09-19T09:53:48.087114+0000","last_became_active":"2024-09-19T09:42:37.518657+0000","last_became_peered":"2024-09-19T09:42:37.518657+0000","last_unstale":"2024-09-19T09:53:48.087114+0000","last_undegraded":"2024-09-19T09:53:48.087114+0000","last_fullsized":"2024-09-19T09:53:48.087114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6133","last_scrub_stamp":"2024-09-19T09:53:48.086993+0000","last_deep_scrub":"25'6133","last_deep_scrub_stamp":"2024-09-19T09:53:48.086993+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.086993+0000","objects_scrubbed":0,"log_size":6133,"log_dups_size":0,"ondisk_log_size":6133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:01.838893+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93163,"num_write_kb":1116253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'6607","reported_seq":6637,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.375628+0000","last_change":"2024-09-19T09:53:51.375656+0000","last_active":"2024-09-19T09:53:51.375628+0000","last_peered":"2024-09-19T09:53:51.375628+0000","last_clean":"2024-09-19T09:53:51.375628+0000","last_became_active":"2024-09-19T09:42:37.524542+0000","last_became_peered":"2024-09-19T09:42:37.524542+0000","last_unstale":"2024-09-19T09:53:51.375628+0000","last_undegraded":"2024-09-19T09:53:51.375628+0000","last_fullsized":"2024-09-19T09:53:51.375628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6607","last_scrub_stamp":"2024-09-19T09:53:51.375522+0000","last_deep_scrub":"25'6607","last_deep_scrub_stamp":"2024-09-19T09:53:51.375522+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.375522+0000","objects_scrubbed":0,"log_size":6607,"log_dups_size":0,"ondisk_log_size":6607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:38.376087+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100493,"num_write_kb":1261887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'7473","reported_seq":7502,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.329035+0000","last_change":"2024-09-19T09:53:48.329057+0000","last_active":"2024-09-19T09:53:48.329035+0000","last_peered":"2024-09-19T09:53:48.329035+0000","last_clean":"2024-09-19T09:53:48.329035+0000","last_became_active":"2024-09-19T09:42:37.514419+0000","last_became_peered":"2024-09-19T09:42:37.514419+0000","last_unstale":"2024-09-19T09:53:48.329035+0000","last_undegraded":"2024-09-19T09:53:48.329035+0000","last_fullsized":"2024-09-19T09:53:48.329035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7473","last_scrub_stamp":"2024-09-19T09:53:48.328955+0000","last_deep_scrub":"25'7473","last_deep_scrub_stamp":"2024-09-19T09:53:48.328955+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.328955+0000","objects_scrubbed":0,"log_size":7473,"log_dups_size":0,"ondisk_log_size":7473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:11.370164+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113853,"num_write_kb":1361930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'8252","reported_seq":8281,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:58.438733+0000","last_change":"2024-09-19T09:53:58.438761+0000","last_active":"2024-09-19T09:53:58.438733+0000","last_peered":"2024-09-19T09:53:58.438733+0000","last_clean":"2024-09-19T09:53:58.438733+0000","last_became_active":"2024-09-19T09:42:37.526146+0000","last_became_peered":"2024-09-19T09:42:37.526146+0000","last_unstale":"2024-09-19T09:53:58.438733+0000","last_undegraded":"2024-09-19T09:53:58.438733+0000","last_fullsized":"2024-09-19T09:53:58.438733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8252","last_scrub_stamp":"2024-09-19T09:53:58.438621+0000","last_deep_scrub":"25'8252","last_deep_scrub_stamp":"2024-09-19T09:53:58.438621+0000","last_clean_scrub_stamp":"2024-09-19T09:53:58.438621+0000","objects_scrubbed":0,"log_size":8252,"log_dups_size":0,"ondisk_log_size":8252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:28.265949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125203,"num_write_kb":1603079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'7736","reported_seq":7765,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.173717+0000","last_change":"2024-09-19T09:53:50.173759+0000","last_active":"2024-09-19T09:53:50.173717+0000","last_peered":"2024-09-19T09:53:50.173717+0000","last_clean":"2024-09-19T09:53:50.173717+0000","last_became_active":"2024-09-19T09:42:37.516767+0000","last_became_peered":"2024-09-19T09:42:37.516767+0000","last_unstale":"2024-09-19T09:53:50.173717+0000","last_undegraded":"2024-09-19T09:53:50.173717+0000","last_fullsized":"2024-09-19T09:53:50.173717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7736","last_scrub_stamp":"2024-09-19T09:53:50.173600+0000","last_deep_scrub":"25'7736","last_deep_scrub_stamp":"2024-09-19T09:53:50.173600+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.173600+0000","objects_scrubbed":0,"log_size":7736,"log_dups_size":0,"ondisk_log_size":7736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.172593+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117401,"num_write_kb":1489402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'6682","reported_seq":6711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.189988+0000","last_change":"2024-09-19T09:53:52.190063+0000","last_active":"2024-09-19T09:53:52.189988+0000","last_peered":"2024-09-19T09:53:52.189988+0000","last_clean":"2024-09-19T09:53:52.189988+0000","last_became_active":"2024-09-19T09:42:37.521583+0000","last_became_peered":"2024-09-19T09:42:37.521583+0000","last_unstale":"2024-09-19T09:53:52.189988+0000","last_undegraded":"2024-09-19T09:53:52.189988+0000","last_fullsized":"2024-09-19T09:53:52.189988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6682","last_scrub_stamp":"2024-09-19T09:53:52.189878+0000","last_deep_scrub":"25'6682","last_deep_scrub_stamp":"2024-09-19T09:53:52.189878+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.189878+0000","objects_scrubbed":0,"log_size":6682,"log_dups_size":0,"ondisk_log_size":6682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:50.212595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101709,"num_write_kb":1228477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'5923","reported_seq":5952,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.483764+0000","last_change":"2024-09-19T09:53:42.483791+0000","last_active":"2024-09-19T09:53:42.483764+0000","last_peered":"2024-09-19T09:53:42.483764+0000","last_clean":"2024-09-19T09:53:42.483764+0000","last_became_active":"2024-09-19T09:42:37.514032+0000","last_became_peered":"2024-09-19T09:42:37.514032+0000","last_unstale":"2024-09-19T09:53:42.483764+0000","last_undegraded":"2024-09-19T09:53:42.483764+0000","last_fullsized":"2024-09-19T09:53:42.483764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5923","last_scrub_stamp":"2024-09-19T09:53:42.483680+0000","last_deep_scrub":"25'5923","last_deep_scrub_stamp":"2024-09-19T09:53:42.483680+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.483680+0000","objects_scrubbed":0,"log_size":5923,"log_dups_size":0,"ondisk_log_size":5923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.933005+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90039,"num_write_kb":1066111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'6238","reported_seq":6267,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.314481+0000","last_change":"2024-09-19T09:53:45.314542+0000","last_active":"2024-09-19T09:53:45.314481+0000","last_peered":"2024-09-19T09:53:45.314481+0000","last_clean":"2024-09-19T09:53:45.314481+0000","last_became_active":"2024-09-19T09:42:37.512297+0000","last_became_peered":"2024-09-19T09:42:37.512297+0000","last_unstale":"2024-09-19T09:53:45.314481+0000","last_undegraded":"2024-09-19T09:53:45.314481+0000","last_fullsized":"2024-09-19T09:53:45.314481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6238","last_scrub_stamp":"2024-09-19T09:53:45.314371+0000","last_deep_scrub":"25'6238","last_deep_scrub_stamp":"2024-09-19T09:53:45.314371+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.314371+0000","objects_scrubbed":0,"log_size":6238,"log_dups_size":0,"ondisk_log_size":6238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:57.003916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94800,"num_write_kb":1191870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'7101","reported_seq":7130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.638416+0000","last_change":"2024-09-19T09:53:43.638462+0000","last_active":"2024-09-19T09:53:43.638416+0000","last_peered":"2024-09-19T09:53:43.638416+0000","last_clean":"2024-09-19T09:53:43.638416+0000","last_became_active":"2024-09-19T09:42:37.513897+0000","last_became_peered":"2024-09-19T09:42:37.513897+0000","last_unstale":"2024-09-19T09:53:43.638416+0000","last_undegraded":"2024-09-19T09:53:43.638416+0000","last_fullsized":"2024-09-19T09:53:43.638416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7101","last_scrub_stamp":"2024-09-19T09:53:43.638313+0000","last_deep_scrub":"25'7101","last_deep_scrub_stamp":"2024-09-19T09:53:43.638313+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.638313+0000","objects_scrubbed":0,"log_size":7101,"log_dups_size":0,"ondisk_log_size":7101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:03.426263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107699,"num_write_kb":1339564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'7242","reported_seq":7271,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.231642+0000","last_change":"2024-09-19T09:53:48.231665+0000","last_active":"2024-09-19T09:53:48.231642+0000","last_peered":"2024-09-19T09:53:48.231642+0000","last_clean":"2024-09-19T09:53:48.231642+0000","last_became_active":"2024-09-19T09:42:37.515235+0000","last_became_peered":"2024-09-19T09:42:37.515235+0000","last_unstale":"2024-09-19T09:53:48.231642+0000","last_undegraded":"2024-09-19T09:53:48.231642+0000","last_fullsized":"2024-09-19T09:53:48.231642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7242","last_scrub_stamp":"2024-09-19T09:53:48.231565+0000","last_deep_scrub":"25'7242","last_deep_scrub_stamp":"2024-09-19T09:53:48.231565+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.231565+0000","objects_scrubbed":0,"log_size":7242,"log_dups_size":0,"ondisk_log_size":7242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:09.188481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109960,"num_write_kb":1298661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'6074","reported_seq":6104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.123426+0000","last_change":"2024-09-19T09:53:49.123426+0000","last_active":"2024-09-19T09:53:49.123426+0000","last_peered":"2024-09-19T09:53:49.123426+0000","last_clean":"2024-09-19T09:53:49.123426+0000","last_became_active":"2024-09-19T09:42:37.519093+0000","last_became_peered":"2024-09-19T09:42:37.519093+0000","last_unstale":"2024-09-19T09:53:49.123426+0000","last_undegraded":"2024-09-19T09:53:49.123426+0000","last_fullsized":"2024-09-19T09:53:49.123426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6074","last_scrub_stamp":"2024-09-19T09:53:49.123302+0000","last_deep_scrub":"25'6074","last_deep_scrub_stamp":"2024-09-19T09:53:49.123302+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.123302+0000","objects_scrubbed":0,"log_size":6074,"log_dups_size":0,"ondisk_log_size":6074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:08.937474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92239,"num_write_kb":1166043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8317","reported_seq":8347,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.105779+0000","last_change":"2024-09-19T09:53:51.105779+0000","last_active":"2024-09-19T09:53:51.105779+0000","last_peered":"2024-09-19T09:53:51.105779+0000","last_clean":"2024-09-19T09:53:51.105779+0000","last_became_active":"2024-09-19T09:42:37.521627+0000","last_became_peered":"2024-09-19T09:42:37.521627+0000","last_unstale":"2024-09-19T09:53:51.105779+0000","last_undegraded":"2024-09-19T09:53:51.105779+0000","last_fullsized":"2024-09-19T09:53:51.105779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8317","last_scrub_stamp":"2024-09-19T09:53:51.105551+0000","last_deep_scrub":"25'8317","last_deep_scrub_stamp":"2024-09-19T09:53:51.105551+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.105551+0000","objects_scrubbed":0,"log_size":8317,"log_dups_size":0,"ondisk_log_size":8317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:53.288066+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126488,"num_write_kb":1557261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'5649","reported_seq":5679,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.901348+0000","last_change":"2024-09-19T09:53:43.901348+0000","last_active":"2024-09-19T09:53:43.901348+0000","last_peered":"2024-09-19T09:53:43.901348+0000","last_clean":"2024-09-19T09:53:43.901348+0000","last_became_active":"2024-09-19T09:42:37.511738+0000","last_became_peered":"2024-09-19T09:42:37.511738+0000","last_unstale":"2024-09-19T09:53:43.901348+0000","last_undegraded":"2024-09-19T09:53:43.901348+0000","last_fullsized":"2024-09-19T09:53:43.901348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5649","last_scrub_stamp":"2024-09-19T09:53:43.901189+0000","last_deep_scrub":"25'5649","last_deep_scrub_stamp":"2024-09-19T09:53:43.901189+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.901189+0000","objects_scrubbed":0,"log_size":5649,"log_dups_size":0,"ondisk_log_size":5649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:15.970231+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85570,"num_write_kb":1023683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'6873","reported_seq":6903,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:55.444678+0000","last_change":"2024-09-19T09:53:55.444678+0000","last_active":"2024-09-19T09:53:55.444678+0000","last_peered":"2024-09-19T09:53:55.444678+0000","last_clean":"2024-09-19T09:53:55.444678+0000","last_became_active":"2024-09-19T09:42:37.526760+0000","last_became_peered":"2024-09-19T09:42:37.526760+0000","last_unstale":"2024-09-19T09:53:55.444678+0000","last_undegraded":"2024-09-19T09:53:55.444678+0000","last_fullsized":"2024-09-19T09:53:55.444678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6873","last_scrub_stamp":"2024-09-19T09:53:55.444563+0000","last_deep_scrub":"25'6873","last_deep_scrub_stamp":"2024-09-19T09:53:55.444563+0000","last_clean_scrub_stamp":"2024-09-19T09:53:55.444563+0000","objects_scrubbed":0,"log_size":6873,"log_dups_size":0,"ondisk_log_size":6873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:45.778734+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104491,"num_write_kb":1253325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'6781","reported_seq":6811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.179134+0000","last_change":"2024-09-19T09:53:46.179134+0000","last_active":"2024-09-19T09:53:46.179134+0000","last_peered":"2024-09-19T09:53:46.179134+0000","last_clean":"2024-09-19T09:53:46.179134+0000","last_became_active":"2024-09-19T09:42:37.513019+0000","last_became_peered":"2024-09-19T09:42:37.513019+0000","last_unstale":"2024-09-19T09:53:46.179134+0000","last_undegraded":"2024-09-19T09:53:46.179134+0000","last_fullsized":"2024-09-19T09:53:46.179134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6781","last_scrub_stamp":"2024-09-19T09:53:46.178986+0000","last_deep_scrub":"25'6781","last_deep_scrub_stamp":"2024-09-19T09:53:46.178986+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.178986+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:52.155341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103096,"num_write_kb":1273163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'7069","reported_seq":7099,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.473383+0000","last_change":"2024-09-19T09:53:49.473383+0000","last_active":"2024-09-19T09:53:49.473383+0000","last_peered":"2024-09-19T09:53:49.473383+0000","last_clean":"2024-09-19T09:53:49.473383+0000","last_became_active":"2024-09-19T09:42:37.521783+0000","last_became_peered":"2024-09-19T09:42:37.521783+0000","last_unstale":"2024-09-19T09:53:49.473383+0000","last_undegraded":"2024-09-19T09:53:49.473383+0000","last_fullsized":"2024-09-19T09:53:49.473383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7069","last_scrub_stamp":"2024-09-19T09:53:49.473279+0000","last_deep_scrub":"25'7069","last_deep_scrub_stamp":"2024-09-19T09:53:49.473279+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.473279+0000","objects_scrubbed":0,"log_size":7069,"log_dups_size":0,"ondisk_log_size":7069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:52.399265+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107113,"num_write_kb":1305966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'7493","reported_seq":7523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:54.121389+0000","last_change":"2024-09-19T09:53:54.121414+0000","last_active":"2024-09-19T09:53:54.121389+0000","last_peered":"2024-09-19T09:53:54.121389+0000","last_clean":"2024-09-19T09:53:54.121389+0000","last_became_active":"2024-09-19T09:42:37.523849+0000","last_became_peered":"2024-09-19T09:42:37.523849+0000","last_unstale":"2024-09-19T09:53:54.121389+0000","last_undegraded":"2024-09-19T09:53:54.121389+0000","last_fullsized":"2024-09-19T09:53:54.121389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7493","last_scrub_stamp":"2024-09-19T09:53:54.121280+0000","last_deep_scrub":"25'7493","last_deep_scrub_stamp":"2024-09-19T09:53:54.121280+0000","last_clean_scrub_stamp":"2024-09-19T09:53:54.121280+0000","objects_scrubbed":0,"log_size":7493,"log_dups_size":0,"ondisk_log_size":7493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:29.004389+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113925,"num_write_kb":1408486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'6884","reported_seq":6914,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.361857+0000","last_change":"2024-09-19T09:53:47.361857+0000","last_active":"2024-09-19T09:53:47.361857+0000","last_peered":"2024-09-19T09:53:47.361857+0000","last_clean":"2024-09-19T09:53:47.361857+0000","last_became_active":"2024-09-19T09:42:37.513706+0000","last_became_peered":"2024-09-19T09:42:37.513706+0000","last_unstale":"2024-09-19T09:53:47.361857+0000","last_undegraded":"2024-09-19T09:53:47.361857+0000","last_fullsized":"2024-09-19T09:53:47.361857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6884","last_scrub_stamp":"2024-09-19T09:53:47.361746+0000","last_deep_scrub":"25'6884","last_deep_scrub_stamp":"2024-09-19T09:53:47.361746+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.361746+0000","objects_scrubbed":0,"log_size":6884,"log_dups_size":0,"ondisk_log_size":6884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:27.972243+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104459,"num_write_kb":1263249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'6119","reported_seq":6149,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.116386+0000","last_change":"2024-09-19T09:53:46.116413+0000","last_active":"2024-09-19T09:53:46.116386+0000","last_peered":"2024-09-19T09:53:46.116386+0000","last_clean":"2024-09-19T09:53:46.116386+0000","last_became_active":"2024-09-19T09:42:37.515861+0000","last_became_peered":"2024-09-19T09:42:37.515861+0000","last_unstale":"2024-09-19T09:53:46.116386+0000","last_undegraded":"2024-09-19T09:53:46.116386+0000","last_fullsized":"2024-09-19T09:53:46.116386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6119","last_scrub_stamp":"2024-09-19T09:53:46.116252+0000","last_deep_scrub":"25'6119","last_deep_scrub_stamp":"2024-09-19T09:53:46.116252+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.116252+0000","objects_scrubbed":0,"log_size":6119,"log_dups_size":0,"ondisk_log_size":6119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:35.750241+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93016,"num_write_kb":1127551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"25'8002","reported_seq":8032,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.281147+0000","last_change":"2024-09-19T09:53:43.281176+0000","last_active":"2024-09-19T09:53:43.281147+0000","last_peered":"2024-09-19T09:53:43.281147+0000","last_clean":"2024-09-19T09:53:43.281147+0000","last_became_active":"2024-09-19T09:42:37.511212+0000","last_became_peered":"2024-09-19T09:42:37.511212+0000","last_unstale":"2024-09-19T09:53:43.281147+0000","last_undegraded":"2024-09-19T09:53:43.281147+0000","last_fullsized":"2024-09-19T09:53:43.281147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8002","last_scrub_stamp":"2024-09-19T09:53:43.281052+0000","last_deep_scrub":"25'8002","last_deep_scrub_stamp":"2024-09-19T09:53:43.281052+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.281052+0000","objects_scrubbed":0,"log_size":8002,"log_dups_size":0,"ondisk_log_size":8002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.766100+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121789,"num_write_kb":1510406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'6222","reported_seq":6252,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.141555+0000","last_change":"2024-09-19T09:53:51.141581+0000","last_active":"2024-09-19T09:53:51.141555+0000","last_peered":"2024-09-19T09:53:51.141555+0000","last_clean":"2024-09-19T09:53:51.141555+0000","last_became_active":"2024-09-19T09:42:37.520427+0000","last_became_peered":"2024-09-19T09:42:37.520427+0000","last_unstale":"2024-09-19T09:53:51.141555+0000","last_undegraded":"2024-09-19T09:53:51.141555+0000","last_fullsized":"2024-09-19T09:53:51.141555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6222","last_scrub_stamp":"2024-09-19T09:53:51.141443+0000","last_deep_scrub":"25'6222","last_deep_scrub_stamp":"2024-09-19T09:53:51.141443+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.141443+0000","objects_scrubbed":0,"log_size":6222,"log_dups_size":0,"ondisk_log_size":6222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:54.978219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94313,"num_write_kb":1157877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'7393","reported_seq":7423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.130764+0000","last_change":"2024-09-19T09:53:45.130792+0000","last_active":"2024-09-19T09:53:45.130764+0000","last_peered":"2024-09-19T09:53:45.130764+0000","last_clean":"2024-09-19T09:53:45.130764+0000","last_became_active":"2024-09-19T09:42:37.508765+0000","last_became_peered":"2024-09-19T09:42:37.508765+0000","last_unstale":"2024-09-19T09:53:45.130764+0000","last_undegraded":"2024-09-19T09:53:45.130764+0000","last_fullsized":"2024-09-19T09:53:45.130764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7393","last_scrub_stamp":"2024-09-19T09:53:45.130660+0000","last_deep_scrub":"25'7393","last_deep_scrub_stamp":"2024-09-19T09:53:45.130660+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.130660+0000","objects_scrubbed":0,"log_size":7393,"log_dups_size":0,"ondisk_log_size":7393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:37.805628+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112469,"num_write_kb":1393395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'6316","reported_seq":6346,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.330095+0000","last_change":"2024-09-19T09:53:46.330128+0000","last_active":"2024-09-19T09:53:46.330095+0000","last_peered":"2024-09-19T09:53:46.330095+0000","last_clean":"2024-09-19T09:53:46.330095+0000","last_became_active":"2024-09-19T09:42:37.513628+0000","last_became_peered":"2024-09-19T09:42:37.513628+0000","last_unstale":"2024-09-19T09:53:46.330095+0000","last_undegraded":"2024-09-19T09:53:46.330095+0000","last_fullsized":"2024-09-19T09:53:46.330095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6316","last_scrub_stamp":"2024-09-19T09:53:46.330003+0000","last_deep_scrub":"25'6316","last_deep_scrub_stamp":"2024-09-19T09:53:46.330003+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.330003+0000","objects_scrubbed":0,"log_size":6316,"log_dups_size":0,"ondisk_log_size":6316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:06.489552+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96072,"num_write_kb":1169122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'5905","reported_seq":5935,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.601361+0000","last_change":"2024-09-19T09:53:45.601411+0000","last_active":"2024-09-19T09:53:45.601361+0000","last_peered":"2024-09-19T09:53:45.601361+0000","last_clean":"2024-09-19T09:53:45.601361+0000","last_became_active":"2024-09-19T09:42:37.515543+0000","last_became_peered":"2024-09-19T09:42:37.515543+0000","last_unstale":"2024-09-19T09:53:45.601361+0000","last_undegraded":"2024-09-19T09:53:45.601361+0000","last_fullsized":"2024-09-19T09:53:45.601361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5905","last_scrub_stamp":"2024-09-19T09:53:45.601244+0000","last_deep_scrub":"25'5905","last_deep_scrub_stamp":"2024-09-19T09:53:45.601244+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.601244+0000","objects_scrubbed":0,"log_size":5905,"log_dups_size":0,"ondisk_log_size":5905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:58.762559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89887,"num_write_kb":1118423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'8492","reported_seq":8522,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.099126+0000","last_change":"2024-09-19T09:53:47.099169+0000","last_active":"2024-09-19T09:53:47.099126+0000","last_peered":"2024-09-19T09:53:47.099126+0000","last_clean":"2024-09-19T09:53:47.099126+0000","last_became_active":"2024-09-19T09:42:37.517592+0000","last_became_peered":"2024-09-19T09:42:37.517592+0000","last_unstale":"2024-09-19T09:53:47.099126+0000","last_undegraded":"2024-09-19T09:53:47.099126+0000","last_fullsized":"2024-09-19T09:53:47.099126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8492","last_scrub_stamp":"2024-09-19T09:53:47.098975+0000","last_deep_scrub":"25'8492","last_deep_scrub_stamp":"2024-09-19T09:53:47.098975+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.098975+0000","objects_scrubbed":0,"log_size":8492,"log_dups_size":0,"ondisk_log_size":8492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:50.376559+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129293,"num_write_kb":1558943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"25'7307","reported_seq":7337,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.947517+0000","last_change":"2024-09-19T09:53:44.947546+0000","last_active":"2024-09-19T09:53:44.947517+0000","last_peered":"2024-09-19T09:53:44.947517+0000","last_clean":"2024-09-19T09:53:44.947517+0000","last_became_active":"2024-09-19T09:42:37.513323+0000","last_became_peered":"2024-09-19T09:42:37.513323+0000","last_unstale":"2024-09-19T09:53:44.947517+0000","last_undegraded":"2024-09-19T09:53:44.947517+0000","last_fullsized":"2024-09-19T09:53:44.947517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7307","last_scrub_stamp":"2024-09-19T09:53:44.947416+0000","last_deep_scrub":"25'7307","last_deep_scrub_stamp":"2024-09-19T09:53:44.947416+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.947416+0000","objects_scrubbed":0,"log_size":7307,"log_dups_size":0,"ondisk_log_size":7307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:00.674614+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111025,"num_write_kb":1382740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'8646","reported_seq":8676,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.149325+0000","last_change":"2024-09-19T09:53:47.149353+0000","last_active":"2024-09-19T09:53:47.149325+0000","last_peered":"2024-09-19T09:53:47.149325+0000","last_clean":"2024-09-19T09:53:47.149325+0000","last_became_active":"2024-09-19T09:42:37.514573+0000","last_became_peered":"2024-09-19T09:42:37.514573+0000","last_unstale":"2024-09-19T09:53:47.149325+0000","last_undegraded":"2024-09-19T09:53:47.149325+0000","last_fullsized":"2024-09-19T09:53:47.149325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8646","last_scrub_stamp":"2024-09-19T09:53:47.149223+0000","last_deep_scrub":"25'8646","last_deep_scrub_stamp":"2024-09-19T09:53:47.149223+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.149223+0000","objects_scrubbed":0,"log_size":8646,"log_dups_size":0,"ondisk_log_size":8646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:41.692730+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131457,"num_write_kb":1608657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'5972","reported_seq":6001,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.525297+0000","last_change":"2024-09-19T09:53:43.525349+0000","last_active":"2024-09-19T09:53:43.525297+0000","last_peered":"2024-09-19T09:53:43.525297+0000","last_clean":"2024-09-19T09:53:43.525297+0000","last_became_active":"2024-09-19T09:42:37.515843+0000","last_became_peered":"2024-09-19T09:42:37.515843+0000","last_unstale":"2024-09-19T09:53:43.525297+0000","last_undegraded":"2024-09-19T09:53:43.525297+0000","last_fullsized":"2024-09-19T09:53:43.525297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5972","last_scrub_stamp":"2024-09-19T09:53:43.525191+0000","last_deep_scrub":"25'5972","last_deep_scrub_stamp":"2024-09-19T09:53:43.525191+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.525191+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:20.828060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90903,"num_write_kb":1098126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1243","reported_seq":1274,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.305106+0000","last_change":"2024-09-19T09:53:42.305130+0000","last_active":"2024-09-19T09:53:42.305106+0000","last_peered":"2024-09-19T09:53:42.305106+0000","last_clean":"2024-09-19T09:53:42.305106+0000","last_became_active":"2024-09-19T09:42:36.506642+0000","last_became_peered":"2024-09-19T09:42:36.506642+0000","last_unstale":"2024-09-19T09:53:42.305106+0000","last_undegraded":"2024-09-19T09:53:42.305106+0000","last_fullsized":"2024-09-19T09:53:42.305106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1243","last_scrub_stamp":"2024-09-19T09:53:42.305037+0000","last_deep_scrub":"25'1243","last_deep_scrub_stamp":"2024-09-19T09:53:42.305037+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.305037+0000","objects_scrubbed":1,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:14.618609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":5249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5283","reported_seq":5312,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.608046+0000","last_change":"2024-09-19T09:53:44.608100+0000","last_active":"2024-09-19T09:53:44.608046+0000","last_peered":"2024-09-19T09:53:44.608046+0000","last_clean":"2024-09-19T09:53:44.608046+0000","last_became_active":"2024-09-19T09:42:37.514017+0000","last_became_peered":"2024-09-19T09:42:37.514017+0000","last_unstale":"2024-09-19T09:53:44.608046+0000","last_undegraded":"2024-09-19T09:53:44.608046+0000","last_fullsized":"2024-09-19T09:53:44.608046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5283","last_scrub_stamp":"2024-09-19T09:53:44.607942+0000","last_deep_scrub":"25'5283","last_deep_scrub_stamp":"2024-09-19T09:53:44.607942+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.607942+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:28.220742+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80097,"num_write_kb":999347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'47","reported_seq":78,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.268352+0000","last_change":"2024-09-19T09:53:42.268383+0000","last_active":"2024-09-19T09:53:42.268352+0000","last_peered":"2024-09-19T09:53:42.268352+0000","last_clean":"2024-09-19T09:53:42.268352+0000","last_became_active":"2024-09-19T09:42:36.490495+0000","last_became_peered":"2024-09-19T09:42:36.490495+0000","last_unstale":"2024-09-19T09:53:42.268352+0000","last_undegraded":"2024-09-19T09:53:42.268352+0000","last_fullsized":"2024-09-19T09:53:42.268352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'47","last_scrub_stamp":"2024-09-19T09:53:42.268279+0000","last_deep_scrub":"25'47","last_deep_scrub_stamp":"2024-09-19T09:53:42.268279+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.268279+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:15.166931+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":16406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.336409+0000","last_change":"2024-09-19T09:53:41.336431+0000","last_active":"2024-09-19T09:53:41.336409+0000","last_peered":"2024-09-19T09:53:41.336409+0000","last_clean":"2024-09-19T09:53:41.336409+0000","last_became_active":"2024-09-19T09:42:36.506487+0000","last_became_peered":"2024-09-19T09:42:36.506487+0000","last_unstale":"2024-09-19T09:53:41.336409+0000","last_undegraded":"2024-09-19T09:53:41.336409+0000","last_fullsized":"2024-09-19T09:53:41.336409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-09-19T09:53:41.336288+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-09-19T09:53:41.336288+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.336288+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.532121+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'6896","reported_seq":6925,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.310840+0000","last_change":"2024-09-19T09:53:49.310923+0000","last_active":"2024-09-19T09:53:49.310840+0000","last_peered":"2024-09-19T09:53:49.310840+0000","last_clean":"2024-09-19T09:53:49.310840+0000","last_became_active":"2024-09-19T09:42:37.518797+0000","last_became_peered":"2024-09-19T09:42:37.518797+0000","last_unstale":"2024-09-19T09:53:49.310840+0000","last_undegraded":"2024-09-19T09:53:49.310840+0000","last_fullsized":"2024-09-19T09:53:49.310840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6896","last_scrub_stamp":"2024-09-19T09:53:49.310705+0000","last_deep_scrub":"25'6896","last_deep_scrub_stamp":"2024-09-19T09:53:49.310705+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.310705+0000","objects_scrubbed":0,"log_size":6896,"log_dups_size":0,"ondisk_log_size":6896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.346216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104648,"num_write_kb":1287559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'34","reported_seq":65,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.118199+0000","last_change":"2024-09-19T09:53:42.118237+0000","last_active":"2024-09-19T09:53:42.118199+0000","last_peered":"2024-09-19T09:53:42.118199+0000","last_clean":"2024-09-19T09:53:42.118199+0000","last_became_active":"2024-09-19T09:42:36.500305+0000","last_became_peered":"2024-09-19T09:42:36.500305+0000","last_unstale":"2024-09-19T09:53:42.118199+0000","last_undegraded":"2024-09-19T09:53:42.118199+0000","last_fullsized":"2024-09-19T09:53:42.118199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'34","last_scrub_stamp":"2024-09-19T09:53:42.118111+0000","last_deep_scrub":"25'34","last_deep_scrub_stamp":"2024-09-19T09:53:42.118111+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.118111+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:03.573257+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'8134","reported_seq":8163,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.183575+0000","last_change":"2024-09-19T09:53:49.183600+0000","last_active":"2024-09-19T09:53:49.183575+0000","last_peered":"2024-09-19T09:53:49.183575+0000","last_clean":"2024-09-19T09:53:49.183575+0000","last_became_active":"2024-09-19T09:42:37.515568+0000","last_became_peered":"2024-09-19T09:42:37.515568+0000","last_unstale":"2024-09-19T09:53:49.183575+0000","last_undegraded":"2024-09-19T09:53:49.183575+0000","last_fullsized":"2024-09-19T09:53:49.183575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8134","last_scrub_stamp":"2024-09-19T09:53:49.183491+0000","last_deep_scrub":"25'8134","last_deep_scrub_stamp":"2024-09-19T09:53:49.183491+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.183491+0000","objects_scrubbed":0,"log_size":8134,"log_dups_size":0,"ondisk_log_size":8134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:49.775968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123619,"num_write_kb":1504166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.243138+0000","last_change":"2024-09-19T09:53:43.243188+0000","last_active":"2024-09-19T09:53:43.243138+0000","last_peered":"2024-09-19T09:53:43.243138+0000","last_clean":"2024-09-19T09:53:43.243138+0000","last_became_active":"2024-09-19T09:42:36.494213+0000","last_became_peered":"2024-09-19T09:42:36.494213+0000","last_unstale":"2024-09-19T09:53:43.243138+0000","last_undegraded":"2024-09-19T09:53:43.243138+0000","last_fullsized":"2024-09-19T09:53:43.243138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-19T09:53:43.243039+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-19T09:53:43.243039+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.243039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:18.654377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'6995","reported_seq":7024,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:55.071723+0000","last_change":"2024-09-19T09:53:55.071752+0000","last_active":"2024-09-19T09:53:55.071723+0000","last_peered":"2024-09-19T09:53:55.071723+0000","last_clean":"2024-09-19T09:53:55.071723+0000","last_became_active":"2024-09-19T09:42:37.525080+0000","last_became_peered":"2024-09-19T09:42:37.525080+0000","last_unstale":"2024-09-19T09:53:55.071723+0000","last_undegraded":"2024-09-19T09:53:55.071723+0000","last_fullsized":"2024-09-19T09:53:55.071723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6995","last_scrub_stamp":"2024-09-19T09:53:55.071621+0000","last_deep_scrub":"25'6995","last_deep_scrub_stamp":"2024-09-19T09:53:55.071621+0000","last_clean_scrub_stamp":"2024-09-19T09:53:55.071621+0000","objects_scrubbed":0,"log_size":6995,"log_dups_size":0,"ondisk_log_size":6995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:29.013733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106286,"num_write_kb":1265589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'29","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.146719+0000","last_change":"2024-09-19T09:53:45.146770+0000","last_active":"2024-09-19T09:53:45.146719+0000","last_peered":"2024-09-19T09:53:45.146719+0000","last_clean":"2024-09-19T09:53:45.146719+0000","last_became_active":"2024-09-19T09:42:36.503426+0000","last_became_peered":"2024-09-19T09:42:36.503426+0000","last_unstale":"2024-09-19T09:53:45.146719+0000","last_undegraded":"2024-09-19T09:53:45.146719+0000","last_fullsized":"2024-09-19T09:53:45.146719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'29","last_scrub_stamp":"2024-09-19T09:53:45.146580+0000","last_deep_scrub":"25'29","last_deep_scrub_stamp":"2024-09-19T09:53:45.146580+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.146580+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:18.502466+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'6106","reported_seq":6135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.467216+0000","last_change":"2024-09-19T09:53:48.467239+0000","last_active":"2024-09-19T09:53:48.467216+0000","last_peered":"2024-09-19T09:53:48.467216+0000","last_clean":"2024-09-19T09:53:48.467216+0000","last_became_active":"2024-09-19T09:42:37.521582+0000","last_became_peered":"2024-09-19T09:42:37.521582+0000","last_unstale":"2024-09-19T09:53:48.467216+0000","last_undegraded":"2024-09-19T09:53:48.467216+0000","last_fullsized":"2024-09-19T09:53:48.467216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6106","last_scrub_stamp":"2024-09-19T09:53:48.467138+0000","last_deep_scrub":"25'6106","last_deep_scrub_stamp":"2024-09-19T09:53:48.467138+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.467138+0000","objects_scrubbed":0,"log_size":6106,"log_dups_size":0,"ondisk_log_size":6106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:20.977677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92578,"num_write_kb":1120610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'150","reported_seq":181,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.105432+0000","last_change":"2024-09-19T09:53:41.105460+0000","last_active":"2024-09-19T09:53:41.105432+0000","last_peered":"2024-09-19T09:53:41.105432+0000","last_clean":"2024-09-19T09:53:41.105432+0000","last_became_active":"2024-09-19T09:42:36.494587+0000","last_became_peered":"2024-09-19T09:42:36.494587+0000","last_unstale":"2024-09-19T09:53:41.105432+0000","last_undegraded":"2024-09-19T09:53:41.105432+0000","last_fullsized":"2024-09-19T09:53:41.105432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'150","last_scrub_stamp":"2024-09-19T09:53:41.105361+0000","last_deep_scrub":"25'150","last_deep_scrub_stamp":"2024-09-19T09:53:41.105361+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.105361+0000","objects_scrubbed":4,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:13.343915+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8082096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":7958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9209","reported_seq":9238,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.470034+0000","last_change":"2024-09-19T09:53:45.470081+0000","last_active":"2024-09-19T09:53:45.470034+0000","last_peered":"2024-09-19T09:53:45.470034+0000","last_clean":"2024-09-19T09:53:45.470034+0000","last_became_active":"2024-09-19T09:42:37.522963+0000","last_became_peered":"2024-09-19T09:42:37.522963+0000","last_unstale":"2024-09-19T09:53:45.470034+0000","last_undegraded":"2024-09-19T09:53:45.470034+0000","last_fullsized":"2024-09-19T09:53:45.470034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9209","last_scrub_stamp":"2024-09-19T09:53:45.469902+0000","last_deep_scrub":"25'9209","last_deep_scrub_stamp":"2024-09-19T09:53:45.469902+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.469902+0000","objects_scrubbed":0,"log_size":9209,"log_dups_size":0,"ondisk_log_size":9209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:28.415824+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140136,"num_write_kb":1697056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'240","reported_seq":271,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.226596+0000","last_change":"2024-09-19T09:53:44.226631+0000","last_active":"2024-09-19T09:53:44.226596+0000","last_peered":"2024-09-19T09:53:44.226596+0000","last_clean":"2024-09-19T09:53:44.226596+0000","last_became_active":"2024-09-19T09:42:36.501343+0000","last_became_peered":"2024-09-19T09:42:36.501343+0000","last_unstale":"2024-09-19T09:53:44.226596+0000","last_undegraded":"2024-09-19T09:53:44.226596+0000","last_fullsized":"2024-09-19T09:53:44.226596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'240","last_scrub_stamp":"2024-09-19T09:53:44.226515+0000","last_deep_scrub":"25'240","last_deep_scrub_stamp":"2024-09-19T09:53:44.226515+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.226515+0000","objects_scrubbed":6,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:58.689377+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":12452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'6643","reported_seq":6672,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.150719+0000","last_change":"2024-09-19T09:53:42.150743+0000","last_active":"2024-09-19T09:53:42.150719+0000","last_peered":"2024-09-19T09:53:42.150719+0000","last_clean":"2024-09-19T09:53:42.150719+0000","last_became_active":"2024-09-19T09:42:37.524301+0000","last_became_peered":"2024-09-19T09:42:37.524301+0000","last_unstale":"2024-09-19T09:53:42.150719+0000","last_undegraded":"2024-09-19T09:53:42.150719+0000","last_fullsized":"2024-09-19T09:53:42.150719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6643","last_scrub_stamp":"2024-09-19T09:53:42.150639+0000","last_deep_scrub":"25'6643","last_deep_scrub_stamp":"2024-09-19T09:53:42.150639+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.150639+0000","objects_scrubbed":0,"log_size":6643,"log_dups_size":0,"ondisk_log_size":6643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:21.465723+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100932,"num_write_kb":1211662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'18","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.529309+0000","last_change":"2024-09-19T09:53:39.529337+0000","last_active":"2024-09-19T09:53:39.529309+0000","last_peered":"2024-09-19T09:53:39.529309+0000","last_clean":"2024-09-19T09:53:39.529309+0000","last_became_active":"2024-09-19T09:42:36.497334+0000","last_became_peered":"2024-09-19T09:42:36.497334+0000","last_unstale":"2024-09-19T09:53:39.529309+0000","last_undegraded":"2024-09-19T09:53:39.529309+0000","last_fullsized":"2024-09-19T09:53:39.529309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'18","last_scrub_stamp":"2024-09-19T09:53:39.529243+0000","last_deep_scrub":"25'18","last_deep_scrub_stamp":"2024-09-19T09:53:39.529243+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.529243+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:28.598014+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'6603","reported_seq":6633,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.510806+0000","last_change":"2024-09-19T09:53:50.510806+0000","last_active":"2024-09-19T09:53:50.510806+0000","last_peered":"2024-09-19T09:53:50.510806+0000","last_clean":"2024-09-19T09:53:50.510806+0000","last_became_active":"2024-09-19T09:42:37.523011+0000","last_became_peered":"2024-09-19T09:42:37.523011+0000","last_unstale":"2024-09-19T09:53:50.510806+0000","last_undegraded":"2024-09-19T09:53:50.510806+0000","last_fullsized":"2024-09-19T09:53:50.510806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6603","last_scrub_stamp":"2024-09-19T09:53:50.510677+0000","last_deep_scrub":"25'6603","last_deep_scrub_stamp":"2024-09-19T09:53:50.510677+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.510677+0000","objects_scrubbed":0,"log_size":6603,"log_dups_size":0,"ondisk_log_size":6603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:15.336038+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100178,"num_write_kb":1211527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.083376+0000","last_change":"2024-09-19T09:53:44.083376+0000","last_active":"2024-09-19T09:53:44.083376+0000","last_peered":"2024-09-19T09:53:44.083376+0000","last_clean":"2024-09-19T09:53:44.083376+0000","last_became_active":"2024-09-19T09:42:36.501929+0000","last_became_peered":"2024-09-19T09:42:36.501929+0000","last_unstale":"2024-09-19T09:53:44.083376+0000","last_undegraded":"2024-09-19T09:53:44.083376+0000","last_fullsized":"2024-09-19T09:53:44.083376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-09-19T09:53:44.083186+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-09-19T09:53:44.083186+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.083186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:22.693601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'7772","reported_seq":7801,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:57.431073+0000","last_change":"2024-09-19T09:53:57.431100+0000","last_active":"2024-09-19T09:53:57.431073+0000","last_peered":"2024-09-19T09:53:57.431073+0000","last_clean":"2024-09-19T09:53:57.431073+0000","last_became_active":"2024-09-19T09:42:37.527249+0000","last_became_peered":"2024-09-19T09:42:37.527249+0000","last_unstale":"2024-09-19T09:53:57.431073+0000","last_undegraded":"2024-09-19T09:53:57.431073+0000","last_fullsized":"2024-09-19T09:53:57.431073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7772","last_scrub_stamp":"2024-09-19T09:53:57.430955+0000","last_deep_scrub":"25'7772","last_deep_scrub_stamp":"2024-09-19T09:53:57.430955+0000","last_clean_scrub_stamp":"2024-09-19T09:53:57.430955+0000","objects_scrubbed":0,"log_size":7772,"log_dups_size":0,"ondisk_log_size":7772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:56.345908+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118022,"num_write_kb":1435104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'6","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.212210+0000","last_change":"2024-09-19T09:53:41.212233+0000","last_active":"2024-09-19T09:53:41.212210+0000","last_peered":"2024-09-19T09:53:41.212210+0000","last_clean":"2024-09-19T09:53:41.212210+0000","last_became_active":"2024-09-19T09:42:36.490252+0000","last_became_peered":"2024-09-19T09:42:36.490252+0000","last_unstale":"2024-09-19T09:53:41.212210+0000","last_undegraded":"2024-09-19T09:53:41.212210+0000","last_fullsized":"2024-09-19T09:53:41.212210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-09-19T09:53:41.212117+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-09-19T09:53:41.212117+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.212117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:20.436321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'7347","reported_seq":7377,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.204584+0000","last_change":"2024-09-19T09:53:49.204584+0000","last_active":"2024-09-19T09:53:49.204584+0000","last_peered":"2024-09-19T09:53:49.204584+0000","last_clean":"2024-09-19T09:53:49.204584+0000","last_became_active":"2024-09-19T09:42:37.515436+0000","last_became_peered":"2024-09-19T09:42:37.515436+0000","last_unstale":"2024-09-19T09:53:49.204584+0000","last_undegraded":"2024-09-19T09:53:49.204584+0000","last_fullsized":"2024-09-19T09:53:49.204584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7347","last_scrub_stamp":"2024-09-19T09:53:49.204473+0000","last_deep_scrub":"25'7347","last_deep_scrub_stamp":"2024-09-19T09:53:49.204473+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.204473+0000","objects_scrubbed":0,"log_size":7347,"log_dups_size":0,"ondisk_log_size":7347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.549385+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111551,"num_write_kb":1366296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'42","reported_seq":74,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.923474+0000","last_change":"2024-09-19T09:53:39.923474+0000","last_active":"2024-09-19T09:53:39.923474+0000","last_peered":"2024-09-19T09:53:39.923474+0000","last_clean":"2024-09-19T09:53:39.923474+0000","last_became_active":"2024-09-19T09:42:36.496934+0000","last_became_peered":"2024-09-19T09:42:36.496934+0000","last_unstale":"2024-09-19T09:53:39.923474+0000","last_undegraded":"2024-09-19T09:53:39.923474+0000","last_fullsized":"2024-09-19T09:53:39.923474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'42","last_scrub_stamp":"2024-09-19T09:53:39.923314+0000","last_deep_scrub":"25'42","last_deep_scrub_stamp":"2024-09-19T09:53:39.923314+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.923314+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:31.879696+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'6691","reported_seq":6720,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.366814+0000","last_change":"2024-09-19T09:53:50.366842+0000","last_active":"2024-09-19T09:53:50.366814+0000","last_peered":"2024-09-19T09:53:50.366814+0000","last_clean":"2024-09-19T09:53:50.366814+0000","last_became_active":"2024-09-19T09:42:37.523175+0000","last_became_peered":"2024-09-19T09:42:37.523175+0000","last_unstale":"2024-09-19T09:53:50.366814+0000","last_undegraded":"2024-09-19T09:53:50.366814+0000","last_fullsized":"2024-09-19T09:53:50.366814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6691","last_scrub_stamp":"2024-09-19T09:53:50.366683+0000","last_deep_scrub":"25'6691","last_deep_scrub_stamp":"2024-09-19T09:53:50.366683+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.366683+0000","objects_scrubbed":0,"log_size":6691,"log_dups_size":0,"ondisk_log_size":6691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:08.657128+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101427,"num_write_kb":1285780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'19","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.470246+0000","last_change":"2024-09-19T09:53:40.470246+0000","last_active":"2024-09-19T09:53:40.470246+0000","last_peered":"2024-09-19T09:53:40.470246+0000","last_clean":"2024-09-19T09:53:40.470246+0000","last_became_active":"2024-09-19T09:42:36.492883+0000","last_became_peered":"2024-09-19T09:42:36.492883+0000","last_unstale":"2024-09-19T09:53:40.470246+0000","last_undegraded":"2024-09-19T09:53:40.470246+0000","last_fullsized":"2024-09-19T09:53:40.470246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2024-09-19T09:53:40.470117+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2024-09-19T09:53:40.470117+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.470117+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:29.570904+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'6802","reported_seq":6825,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.243669+0000","last_change":"2024-09-19T09:53:51.243700+0000","last_active":"2024-09-19T09:53:51.243669+0000","last_peered":"2024-09-19T09:53:51.243669+0000","last_clean":"2024-09-19T09:53:51.243669+0000","last_became_active":"2024-09-19T09:43:20.619328+0000","last_became_peered":"2024-09-19T09:43:20.619328+0000","last_unstale":"2024-09-19T09:53:51.243669+0000","last_undegraded":"2024-09-19T09:53:51.243669+0000","last_fullsized":"2024-09-19T09:53:51.243669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6802","last_scrub_stamp":"2024-09-19T09:53:51.243568+0000","last_deep_scrub":"25'6802","last_deep_scrub_stamp":"2024-09-19T09:53:51.243568+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.243568+0000","objects_scrubbed":0,"log_size":6802,"log_dups_size":0,"ondisk_log_size":6802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:10.705240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103611,"num_write_kb":1225908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"25'21","reported_seq":53,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.866230+0000","last_change":"2024-09-19T09:53:42.866230+0000","last_active":"2024-09-19T09:53:42.866230+0000","last_peered":"2024-09-19T09:53:42.866230+0000","last_clean":"2024-09-19T09:53:42.866230+0000","last_became_active":"2024-09-19T09:42:36.501939+0000","last_became_peered":"2024-09-19T09:42:36.501939+0000","last_unstale":"2024-09-19T09:53:42.866230+0000","last_undegraded":"2024-09-19T09:53:42.866230+0000","last_fullsized":"2024-09-19T09:53:42.866230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2024-09-19T09:53:42.866124+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2024-09-19T09:53:42.866124+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.866124+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:08.320435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'8081","reported_seq":8111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:56.449276+0000","last_change":"2024-09-19T09:53:56.449276+0000","last_active":"2024-09-19T09:53:56.449276+0000","last_peered":"2024-09-19T09:53:56.449276+0000","last_clean":"2024-09-19T09:53:56.449276+0000","last_became_active":"2024-09-19T09:42:37.527219+0000","last_became_peered":"2024-09-19T09:42:37.527219+0000","last_unstale":"2024-09-19T09:53:56.449276+0000","last_undegraded":"2024-09-19T09:53:56.449276+0000","last_fullsized":"2024-09-19T09:53:56.449276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8081","last_scrub_stamp":"2024-09-19T09:53:56.449135+0000","last_deep_scrub":"25'8081","last_deep_scrub_stamp":"2024-09-19T09:53:56.449135+0000","last_clean_scrub_stamp":"2024-09-19T09:53:56.449135+0000","objects_scrubbed":0,"log_size":8081,"log_dups_size":0,"ondisk_log_size":8081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:22.875340+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122842,"num_write_kb":1473778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.128775+0000","last_change":"2024-09-19T09:53:43.128775+0000","last_active":"2024-09-19T09:53:43.128775+0000","last_peered":"2024-09-19T09:53:43.128775+0000","last_clean":"2024-09-19T09:53:43.128775+0000","last_became_active":"2024-09-19T09:42:36.495711+0000","last_became_peered":"2024-09-19T09:42:36.495711+0000","last_unstale":"2024-09-19T09:53:43.128775+0000","last_undegraded":"2024-09-19T09:53:43.128775+0000","last_fullsized":"2024-09-19T09:53:43.128775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:43.128627+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:43.128627+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.128627+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:58.899895+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'7130","reported_seq":7153,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.963533+0000","last_change":"2024-09-19T09:53:45.963561+0000","last_active":"2024-09-19T09:53:45.963533+0000","last_peered":"2024-09-19T09:53:45.963533+0000","last_clean":"2024-09-19T09:53:45.963533+0000","last_became_active":"2024-09-19T09:43:20.618840+0000","last_became_peered":"2024-09-19T09:43:20.618840+0000","last_unstale":"2024-09-19T09:53:45.963533+0000","last_undegraded":"2024-09-19T09:53:45.963533+0000","last_fullsized":"2024-09-19T09:53:45.963533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7130","last_scrub_stamp":"2024-09-19T09:53:45.963405+0000","last_deep_scrub":"25'7130","last_deep_scrub_stamp":"2024-09-19T09:53:45.963405+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.963405+0000","objects_scrubbed":0,"log_size":7130,"log_dups_size":0,"ondisk_log_size":7130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.304205+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108281,"num_write_kb":1344761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.906975+0000","last_change":"2024-09-19T09:53:41.906975+0000","last_active":"2024-09-19T09:53:41.906975+0000","last_peered":"2024-09-19T09:53:41.906975+0000","last_clean":"2024-09-19T09:53:41.906975+0000","last_became_active":"2024-09-19T09:42:36.497581+0000","last_became_peered":"2024-09-19T09:42:36.497581+0000","last_unstale":"2024-09-19T09:53:41.906975+0000","last_undegraded":"2024-09-19T09:53:41.906975+0000","last_fullsized":"2024-09-19T09:53:41.906975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:41.906839+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:41.906839+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.906839+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:33.324470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'6859","reported_seq":6889,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:53.380941+0000","last_change":"2024-09-19T09:53:53.380941+0000","last_active":"2024-09-19T09:53:53.380941+0000","last_peered":"2024-09-19T09:53:53.380941+0000","last_clean":"2024-09-19T09:53:53.380941+0000","last_became_active":"2024-09-19T09:42:37.525679+0000","last_became_peered":"2024-09-19T09:42:37.525679+0000","last_unstale":"2024-09-19T09:53:53.380941+0000","last_undegraded":"2024-09-19T09:53:53.380941+0000","last_fullsized":"2024-09-19T09:53:53.380941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6859","last_scrub_stamp":"2024-09-19T09:53:53.380809+0000","last_deep_scrub":"25'6859","last_deep_scrub_stamp":"2024-09-19T09:53:53.380809+0000","last_clean_scrub_stamp":"2024-09-19T09:53:53.380809+0000","objects_scrubbed":0,"log_size":6859,"log_dups_size":0,"ondisk_log_size":6859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:12.715015+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104241,"num_write_kb":1288428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":190,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.193758+0000","last_change":"2024-09-19T09:53:43.193800+0000","last_active":"2024-09-19T09:53:43.193758+0000","last_peered":"2024-09-19T09:53:43.193758+0000","last_clean":"2024-09-19T09:53:43.193758+0000","last_became_active":"2024-09-19T09:42:31.071582+0000","last_became_peered":"2024-09-19T09:42:31.071582+0000","last_unstale":"2024-09-19T09:53:43.193758+0000","last_undegraded":"2024-09-19T09:53:43.193758+0000","last_fullsized":"2024-09-19T09:53:43.193758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-09-19T09:53:43.193671+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-09-19T09:53:43.193671+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.193671+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:55.280864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.137783+0000","last_change":"2024-09-19T09:53:41.137815+0000","last_active":"2024-09-19T09:53:41.137783+0000","last_peered":"2024-09-19T09:53:41.137783+0000","last_clean":"2024-09-19T09:53:41.137783+0000","last_became_active":"2024-09-19T09:42:36.498989+0000","last_became_peered":"2024-09-19T09:42:36.498989+0000","last_unstale":"2024-09-19T09:53:41.137783+0000","last_undegraded":"2024-09-19T09:53:41.137783+0000","last_fullsized":"2024-09-19T09:53:41.137783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-09-19T09:53:41.137692+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-09-19T09:53:41.137692+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.137692+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:04.710702+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'7194","reported_seq":7224,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:51.310454+0000","last_change":"2024-09-19T09:53:51.310479+0000","last_active":"2024-09-19T09:53:51.310454+0000","last_peered":"2024-09-19T09:53:51.310454+0000","last_clean":"2024-09-19T09:53:51.310454+0000","last_became_active":"2024-09-19T09:42:37.520437+0000","last_became_peered":"2024-09-19T09:42:37.520437+0000","last_unstale":"2024-09-19T09:53:51.310454+0000","last_undegraded":"2024-09-19T09:53:51.310454+0000","last_fullsized":"2024-09-19T09:53:51.310454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7194","last_scrub_stamp":"2024-09-19T09:53:51.310356+0000","last_deep_scrub":"25'7194","last_deep_scrub_stamp":"2024-09-19T09:53:51.310356+0000","last_clean_scrub_stamp":"2024-09-19T09:53:51.310356+0000","objects_scrubbed":0,"log_size":7194,"log_dups_size":0,"ondisk_log_size":7194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:12.577632+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109665,"num_write_kb":1344078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'54","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.301470+0000","last_change":"2024-09-19T09:53:46.301499+0000","last_active":"2024-09-19T09:53:46.301470+0000","last_peered":"2024-09-19T09:53:46.301470+0000","last_clean":"2024-09-19T09:53:46.301470+0000","last_became_active":"2024-09-19T09:42:36.503506+0000","last_became_peered":"2024-09-19T09:42:36.503506+0000","last_unstale":"2024-09-19T09:53:46.301470+0000","last_undegraded":"2024-09-19T09:53:46.301470+0000","last_fullsized":"2024-09-19T09:53:46.301470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'54","last_scrub_stamp":"2024-09-19T09:53:46.301388+0000","last_deep_scrub":"25'54","last_deep_scrub_stamp":"2024-09-19T09:53:46.301388+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.301388+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:14.280813+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'6526","reported_seq":6556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.632208+0000","last_change":"2024-09-19T09:53:42.632252+0000","last_active":"2024-09-19T09:53:42.632208+0000","last_peered":"2024-09-19T09:53:42.632208+0000","last_clean":"2024-09-19T09:53:42.632208+0000","last_became_active":"2024-09-19T09:42:37.513471+0000","last_became_peered":"2024-09-19T09:42:37.513471+0000","last_unstale":"2024-09-19T09:53:42.632208+0000","last_undegraded":"2024-09-19T09:53:42.632208+0000","last_fullsized":"2024-09-19T09:53:42.632208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6526","last_scrub_stamp":"2024-09-19T09:53:42.632123+0000","last_deep_scrub":"25'6526","last_deep_scrub_stamp":"2024-09-19T09:53:42.632123+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.632123+0000","objects_scrubbed":0,"log_size":6526,"log_dups_size":0,"ondisk_log_size":6526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:07.465583+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99242,"num_write_kb":1260349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'27","reported_seq":83,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.854545+0000","last_change":"2024-09-19T09:53:40.854570+0000","last_active":"2024-09-19T09:53:40.854545+0000","last_peered":"2024-09-19T09:53:40.854545+0000","last_clean":"2024-09-19T09:53:40.854545+0000","last_became_active":"2024-09-19T09:42:36.500117+0000","last_became_peered":"2024-09-19T09:42:36.500117+0000","last_unstale":"2024-09-19T09:53:40.854545+0000","last_undegraded":"2024-09-19T09:53:40.854545+0000","last_fullsized":"2024-09-19T09:53:40.854545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'27","last_scrub_stamp":"2024-09-19T09:53:40.854471+0000","last_deep_scrub":"25'27","last_deep_scrub_stamp":"2024-09-19T09:53:40.854471+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.854471+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:48.024788+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":24,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'6593","reported_seq":6623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.137296+0000","last_change":"2024-09-19T09:53:46.137326+0000","last_active":"2024-09-19T09:53:46.137296+0000","last_peered":"2024-09-19T09:53:46.137296+0000","last_clean":"2024-09-19T09:53:46.137296+0000","last_became_active":"2024-09-19T09:42:37.510359+0000","last_became_peered":"2024-09-19T09:42:37.510359+0000","last_unstale":"2024-09-19T09:53:46.137296+0000","last_undegraded":"2024-09-19T09:53:46.137296+0000","last_fullsized":"2024-09-19T09:53:46.137296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6593","last_scrub_stamp":"2024-09-19T09:53:46.137199+0000","last_deep_scrub":"25'6593","last_deep_scrub_stamp":"2024-09-19T09:53:46.137199+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.137199+0000","objects_scrubbed":0,"log_size":6593,"log_dups_size":0,"ondisk_log_size":6593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:45.659855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99779,"num_write_kb":1243684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'22","reported_seq":54,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:43.062876+0000","last_change":"2024-09-19T09:53:43.062931+0000","last_active":"2024-09-19T09:53:43.062876+0000","last_peered":"2024-09-19T09:53:43.062876+0000","last_clean":"2024-09-19T09:53:43.062876+0000","last_became_active":"2024-09-19T09:42:36.501168+0000","last_became_peered":"2024-09-19T09:42:36.501168+0000","last_unstale":"2024-09-19T09:53:43.062876+0000","last_undegraded":"2024-09-19T09:53:43.062876+0000","last_fullsized":"2024-09-19T09:53:43.062876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'22","last_scrub_stamp":"2024-09-19T09:53:43.062768+0000","last_deep_scrub":"25'22","last_deep_scrub_stamp":"2024-09-19T09:53:43.062768+0000","last_clean_scrub_stamp":"2024-09-19T09:53:43.062768+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:07.932088+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6382","reported_seq":6412,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.513253+0000","last_change":"2024-09-19T09:53:44.513283+0000","last_active":"2024-09-19T09:53:44.513253+0000","last_peered":"2024-09-19T09:53:44.513253+0000","last_clean":"2024-09-19T09:53:44.513253+0000","last_became_active":"2024-09-19T09:42:37.518189+0000","last_became_peered":"2024-09-19T09:42:37.518189+0000","last_unstale":"2024-09-19T09:53:44.513253+0000","last_undegraded":"2024-09-19T09:53:44.513253+0000","last_fullsized":"2024-09-19T09:53:44.513253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6382","last_scrub_stamp":"2024-09-19T09:53:44.513152+0000","last_deep_scrub":"25'6382","last_deep_scrub_stamp":"2024-09-19T09:53:44.513152+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.513152+0000","objects_scrubbed":0,"log_size":6382,"log_dups_size":0,"ondisk_log_size":6382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:12.033615+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97075,"num_write_kb":1245753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'18","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.090491+0000","last_change":"2024-09-19T09:53:40.090522+0000","last_active":"2024-09-19T09:53:40.090491+0000","last_peered":"2024-09-19T09:53:40.090491+0000","last_clean":"2024-09-19T09:53:40.090491+0000","last_became_active":"2024-09-19T09:42:36.492224+0000","last_became_peered":"2024-09-19T09:42:36.492224+0000","last_unstale":"2024-09-19T09:53:40.090491+0000","last_undegraded":"2024-09-19T09:53:40.090491+0000","last_fullsized":"2024-09-19T09:53:40.090491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'18","last_scrub_stamp":"2024-09-19T09:53:40.090423+0000","last_deep_scrub":"25'18","last_deep_scrub_stamp":"2024-09-19T09:53:40.090423+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.090423+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:33.209448+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5988","reported_seq":6018,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:53.129102+0000","last_change":"2024-09-19T09:53:53.129139+0000","last_active":"2024-09-19T09:53:53.129102+0000","last_peered":"2024-09-19T09:53:53.129102+0000","last_clean":"2024-09-19T09:53:53.129102+0000","last_became_active":"2024-09-19T09:42:37.523542+0000","last_became_peered":"2024-09-19T09:42:37.523542+0000","last_unstale":"2024-09-19T09:53:53.129102+0000","last_undegraded":"2024-09-19T09:53:53.129102+0000","last_fullsized":"2024-09-19T09:53:53.129102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5988","last_scrub_stamp":"2024-09-19T09:53:53.128974+0000","last_deep_scrub":"25'5988","last_deep_scrub_stamp":"2024-09-19T09:53:53.128974+0000","last_clean_scrub_stamp":"2024-09-19T09:53:53.128974+0000","objects_scrubbed":0,"log_size":5988,"log_dups_size":0,"ondisk_log_size":5988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:26.452182+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90916,"num_write_kb":1171530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.345952+0000","last_change":"2024-09-19T09:53:48.345984+0000","last_active":"2024-09-19T09:53:48.345952+0000","last_peered":"2024-09-19T09:53:48.345952+0000","last_clean":"2024-09-19T09:53:48.345952+0000","last_became_active":"2024-09-19T09:42:36.505402+0000","last_became_peered":"2024-09-19T09:42:36.505402+0000","last_unstale":"2024-09-19T09:53:48.345952+0000","last_undegraded":"2024-09-19T09:53:48.345952+0000","last_fullsized":"2024-09-19T09:53:48.345952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:48.345862+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:48.345862+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.345862+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:23.441391+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'7106","reported_seq":7136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.183930+0000","last_change":"2024-09-19T09:53:47.183972+0000","last_active":"2024-09-19T09:53:47.183930+0000","last_peered":"2024-09-19T09:53:47.183930+0000","last_clean":"2024-09-19T09:53:47.183930+0000","last_became_active":"2024-09-19T09:42:37.511086+0000","last_became_peered":"2024-09-19T09:42:37.511086+0000","last_unstale":"2024-09-19T09:53:47.183930+0000","last_undegraded":"2024-09-19T09:53:47.183930+0000","last_fullsized":"2024-09-19T09:53:47.183930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7106","last_scrub_stamp":"2024-09-19T09:53:47.183808+0000","last_deep_scrub":"25'7106","last_deep_scrub_stamp":"2024-09-19T09:53:47.183808+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.183808+0000","objects_scrubbed":0,"log_size":7106,"log_dups_size":0,"ondisk_log_size":7106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:52.970871+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107857,"num_write_kb":1353549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'251","reported_seq":283,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:39.102072+0000","last_change":"2024-09-19T09:53:39.102122+0000","last_active":"2024-09-19T09:53:39.102072+0000","last_peered":"2024-09-19T09:53:39.102072+0000","last_clean":"2024-09-19T09:53:39.102072+0000","last_became_active":"2024-09-19T09:42:36.490343+0000","last_became_peered":"2024-09-19T09:42:36.490343+0000","last_unstale":"2024-09-19T09:53:39.102072+0000","last_undegraded":"2024-09-19T09:53:39.102072+0000","last_fullsized":"2024-09-19T09:53:39.102072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'251","last_scrub_stamp":"2024-09-19T09:53:39.101982+0000","last_deep_scrub":"25'251","last_deep_scrub_stamp":"2024-09-19T09:53:39.101982+0000","last_clean_scrub_stamp":"2024-09-19T09:53:39.101982+0000","objects_scrubbed":1,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:28.149413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'6910","reported_seq":6940,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:52.348809+0000","last_change":"2024-09-19T09:53:52.348836+0000","last_active":"2024-09-19T09:53:52.348809+0000","last_peered":"2024-09-19T09:53:52.348809+0000","last_clean":"2024-09-19T09:53:52.348809+0000","last_became_active":"2024-09-19T09:42:37.523353+0000","last_became_peered":"2024-09-19T09:42:37.523353+0000","last_unstale":"2024-09-19T09:53:52.348809+0000","last_undegraded":"2024-09-19T09:53:52.348809+0000","last_fullsized":"2024-09-19T09:53:52.348809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6910","last_scrub_stamp":"2024-09-19T09:53:52.348661+0000","last_deep_scrub":"25'6910","last_deep_scrub_stamp":"2024-09-19T09:53:52.348661+0000","last_clean_scrub_stamp":"2024-09-19T09:53:52.348661+0000","objects_scrubbed":0,"log_size":6910,"log_dups_size":0,"ondisk_log_size":6910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:06.751027+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104946,"num_write_kb":1269889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'10","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.227735+0000","last_change":"2024-09-19T09:53:45.227763+0000","last_active":"2024-09-19T09:53:45.227735+0000","last_peered":"2024-09-19T09:53:45.227735+0000","last_clean":"2024-09-19T09:53:45.227735+0000","last_became_active":"2024-09-19T09:42:36.504192+0000","last_became_peered":"2024-09-19T09:42:36.504192+0000","last_unstale":"2024-09-19T09:53:45.227735+0000","last_undegraded":"2024-09-19T09:53:45.227735+0000","last_fullsized":"2024-09-19T09:53:45.227735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-09-19T09:53:45.227652+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-09-19T09:53:45.227652+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.227652+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:07.236564+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'5820","reported_seq":5850,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.602240+0000","last_change":"2024-09-19T09:53:41.602262+0000","last_active":"2024-09-19T09:53:41.602240+0000","last_peered":"2024-09-19T09:53:41.602240+0000","last_clean":"2024-09-19T09:53:41.602240+0000","last_became_active":"2024-09-19T09:42:37.513158+0000","last_became_peered":"2024-09-19T09:42:37.513158+0000","last_unstale":"2024-09-19T09:53:41.602240+0000","last_undegraded":"2024-09-19T09:53:41.602240+0000","last_fullsized":"2024-09-19T09:53:41.602240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5820","last_scrub_stamp":"2024-09-19T09:53:41.602151+0000","last_deep_scrub":"25'5820","last_deep_scrub_stamp":"2024-09-19T09:53:41.602151+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.602151+0000","objects_scrubbed":0,"log_size":5820,"log_dups_size":0,"ondisk_log_size":5820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:49.957783+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88305,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'15","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.314747+0000","last_change":"2024-09-19T09:53:47.314778+0000","last_active":"2024-09-19T09:53:47.314747+0000","last_peered":"2024-09-19T09:53:47.314747+0000","last_clean":"2024-09-19T09:53:47.314747+0000","last_became_active":"2024-09-19T09:42:36.505384+0000","last_became_peered":"2024-09-19T09:42:36.505384+0000","last_unstale":"2024-09-19T09:53:47.314747+0000","last_undegraded":"2024-09-19T09:53:47.314747+0000","last_fullsized":"2024-09-19T09:53:47.314747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-09-19T09:53:47.314625+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-09-19T09:53:47.314625+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.314625+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:07.117144+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'6612","reported_seq":6642,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:41.482148+0000","last_change":"2024-09-19T09:53:41.482175+0000","last_active":"2024-09-19T09:53:41.482148+0000","last_peered":"2024-09-19T09:53:41.482148+0000","last_clean":"2024-09-19T09:53:41.482148+0000","last_became_active":"2024-09-19T09:42:37.510555+0000","last_became_peered":"2024-09-19T09:42:37.510555+0000","last_unstale":"2024-09-19T09:53:41.482148+0000","last_undegraded":"2024-09-19T09:53:41.482148+0000","last_fullsized":"2024-09-19T09:53:41.482148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6612","last_scrub_stamp":"2024-09-19T09:53:41.482053+0000","last_deep_scrub":"25'6612","last_deep_scrub_stamp":"2024-09-19T09:53:41.482053+0000","last_clean_scrub_stamp":"2024-09-19T09:53:41.482053+0000","objects_scrubbed":0,"log_size":6612,"log_dups_size":0,"ondisk_log_size":6612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:22.854949+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100566,"num_write_kb":1195835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'16","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:42.103347+0000","last_change":"2024-09-19T09:53:42.103372+0000","last_active":"2024-09-19T09:53:42.103347+0000","last_peered":"2024-09-19T09:53:42.103347+0000","last_clean":"2024-09-19T09:53:42.103347+0000","last_became_active":"2024-09-19T09:42:36.496782+0000","last_became_peered":"2024-09-19T09:42:36.496782+0000","last_unstale":"2024-09-19T09:53:42.103347+0000","last_undegraded":"2024-09-19T09:53:42.103347+0000","last_fullsized":"2024-09-19T09:53:42.103347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-09-19T09:53:42.103272+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-09-19T09:53:42.103272+0000","last_clean_scrub_stamp":"2024-09-19T09:53:42.103272+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:12.339198+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'6882","reported_seq":6906,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:46.920049+0000","last_change":"2024-09-19T09:53:46.920049+0000","last_active":"2024-09-19T09:53:46.920049+0000","last_peered":"2024-09-19T09:53:46.920049+0000","last_clean":"2024-09-19T09:53:46.920049+0000","last_became_active":"2024-09-19T09:43:20.619922+0000","last_became_peered":"2024-09-19T09:43:20.619922+0000","last_unstale":"2024-09-19T09:53:46.920049+0000","last_undegraded":"2024-09-19T09:53:46.920049+0000","last_fullsized":"2024-09-19T09:53:46.920049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6882","last_scrub_stamp":"2024-09-19T09:53:46.919880+0000","last_deep_scrub":"25'6882","last_deep_scrub_stamp":"2024-09-19T09:53:46.919880+0000","last_clean_scrub_stamp":"2024-09-19T09:53:46.919880+0000","objects_scrubbed":0,"log_size":6882,"log_dups_size":0,"ondisk_log_size":6882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:59.179776+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104802,"num_write_kb":1303037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"25'22","reported_seq":54,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.137729+0000","last_change":"2024-09-19T09:53:44.137764+0000","last_active":"2024-09-19T09:53:44.137729+0000","last_peered":"2024-09-19T09:53:44.137729+0000","last_clean":"2024-09-19T09:53:44.137729+0000","last_became_active":"2024-09-19T09:42:36.499927+0000","last_became_peered":"2024-09-19T09:42:36.499927+0000","last_unstale":"2024-09-19T09:53:44.137729+0000","last_undegraded":"2024-09-19T09:53:44.137729+0000","last_fullsized":"2024-09-19T09:53:44.137729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'22","last_scrub_stamp":"2024-09-19T09:53:44.137621+0000","last_deep_scrub":"25'22","last_deep_scrub_stamp":"2024-09-19T09:53:44.137621+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.137621+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:11.402883+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'5981","reported_seq":6011,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.315789+0000","last_change":"2024-09-19T09:53:50.315817+0000","last_active":"2024-09-19T09:53:50.315789+0000","last_peered":"2024-09-19T09:53:50.315789+0000","last_clean":"2024-09-19T09:53:50.315789+0000","last_became_active":"2024-09-19T09:42:37.519065+0000","last_became_peered":"2024-09-19T09:42:37.519065+0000","last_unstale":"2024-09-19T09:53:50.315789+0000","last_undegraded":"2024-09-19T09:53:50.315789+0000","last_fullsized":"2024-09-19T09:53:50.315789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5981","last_scrub_stamp":"2024-09-19T09:53:50.315660+0000","last_deep_scrub":"25'5981","last_deep_scrub_stamp":"2024-09-19T09:53:50.315660+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.315660+0000","objects_scrubbed":0,"log_size":5981,"log_dups_size":0,"ondisk_log_size":5981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:53.240928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91144,"num_write_kb":1060104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'185","reported_seq":217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.253890+0000","last_change":"2024-09-19T09:53:44.253890+0000","last_active":"2024-09-19T09:53:44.253890+0000","last_peered":"2024-09-19T09:53:44.253890+0000","last_clean":"2024-09-19T09:53:44.253890+0000","last_became_active":"2024-09-19T09:42:36.503463+0000","last_became_peered":"2024-09-19T09:42:36.503463+0000","last_unstale":"2024-09-19T09:53:44.253890+0000","last_undegraded":"2024-09-19T09:53:44.253890+0000","last_fullsized":"2024-09-19T09:53:44.253890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'185","last_scrub_stamp":"2024-09-19T09:53:44.253618+0000","last_deep_scrub":"25'185","last_deep_scrub_stamp":"2024-09-19T09:53:44.253618+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.253618+0000","objects_scrubbed":4,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:48.772471+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'6191","reported_seq":6221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:48.164944+0000","last_change":"2024-09-19T09:53:48.164968+0000","last_active":"2024-09-19T09:53:48.164944+0000","last_peered":"2024-09-19T09:53:48.164944+0000","last_clean":"2024-09-19T09:53:48.164944+0000","last_became_active":"2024-09-19T09:42:37.514943+0000","last_became_peered":"2024-09-19T09:42:37.514943+0000","last_unstale":"2024-09-19T09:53:48.164944+0000","last_undegraded":"2024-09-19T09:53:48.164944+0000","last_fullsized":"2024-09-19T09:53:48.164944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6191","last_scrub_stamp":"2024-09-19T09:53:48.164814+0000","last_deep_scrub":"25'6191","last_deep_scrub_stamp":"2024-09-19T09:53:48.164814+0000","last_clean_scrub_stamp":"2024-09-19T09:53:48.164814+0000","objects_scrubbed":0,"log_size":6191,"log_dups_size":0,"ondisk_log_size":6191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:12.035535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94126,"num_write_kb":1169732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'8374","reported_seq":8397,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.910236+0000","last_change":"2024-09-19T09:53:47.910266+0000","last_active":"2024-09-19T09:53:47.910236+0000","last_peered":"2024-09-19T09:53:47.910236+0000","last_clean":"2024-09-19T09:53:47.910236+0000","last_became_active":"2024-09-19T09:43:20.620007+0000","last_became_peered":"2024-09-19T09:43:20.620007+0000","last_unstale":"2024-09-19T09:53:47.910236+0000","last_undegraded":"2024-09-19T09:53:47.910236+0000","last_fullsized":"2024-09-19T09:53:47.910236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8374","last_scrub_stamp":"2024-09-19T09:53:47.910136+0000","last_deep_scrub":"25'8374","last_deep_scrub_stamp":"2024-09-19T09:53:47.910136+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.910136+0000","objects_scrubbed":0,"log_size":8374,"log_dups_size":0,"ondisk_log_size":8374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:42.299339+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127388,"num_write_kb":1561891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'9","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:45.246744+0000","last_change":"2024-09-19T09:53:45.246775+0000","last_active":"2024-09-19T09:53:45.246744+0000","last_peered":"2024-09-19T09:53:45.246744+0000","last_clean":"2024-09-19T09:53:45.246744+0000","last_became_active":"2024-09-19T09:42:36.503515+0000","last_became_peered":"2024-09-19T09:42:36.503515+0000","last_unstale":"2024-09-19T09:53:45.246744+0000","last_undegraded":"2024-09-19T09:53:45.246744+0000","last_fullsized":"2024-09-19T09:53:45.246744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-09-19T09:53:45.246625+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-09-19T09:53:45.246625+0000","last_clean_scrub_stamp":"2024-09-19T09:53:45.246625+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:18.786923+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5056","reported_seq":5085,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:50.079311+0000","last_change":"2024-09-19T09:53:50.079338+0000","last_active":"2024-09-19T09:53:50.079311+0000","last_peered":"2024-09-19T09:53:50.079311+0000","last_clean":"2024-09-19T09:53:50.079311+0000","last_became_active":"2024-09-19T09:42:37.520728+0000","last_became_peered":"2024-09-19T09:42:37.520728+0000","last_unstale":"2024-09-19T09:53:50.079311+0000","last_undegraded":"2024-09-19T09:53:50.079311+0000","last_fullsized":"2024-09-19T09:53:50.079311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5056","last_scrub_stamp":"2024-09-19T09:53:50.079212+0000","last_deep_scrub":"25'5056","last_deep_scrub_stamp":"2024-09-19T09:53:50.079212+0000","last_clean_scrub_stamp":"2024-09-19T09:53:50.079212+0000","objects_scrubbed":0,"log_size":5056,"log_dups_size":0,"ondisk_log_size":5056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:14.016431+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76792,"num_write_kb":903119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'53","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:49.362128+0000","last_change":"2024-09-19T09:53:49.362162+0000","last_active":"2024-09-19T09:53:49.362128+0000","last_peered":"2024-09-19T09:53:49.362128+0000","last_clean":"2024-09-19T09:53:49.362128+0000","last_became_active":"2024-09-19T09:42:36.506530+0000","last_became_peered":"2024-09-19T09:42:36.506530+0000","last_unstale":"2024-09-19T09:53:49.362128+0000","last_undegraded":"2024-09-19T09:53:49.362128+0000","last_fullsized":"2024-09-19T09:53:49.362128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'53","last_scrub_stamp":"2024-09-19T09:53:49.362045+0000","last_deep_scrub":"25'53","last_deep_scrub_stamp":"2024-09-19T09:53:49.362045+0000","last_clean_scrub_stamp":"2024-09-19T09:53:49.362045+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:16.268942+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":16399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'8300","reported_seq":8330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:47.517919+0000","last_change":"2024-09-19T09:53:47.517942+0000","last_active":"2024-09-19T09:53:47.517919+0000","last_peered":"2024-09-19T09:53:47.517919+0000","last_clean":"2024-09-19T09:53:47.517919+0000","last_became_active":"2024-09-19T09:42:37.521426+0000","last_became_peered":"2024-09-19T09:42:37.521426+0000","last_unstale":"2024-09-19T09:53:47.517919+0000","last_undegraded":"2024-09-19T09:53:47.517919+0000","last_fullsized":"2024-09-19T09:53:47.517919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8300","last_scrub_stamp":"2024-09-19T09:53:47.517743+0000","last_deep_scrub":"25'8300","last_deep_scrub_stamp":"2024-09-19T09:53:47.517743+0000","last_clean_scrub_stamp":"2024-09-19T09:53:47.517743+0000","objects_scrubbed":0,"log_size":8300,"log_dups_size":0,"ondisk_log_size":8300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:00.510835+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125930,"num_write_kb":1569689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'28","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.384465+0000","last_change":"2024-09-19T09:53:40.384513+0000","last_active":"2024-09-19T09:53:40.384465+0000","last_peered":"2024-09-19T09:53:40.384465+0000","last_clean":"2024-09-19T09:53:40.384465+0000","last_became_active":"2024-09-19T09:42:36.502583+0000","last_became_peered":"2024-09-19T09:42:36.502583+0000","last_unstale":"2024-09-19T09:53:40.384465+0000","last_undegraded":"2024-09-19T09:53:40.384465+0000","last_fullsized":"2024-09-19T09:53:40.384465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'28","last_scrub_stamp":"2024-09-19T09:53:40.384385+0000","last_deep_scrub":"25'28","last_deep_scrub_stamp":"2024-09-19T09:53:40.384385+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.384385+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:47.412653+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'7286","reported_seq":7316,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:44.277427+0000","last_change":"2024-09-19T09:53:44.277453+0000","last_active":"2024-09-19T09:53:44.277427+0000","last_peered":"2024-09-19T09:53:44.277427+0000","last_clean":"2024-09-19T09:53:44.277427+0000","last_became_active":"2024-09-19T09:42:37.512265+0000","last_became_peered":"2024-09-19T09:42:37.512265+0000","last_unstale":"2024-09-19T09:53:44.277427+0000","last_undegraded":"2024-09-19T09:53:44.277427+0000","last_fullsized":"2024-09-19T09:53:44.277427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7286","last_scrub_stamp":"2024-09-19T09:53:44.277305+0000","last_deep_scrub":"25'7286","last_deep_scrub_stamp":"2024-09-19T09:53:44.277305+0000","last_clean_scrub_stamp":"2024-09-19T09:53:44.277305+0000","objects_scrubbed":0,"log_size":7286,"log_dups_size":0,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:20.260190+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110915,"num_write_kb":1387536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'25","reported_seq":57,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-19T09:53:40.568347+0000","last_change":"2024-09-19T09:53:40.568399+0000","last_active":"2024-09-19T09:53:40.568347+0000","last_peered":"2024-09-19T09:53:40.568347+0000","last_clean":"2024-09-19T09:53:40.568347+0000","last_became_active":"2024-09-19T09:42:36.504703+0000","last_became_peered":"2024-09-19T09:42:36.504703+0000","last_unstale":"2024-09-19T09:53:40.568347+0000","last_undegraded":"2024-09-19T09:53:40.568347+0000","last_fullsized":"2024-09-19T09:53:40.568347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'25","last_scrub_stamp":"2024-09-19T09:53:40.568257+0000","last_deep_scrub":"25'25","last_deep_scrub_stamp":"2024-09-19T09:53:40.568257+0000","last_clean_scrub_stamp":"2024-09-19T09:53:40.568257+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:30.131143+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6761782,"num_write_kb":82954764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":444924,"ondisk_log_size":444924,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":209498148,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":24,"num_read_kb":101,"num_write":2660,"num_write_kb":206607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":419061760,"data_stored":418996296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2653,"ondisk_log_size":2653,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509585,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705108,"kb_used_data":78660,"kb_used_omap":1,"kb_used_meta":626430,"kb_avail":93666732,"statfs":{"total":96636764160,"available":95914733568,"internally_reserved":0,"allocated":80547840,"data_stored":80376143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":641464778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509583,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443924,"kb_used_data":61700,"kb_used_omap":1,"kb_used_meta":382206,"kb_avail":93927916,"statfs":{"total":96636764160,"available":96182185984,"internally_reserved":0,"allocated":63180800,"data_stored":63008649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":391379398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509584,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653352,"kb_used_data":49112,"kb_used_omap":1,"kb_used_meta":604222,"kb_avail":93718488,"statfs":{"total":96636764160,"available":95967731712,"internally_reserved":0,"allocated":50290688,"data_stored":50118553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618723781},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509584,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":679896,"kb_used_data":57608,"kb_used_omap":1,"kb_used_meta":622270,"kb_avail":93691944,"statfs":{"total":96636764160,"available":95940550656,"internally_reserved":0,"allocated":58990592,"data_stored":58813799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":637204933},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509581,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":649708,"kb_used_data":41308,"kb_used_omap":1,"kb_used_meta":608382,"kb_avail":93722132,"statfs":{"total":96636764160,"available":95971463168,"internally_reserved":0,"allocated":42299392,"data_stored":42125209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":622983623},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509584,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435372,"kb_used_data":57308,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93936468,"statfs":{"total":96636764160,"available":96190943232,"internally_reserved":0,"allocated":58683392,"data_stored":58507231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":387119557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509584,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":672412,"kb_used_data":45900,"kb_used_omap":1,"kb_used_meta":626494,"kb_avail":93699428,"statfs":{"total":96636764160,"available":95948214272,"internally_reserved":0,"allocated":47001600,"data_stored":46821767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":641530310},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421092,"kb_used_data":20820,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93950748,"statfs":{"total":96636764160,"available":96205565952,"internally_reserved":0,"allocated":21319680,"data_stored":21153017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":409860549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58425344,"data_stored":58413814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21061632,"data_stored":21059600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42041344,"data_stored":42031792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58732544,"data_stored":58720382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50032640,"data_stored":50025136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:54:22.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T09:54:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.739+0000 7f011cb6d640 1 Processor -- start 2024-09-19T09:54:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.739+0000 7f011cb6d640 1 -- start start 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.740+0000 7f011cb6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f011814edd0 0x7f011815b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.740+0000 7f011cb6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01180c9a30 0x7f01181588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.740+0000 7f011cb6d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180720d0 con 0x7f01180724a0 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.740+0000 7f011cb6d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0118071110 con 0x7f011814edd0 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.740+0000 7f011cb6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0118157e10 con 0x7f01180c9a30 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f011814edd0 0x7f011815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f0116d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f01180724a0 0x7f01180c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32882/0 (socket says 172.21.15.123:32882) 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f011814edd0 0x7f011815b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42862/0 (socket says 172.21.15.123:42862) 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f0116d9d640 1 -- 172.21.15.123:0/2752912025 learned_addr learned my addr 172.21.15.123:0/2752912025 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:54:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f0115d9b640 1 --2- 172.21.15.123:0/2752912025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01180c9a30 0x7f01181588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011659c640 1 -- 172.21.15.123:0/2752912025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01180c9a30 msgr2=0x7f01181588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011659c640 1 --2- 172.21.15.123:0/2752912025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01180c9a30 0x7f01181588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011659c640 1 -- 172.21.15.123:0/2752912025 >> v1:172.21.15.123:6789/0 conn(0x7f01180724a0 legacy=0x7f01180c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011559a640 1 -- 172.21.15.123:0/2752912025 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092159428 0 0) 0x7f01180720d0 con 0x7f01180724a0 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.741+0000 7f011659c640 1 -- 172.21.15.123:0/2752912025 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118071360 con 0x7f011814edd0 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011659c640 1 --2- 172.21.15.123:0/2752912025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011814edd0 0x7f011815b380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01000097a0 tx=0x7f010002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f666160af6cdcf0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011559a640 1 -- 172.21.15.123:0/2752912025 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100037070 con 0x7f011814edd0 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011559a640 1 -- 172.21.15.123:0/2752912025 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010002ae50 con 0x7f011814edd0 2024-09-19T09:54:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011559a640 1 -- 172.21.15.123:0/2752912025 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100032660 con 0x7f011814edd0 2024-09-19T09:54:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 -- 172.21.15.123:0/2752912025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011814edd0 msgr2=0x7f011815b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 --2- 172.21.15.123:0/2752912025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011814edd0 0x7f011815b380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01000097a0 tx=0x7f010002a100 comp rx=0 tx=0).stop 2024-09-19T09:54:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 -- 172.21.15.123:0/2752912025 shutdown_connections 2024-09-19T09:54:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 --2- 172.21.15.123:0/2752912025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01180c9a30 0x7f01181588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 --2- 172.21.15.123:0/2752912025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f011814edd0 0x7f011815b380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 -- 172.21.15.123:0/2752912025 >> 172.21.15.123:0/2752912025 conn(0x7f011806ed00 msgr2=0x7f011806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 -- 172.21.15.123:0/2752912025 shutdown_connections 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.742+0000 7f011cb6d640 1 -- 172.21.15.123:0/2752912025 wait complete. 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 Processor -- start 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 -- start start 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01180724a0 0x7f0118164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 0x7f01181f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f011814edd0 0x7f01181eb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01181583b0 con 0x7f01180c9a30 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f01181580d0 con 0x7f01180724a0 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f011cb6d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f0118071c80 con 0x7f011814edd0 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f0115d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 0x7f01181f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f0115d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 0x7f01181f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42870/0 (socket says 172.21.15.123:42870) 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.744+0000 7f0115d9b640 1 -- 172.21.15.123:0/872913383 learned_addr learned my addr 172.21.15.123:0/872913383 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:22.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0116d9d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f011814edd0 0x7f01181eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0115d9b640 1 -- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f011814edd0 msgr2=0x7f01181eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0115d9b640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f011814edd0 0x7f01181eb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f011659c640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01180724a0 0x7f0118164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0115d9b640 1 -- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01180724a0 msgr2=0x7f0118164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0115d9b640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01180724a0 0x7f0118164b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0115d9b640 1 -- 172.21.15.123:0/872913383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011814b7d0 con 0x7f01180c9a30 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f0115d9b640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 0x7f01181f1200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f010800e870 tx=0x7f010800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108017070 con 0x7f01180c9a30 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010800c940 con 0x7f01180c9a30 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010800cd30 con 0x7f01180c9a30 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01181f1ac0 con 0x7f01180c9a30 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.745+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181f1d60 con 0x7f01180c9a30 2024-09-19T09:54:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.746+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0118071f50 con 0x7f01180c9a30 2024-09-19T09:54:22.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.746+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f010801a070 con 0x7f01180c9a30 2024-09-19T09:54:22.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.747+0000 7f010effd640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f00f806c2b0 0x7f00f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:22.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.747+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f010808b360 con 0x7f01180c9a30 2024-09-19T09:54:22.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.747+0000 7f011659c640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f00f806c2b0 0x7f00f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:22.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.747+0000 7f011659c640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f00f806c2b0 0x7f00f806e770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0100034000 tx=0x7f010002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:22.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.751+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0108059a50 con 0x7f01180c9a30 2024-09-19T09:54:22.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.919+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f01180c3440 con 0x7f01180c9a30 2024-09-19T09:54:22.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.922+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f0108059350 con 0x7f01180c9a30 2024-09-19T09:54:22.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.923+0000 7f010effd640 1 -- 172.21.15.123:0/872913383 <== mon.0 v2:172.21.15.123:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f010805d700 con 0x7f01180c9a30 2024-09-19T09:54:22.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f00f806c2b0 msgr2=0x7f00f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f00f806c2b0 0x7f00f806e770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0100034000 tx=0x7f010002e000 comp rx=0 tx=0).stop 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 msgr2=0x7f01181f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 0x7f01181f1200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f010800e870 tx=0x7f010800ed30 comp rx=0 tx=0).stop 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 shutdown_connections 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f00f806c2b0 0x7f00f806e770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f011814edd0 0x7f01181eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01180c9a30 0x7f01181f1200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 --2- 172.21.15.123:0/872913383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01180724a0 0x7f0118164b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 >> 172.21.15.123:0/872913383 conn(0x7f011806ed00 msgr2=0x7f01180c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 shutdown_connections 2024-09-19T09:54:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:22.925+0000 7f011cb6d640 1 -- 172.21.15.123:0/872913383 wait complete. 2024-09-19T09:54:22.939 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:54:22.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:54:23.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.034+0000 7f29089a1640 1 Processor -- start 2024-09-19T09:54:23.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.034+0000 7f29089a1640 1 -- start start 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f29089a1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2904151fc0 0x7f29040c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f29089a1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2904157e20 con 0x7f2904072770 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f29089a1640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2904072100 con 0x7f29041523a0 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f29089a1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f29040723e0 con 0x7f2904151fc0 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f290259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2904151fc0 0x7f29040c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f290259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2904151fc0 0x7f29040c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42876/0 (socket says 172.21.15.123:42876) 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f290259c640 1 -- 172.21.15.123:0/333124074 learned_addr learned my addr 172.21.15.123:0/333124074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f2902d9d640 1 --1- 172.21.15.123:0/333124074 >> v1:172.21.15.123:6789/0 conn(0x7f2904072770 0x7f2904162760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32894/0 (socket says 172.21.15.123:32894) 2024-09-19T09:54:23.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f290259c640 1 -- 172.21.15.123:0/333124074 >> v1:172.21.15.194:6789/0 conn(0x7f29041523a0 legacy=0x7f29040710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:23.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f290259c640 1 -- 172.21.15.123:0/333124074 >> v1:172.21.15.123:6789/0 conn(0x7f2904072770 legacy=0x7f2904162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f290259c640 1 -- 172.21.15.123:0/333124074 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29041580e0 con 0x7f2904151fc0 2024-09-19T09:54:23.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.035+0000 7f2901d9b640 1 -- 172.21.15.123:0/333124074 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197946683 0 0) 0x7f2904157e20 con 0x7f2904072770 2024-09-19T09:54:23.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.036+0000 7f290259c640 1 --2- 172.21.15.123:0/333124074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904151fc0 0x7f29040c88b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009870 tx=0x7f28f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298e8afcf454520f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.036+0000 7f2901d9b640 1 -- 172.21.15.123:0/333124074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4037070 con 0x7f2904151fc0 2024-09-19T09:54:23.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.036+0000 7f2901d9b640 1 -- 172.21.15.123:0/333124074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f28f4032440 con 0x7f2904151fc0 2024-09-19T09:54:23.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.036+0000 7f2901d9b640 1 -- 172.21.15.123:0/333124074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4032830 con 0x7f2904151fc0 2024-09-19T09:54:23.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 -- 172.21.15.123:0/333124074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904151fc0 msgr2=0x7f29040c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 --2- 172.21.15.123:0/333124074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904151fc0 0x7f29040c88b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009870 tx=0x7f28f402a210 comp rx=0 tx=0).stop 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 -- 172.21.15.123:0/333124074 shutdown_connections 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 --2- 172.21.15.123:0/333124074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904151fc0 0x7f29040c88b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 -- 172.21.15.123:0/333124074 >> 172.21.15.123:0/333124074 conn(0x7f290406ec90 msgr2=0x7f290406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 -- 172.21.15.123:0/333124074 shutdown_connections 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.037+0000 7f29089a1640 1 -- 172.21.15.123:0/333124074 wait complete. 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.038+0000 7f29089a1640 1 Processor -- start 2024-09-19T09:54:23.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.038+0000 7f29089a1640 1 -- start start 2024-09-19T09:54:23.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f29089a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 0x7f29041ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f29089a1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2904151fc0 0x7f2904159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f29089a1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2904152ae0 0x7f2904152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f29089a1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2904071980 con 0x7f2904072770 2024-09-19T09:54:23.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f29089a1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2904071800 con 0x7f2904152ae0 2024-09-19T09:54:23.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f29089a1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f290415b3d0 con 0x7f2904151fc0 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 0x7f29041ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 0x7f29041ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42886/0 (socket says 172.21.15.123:42886) 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 -- 172.21.15.123:0/3638895889 learned_addr learned my addr 172.21.15.123:0/3638895889 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f2902d9d640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2904152ae0 0x7f2904152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f28f9d9b640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2904151fc0 0x7f2904159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 -- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2904151fc0 msgr2=0x7f2904159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2904151fc0 0x7f2904159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 -- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2904152ae0 msgr2=0x7f2904152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2904152ae0 0x7f2904152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.039+0000 7f290259c640 1 -- 172.21.15.123:0/3638895889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2904153480 con 0x7f2904072770 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.040+0000 7f290259c640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 0x7f29041ed810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009990 tx=0x7f28f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.040+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4037040 con 0x7f2904072770 2024-09-19T09:54:23.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.040+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f28f4004230 con 0x7f2904072770 2024-09-19T09:54:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.040+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290414d4d0 con 0x7f2904072770 2024-09-19T09:54:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.040+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4030770 con 0x7f2904072770 2024-09-19T09:54:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.040+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f290414da90 con 0x7f2904072770 2024-09-19T09:54:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.041+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29040c3800 con 0x7f2904072770 2024-09-19T09:54:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.041+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f28f4030910 con 0x7f2904072770 2024-09-19T09:54:23.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.042+0000 7f28fb7fe640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f28e406c2e0 0x7f28e406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.042+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f28f40ac470 con 0x7f2904072770 2024-09-19T09:54:23.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.042+0000 7f28f9d9b640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f28e406c2e0 0x7f28e406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.042+0000 7f28f9d9b640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f28e406c2e0 0x7f28e406e7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2904073090 tx=0x7f28ec009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.046+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f28f407a630 con 0x7f2904072770 2024-09-19T09:54:23.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.244+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29040c4270 con 0x7f2904072770 2024-09-19T09:54:23.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.244+0000 7f28fb7fe640 1 -- 172.21.15.123:0/3638895889 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f28f407e930 con 0x7f2904072770 2024-09-19T09:54:23.248 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:54:23.248 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:54:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:54:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f28e406c2e0 msgr2=0x7f28e406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f28e406c2e0 0x7f28e406e7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2904073090 tx=0x7f28ec009060 comp rx=0 tx=0).stop 2024-09-19T09:54:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 msgr2=0x7f29041ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 0x7f29041ed810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009990 tx=0x7f28f40046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 shutdown_connections 2024-09-19T09:54:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2904152ae0 0x7f2904152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.246+0000 7f29089a1640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f28e406c2e0 0x7f28e406e7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.247+0000 7f29089a1640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2904151fc0 0x7f2904159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.247+0000 7f29089a1640 1 --2- 172.21.15.123:0/3638895889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2904072770 0x7f29041ed810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.247+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 >> 172.21.15.123:0/3638895889 conn(0x7f290406ec90 msgr2=0x7f29040c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.247+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 shutdown_connections 2024-09-19T09:54:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.247+0000 7f29089a1640 1 -- 172.21.15.123:0/3638895889 wait complete. 2024-09-19T09:54:23.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:54:23.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.357+0000 7f270ed31640 1 Processor -- start 2024-09-19T09:54:23.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.357+0000 7f270ed31640 1 -- start start 2024-09-19T09:54:23.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270ed31640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f270815e7e0 0x7f27080cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270ed31640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27080c9970 0x7f270815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270ed31640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080ccbb0 con 0x7f27080cbc40 2024-09-19T09:54:23.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270ed31640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f27080c7640 con 0x7f270815e7e0 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270ed31640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f27080cce90 con 0x7f27080c9970 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270cacd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f270815e7e0 0x7f27080cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270cacd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f270815e7e0 0x7f27080cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50246/0 (socket says 172.21.15.123:50246) 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270cacd640 1 -- 172.21.15.123:0/3736655165 learned_addr learned my addr 172.21.15.123:0/3736655165 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f2707fff640 1 --2- 172.21.15.123:0/3736655165 >> v2:172.21.15.194:3300/0 conn(0x7f27080c9970 0x7f270815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.358+0000 7f270cacd640 1 -- 172.21.15.123:0/3736655165 >> v2:172.21.15.194:3300/0 conn(0x7f27080c9970 msgr2=0x7f270815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f270cacd640 1 --2- 172.21.15.123:0/3736655165 >> v2:172.21.15.194:3300/0 conn(0x7f27080c9970 0x7f270815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f270cacd640 1 -- 172.21.15.123:0/3736655165 >> v1:172.21.15.194:6789/0 conn(0x7f27080cbc40 legacy=0x7f270815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f270cacd640 1 -- 172.21.15.123:0/3736655165 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27080c8bb0 con 0x7f270815e7e0 2024-09-19T09:54:23.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f270cacd640 1 --2- 172.21.15.123:0/3736655165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f270815e7e0 0x7f27080cecd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27080b66f0 tx=0x7f26f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174b86ae61c0937d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f27077fe640 1 -- 172.21.15.123:0/3736655165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8037070 con 0x7f270815e7e0 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f27077fe640 1 -- 172.21.15.123:0/3736655165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26f8032440 con 0x7f270815e7e0 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.359+0000 7f27077fe640 1 -- 172.21.15.123:0/3736655165 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8032830 con 0x7f270815e7e0 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 -- 172.21.15.123:0/3736655165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f270815e7e0 msgr2=0x7f27080cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 --2- 172.21.15.123:0/3736655165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f270815e7e0 0x7f27080cecd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27080b66f0 tx=0x7f26f802a270 comp rx=0 tx=0).stop 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 -- 172.21.15.123:0/3736655165 shutdown_connections 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 --2- 172.21.15.123:0/3736655165 >> v2:172.21.15.194:3300/0 conn(0x7f27080c9970 0x7f270815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 --2- 172.21.15.123:0/3736655165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f270815e7e0 0x7f27080cecd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 -- 172.21.15.123:0/3736655165 >> 172.21.15.123:0/3736655165 conn(0x7f27080d0f00 msgr2=0x7f27080d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 -- 172.21.15.123:0/3736655165 shutdown_connections 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.360+0000 7f270ed31640 1 -- 172.21.15.123:0/3736655165 wait complete. 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.361+0000 7f270ed31640 1 Processor -- start 2024-09-19T09:54:23.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.361+0000 7f270ed31640 1 -- start start 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270ed31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 0x7f2708152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270ed31640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27080cbc40 0x7f27081f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270ed31640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f270815e7e0 0x7f27081f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270ed31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f27080c9170 con 0x7f27080c9970 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270ed31640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f27080c94e0 con 0x7f27080cbc40 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270ed31640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f270815f450 con 0x7f270815e7e0 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 0x7f2708152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 0x7f2708152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50256/0 (socket says 172.21.15.123:50256) 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 -- 172.21.15.123:0/3371337810 learned_addr learned my addr 172.21.15.123:0/3371337810 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270d2ce640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f270815e7e0 0x7f27081f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f2707fff640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27080cbc40 0x7f27081f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 -- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f270815e7e0 msgr2=0x7f27081f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f270815e7e0 0x7f27081f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 -- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27080cbc40 msgr2=0x7f27081f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27080cbc40 0x7f27081f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270cacd640 1 -- 172.21.15.123:0/3371337810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27081e5b40 con 0x7f27080c9970 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f2707fff640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27080cbc40 0x7f27081f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.362+0000 7f270d2ce640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f270815e7e0 0x7f27081f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.363+0000 7f270cacd640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 0x7f2708152ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26f802a2b0 tx=0x7f26f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.363+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8037040 con 0x7f27080c9970 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.363+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26f8042070 con 0x7f27080c9970 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.363+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8030920 con 0x7f27080c9970 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.363+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27081e5e20 con 0x7f27080c9970 2024-09-19T09:54:23.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.363+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27081e63e0 con 0x7f27080c9970 2024-09-19T09:54:23.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.364+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27080cd090 con 0x7f27080c9970 2024-09-19T09:54:23.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.364+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26f8030ac0 con 0x7f27080c9970 2024-09-19T09:54:23.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.365+0000 7f27057fa640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26f406c2b0 0x7f26f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.365+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f26f80abf10 con 0x7f27080c9970 2024-09-19T09:54:23.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.365+0000 7f2707fff640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26f406c2b0 0x7f26f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.365+0000 7f2707fff640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26f406c2b0 0x7f26f406e770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009b90 tx=0x7f26fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.369+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f26f807a570 con 0x7f27080c9970 2024-09-19T09:54:23.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.569+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27081e6a20 con 0x7f27080c9970 2024-09-19T09:54:23.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.570+0000 7f27057fa640 1 -- 172.21.15.123:0/3371337810 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6878 (secure 0 0 0) 0x7f26f8079e70 con 0x7f27080c9970 2024-09-19T09:54:23.573 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:54:23.573 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"btime":"2024-09-19T09:42:42:526069+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/339264970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":339264970},{"type":"v1","addr":"172.21.15.194:6833","nonce":339264970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2777041155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2777041155},{"type":"v1","addr":"172.21.15.194:6837","nonce":2777041155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/2192684829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2192684829},{"type":"v1","addr":"172.21.15.194:6836","nonce":2192684829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/186368984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":186368984},{"type":"v1","addr":"172.21.15.123:6836","nonce":186368984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2473813052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":2473813052},{"type":"v1","addr":"172.21.15.123:6837","nonce":2473813052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:42:36.824422+0000","modified":"2024-09-19T09:42:42.526063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/1314641752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":1314641752},{"type":"v1","addr":"172.21.15.123:6839","nonce":1314641752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308]},"id":1}]} 2024-09-19T09:54:23.574 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-09-19T09:54:23.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26f406c2b0 msgr2=0x7f26f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26f406c2b0 0x7f26f406e770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009b90 tx=0x7f26fc008040 comp rx=0 tx=0).stop 2024-09-19T09:54:23.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 msgr2=0x7f2708152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 0x7f2708152ab0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26f802a2b0 tx=0x7f26f80046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 shutdown_connections 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f26f406c2b0 0x7f26f406e770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f270815e7e0 0x7f27081f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27080cbc40 0x7f27081f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 --2- 172.21.15.123:0/3371337810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27080c9970 0x7f2708152ab0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 >> 172.21.15.123:0/3371337810 conn(0x7f27080d0f00 msgr2=0x7f27080d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 shutdown_connections 2024-09-19T09:54:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.572+0000 7f270ed31640 1 -- 172.21.15.123:0/3371337810 wait complete. 2024-09-19T09:54:23.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:54:23.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.682+0000 7fad7a0d0640 1 Processor -- start 2024-09-19T09:54:23.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.682+0000 7fad7a0d0640 1 -- start start 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad7a0d0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad74152e00 0x7fad7415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad7a0d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7406de20 0x7fad741598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad7a0d0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad74159e10 con 0x7fad74073260 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad7a0d0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fad7415c440 con 0x7fad74152e00 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad7a0d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fad7415ca00 con 0x7fad7406de20 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad74152e00 0x7fad7415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad74152e00 0x7fad7415ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50258/0 (socket says 172.21.15.123:50258) 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad73fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fad74073260 0x7fad740c5e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36418/0 (socket says 172.21.15.123:36418) 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 -- 172.21.15.123:0/2740894554 learned_addr learned my addr 172.21.15.123:0/2740894554 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad6bfff640 1 --2- 172.21.15.123:0/2740894554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7406de20 0x7fad741598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 -- 172.21.15.123:0/2740894554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7406de20 msgr2=0x7fad741598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 --2- 172.21.15.123:0/2740894554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7406de20 0x7fad741598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 -- 172.21.15.123:0/2740894554 >> v1:172.21.15.123:6789/0 conn(0x7fad74073260 legacy=0x7fad740c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad737fe640 1 -- 172.21.15.123:0/2740894554 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad740c8700 con 0x7fad74152e00 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.683+0000 7fad72ffd640 1 -- 172.21.15.123:0/2740894554 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101313125 0 0) 0x7fad6c001490 con 0x7fad74073260 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad737fe640 1 --2- 172.21.15.123:0/2740894554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad74152e00 0x7fad7415ce90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad64009870 tx=0x7fad6402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8681cd414dca238 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad72ffd640 1 -- 172.21.15.123:0/2740894554 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64037070 con 0x7fad74152e00 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad72ffd640 1 -- 172.21.15.123:0/2740894554 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fad6402ae50 con 0x7fad74152e00 2024-09-19T09:54:23.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad72ffd640 1 -- 172.21.15.123:0/2740894554 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64032880 con 0x7fad74152e00 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2740894554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad74152e00 msgr2=0x7fad7415ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2740894554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad74152e00 0x7fad7415ce90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad64009870 tx=0x7fad6402a300 comp rx=0 tx=0).stop 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.684+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2740894554 shutdown_connections 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.685+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2740894554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7406de20 0x7fad741598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.685+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2740894554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad74152e00 0x7fad7415ce90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.685+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2740894554 >> 172.21.15.123:0/2740894554 conn(0x7fad740ce9b0 msgr2=0x7fad740ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.685+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2740894554 shutdown_connections 2024-09-19T09:54:23.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.685+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2740894554 wait complete. 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 Processor -- start 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 -- start start 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 0x7fad7415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad74073260 0x7fad740ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad74152e00 0x7fad741484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad740c8cc0 con 0x7fad7406de20 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fad7415d3d0 con 0x7fad74152e00 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad7a0d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7fad7415c690 con 0x7fad74073260 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 0x7fad7415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad737fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 0x7fad7415b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50266/0 (socket says 172.21.15.123:50266) 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.686+0000 7fad737fe640 1 -- 172.21.15.123:0/2767128559 learned_addr learned my addr 172.21.15.123:0/2767128559 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad6bfff640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad74073260 0x7fad740ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad737fe640 1 -- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad74073260 msgr2=0x7fad740ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad737fe640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad74073260 0x7fad740ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad737fe640 1 -- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad74152e00 msgr2=0x7fad741484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad737fe640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad74152e00 0x7fad741484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad737fe640 1 -- 172.21.15.123:0/2767128559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad74149370 con 0x7fad7406de20 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad737fe640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 0x7fad7415b6d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad64000c00 tx=0x7fad640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64041070 con 0x7fad7406de20 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fad6403c870 con 0x7fad7406de20 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad741e6690 con 0x7fad7406de20 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64037040 con 0x7fad7406de20 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.687+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad740cddd0 con 0x7fad7406de20 2024-09-19T09:54:23.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.688+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad740cabf0 con 0x7fad7406de20 2024-09-19T09:54:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.688+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fad64044070 con 0x7fad7406de20 2024-09-19T09:54:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.689+0000 7fad70ff9640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad5406c2b0 0x7fad5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.689+0000 7fad6bfff640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad5406c2b0 0x7fad5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.689+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fad640ac050 con 0x7fad7406de20 2024-09-19T09:54:23.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.689+0000 7fad6bfff640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad5406c2b0 0x7fad5406e770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad5c006fd0 tx=0x7fad5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.693+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fad740cabf0 con 0x7fad7406de20 2024-09-19T09:54:23.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.863+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad741531e0 con 0x7fad7406de20 2024-09-19T09:54:23.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.864+0000 7fad70ff9640 1 -- 172.21.15.123:0/2767128559 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16892 (secure 0 0 0) 0x7fad6407a7d0 con 0x7fad7406de20 2024-09-19T09:54:23.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-19T09:54:23.867 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"fsid":"837baa2f-03c1-414f-aff3-ae2b21065b15","created":"2024-09-19T09:42:14.648197+0000","modified":"2024-09-19T09:43:20.608350+0000","last_up_change":"2024-09-19T09:42:27.397488+0000","last_in_change":"2024-09-19T09:42:16.710645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:42:28.726550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:42:35.427299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:42:35.797333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"184c1d58-a744-4d9f-924d-453709c92009","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6827","nonce":202872460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6829","nonce":202872460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6833","nonce":202872460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":202872460},{"type":"v1","addr":"172.21.15.123:6831","nonce":202872460}]},"public_addr":"172.21.15.123:6827/202872460","cluster_addr":"172.21.15.123:6829/202872460","heartbeat_back_addr":"172.21.15.123:6833/202872460","heartbeat_front_addr":"172.21.15.123:6831/202872460","state":["exists","up"]},{"osd":1,"uuid":"5777b9a1-1974-47d1-85c0-51d92a35271e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6802","nonce":1169600851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6806","nonce":1169600851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6814","nonce":1169600851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1169600851},{"type":"v1","addr":"172.21.15.123:6810","nonce":1169600851}]},"public_addr":"172.21.15.123:6802/1169600851","cluster_addr":"172.21.15.123:6806/1169600851","heartbeat_back_addr":"172.21.15.123:6814/1169600851","heartbeat_front_addr":"172.21.15.123:6810/1169600851","state":["exists","up"]},{"osd":2,"uuid":"f35e9331-0589-4735-a00e-892e21ac0f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6801","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6803","nonce":2615633995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6805","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6807","nonce":2615633995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6815","nonce":2615633995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":2615633995},{"type":"v1","addr":"172.21.15.123:6811","nonce":2615633995}]},"public_addr":"172.21.15.123:6803/2615633995","cluster_addr":"172.21.15.123:6807/2615633995","heartbeat_back_addr":"172.21.15.123:6815/2615633995","heartbeat_front_addr":"172.21.15.123:6811/2615633995","state":["exists","up"]},{"osd":3,"uuid":"b4c04a04-7f30-4053-88a6-e3999460781a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6817","nonce":116101554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6819","nonce":116101554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6823","nonce":116101554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":116101554},{"type":"v1","addr":"172.21.15.123:6821","nonce":116101554}]},"public_addr":"172.21.15.123:6817/116101554","cluster_addr":"172.21.15.123:6819/116101554","heartbeat_back_addr":"172.21.15.123:6823/116101554","heartbeat_front_addr":"172.21.15.123:6821/116101554","state":["exists","up"]},{"osd":4,"uuid":"400da593-7bbe-4427-8e55-a7d0225a8ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6809","nonce":3240452263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6811","nonce":3240452263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6815","nonce":3240452263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3240452263},{"type":"v1","addr":"172.21.15.194:6813","nonce":3240452263}]},"public_addr":"172.21.15.194:6809/3240452263","cluster_addr":"172.21.15.194:6811/3240452263","heartbeat_back_addr":"172.21.15.194:6815/3240452263","heartbeat_front_addr":"172.21.15.194:6813/3240452263","state":["exists","up"]},{"osd":5,"uuid":"b48779a9-4c3f-478b-b59d-8a1847604bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6825","nonce":3240582688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6827","nonce":3240582688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6831","nonce":3240582688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3240582688},{"type":"v1","addr":"172.21.15.194:6829","nonce":3240582688}]},"public_addr":"172.21.15.194:6825/3240582688","cluster_addr":"172.21.15.194:6827/3240582688","heartbeat_back_addr":"172.21.15.194:6831/3240582688","heartbeat_front_addr":"172.21.15.194:6829/3240582688","state":["exists","up"]},{"osd":6,"uuid":"0713ee56-1d00-45f2-8c41-1ef47f6cf615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6801","nonce":2256990025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6803","nonce":2256990025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6807","nonce":2256990025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2256990025},{"type":"v1","addr":"172.21.15.194:6805","nonce":2256990025}]},"public_addr":"172.21.15.194:6801/2256990025","cluster_addr":"172.21.15.194:6803/2256990025","heartbeat_back_addr":"172.21.15.194:6807/2256990025","heartbeat_front_addr":"172.21.15.194:6805/2256990025","state":["exists","up"]},{"osd":7,"uuid":"cda99eb2-00e3-480a-8893-f9578f04a092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6817","nonce":125762816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6819","nonce":125762816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6823","nonce":125762816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":125762816},{"type":"v1","addr":"172.21.15.194:6821","nonce":125762816}]},"public_addr":"172.21.15.194:6817/125762816","cluster_addr":"172.21.15.194:6819/125762816","heartbeat_back_addr":"172.21.15.194:6823/125762816","heartbeat_front_addr":"172.21.15.194:6821/125762816","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.018331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.697145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.493222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.078016+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.999404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.093473+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:23.758370+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:42:24.131878+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:54:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad5406c2b0 msgr2=0x7fad5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad5406c2b0 0x7fad5406e770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad5c006fd0 tx=0x7fad5c008040 comp rx=0 tx=0).stop 2024-09-19T09:54:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 msgr2=0x7fad7415b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 0x7fad7415b6d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad64000c00 tx=0x7fad640046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 shutdown_connections 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad74152e00 0x7fad741484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7fad5406c2b0 0x7fad5406e770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad74073260 0x7fad740ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 --2- 172.21.15.123:0/2767128559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad7406de20 0x7fad7415b6d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 >> 172.21.15.123:0/2767128559 conn(0x7fad740ce9b0 msgr2=0x7fad74158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 shutdown_connections 2024-09-19T09:54:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.866+0000 7fad7a0d0640 1 -- 172.21.15.123:0/2767128559 wait complete. 2024-09-19T09:54:23.880 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:54:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.977+0000 7f8dc0ed0640 1 Processor -- start 2024-09-19T09:54:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.977+0000 7f8dc0ed0640 1 -- start start 2024-09-19T09:54:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dc0ed0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc15b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dc0ed0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8dbc0c9a30 0x7f8dbc1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dc0ed0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dbc0720d0 con 0x7f8dbc0724a0 2024-09-19T09:54:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dc0ed0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8dbc071110 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dc0ed0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc157e10 con 0x7f8dbc14edd0 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8dbc0c9a30 0x7f8dbc1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8dbc0c9a30 0x7f8dbc1588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50270/0 (socket says 172.21.15.123:50270) 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 -- 172.21.15.123:0/1560761699 learned_addr learned my addr 172.21.15.123:0/1560761699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dba59c640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 -- 172.21.15.123:0/1560761699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 msgr2=0x7f8dbc15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 -- 172.21.15.123:0/1560761699 >> v1:172.21.15.123:6789/0 conn(0x7f8dbc0724a0 legacy=0x7f8dbc0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db9d9b640 1 -- 172.21.15.123:0/1560761699 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc071360 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8db959a640 1 -- 172.21.15.123:0/1560761699 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104417946 0 0) 0x7f8dbc0720d0 con 0x7f8dbc0724a0 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.978+0000 7f8dba59c640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.979+0000 7f8db9d9b640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc1588d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009870 tx=0x7f8da402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5932dfef514dabd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.979+0000 7f8db959a640 1 -- 172.21.15.123:0/1560761699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4037070 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.979+0000 7f8db959a640 1 -- 172.21.15.123:0/1560761699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8da4032440 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.979+0000 7f8db959a640 1 -- 172.21.15.123:0/1560761699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4032830 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/1560761699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 msgr2=0x7f8dbc1588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc1588d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009870 tx=0x7f8da402a1c0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/1560761699 shutdown_connections 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc1588d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/1560761699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/1560761699 >> 172.21.15.123:0/1560761699 conn(0x7f8dbc06ed00 msgr2=0x7f8dbc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/1560761699 shutdown_connections 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.980+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/1560761699 wait complete. 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.981+0000 7f8dc0ed0640 1 Processor -- start 2024-09-19T09:54:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.981+0000 7f8dc0ed0640 1 -- start start 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dc0ed0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dbc0724a0 0x7f8dbc149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dc0ed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dc0ed0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dc0ed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1583b0 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dc0ed0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1580d0 con 0x7f8dbc0724a0 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dc0ed0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc071c80 con 0x7f8dbc14edd0 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50286/0 (socket says 172.21.15.123:50286) 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 -- 172.21.15.123:0/4099397121 learned_addr learned my addr 172.21.15.123:0/4099397121 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dba59c640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dbc0724a0 0x7f8dbc149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8dbad9d640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 -- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 msgr2=0x7f8dbc143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 -- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dbc0724a0 msgr2=0x7f8dbc149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dbc0724a0 0x7f8dbc149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 -- 172.21.15.123:0/4099397121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc14be20 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.982+0000 7f8db9d9b640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc147e80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8da402a200 tx=0x7f8da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.983+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4037040 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.983+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8da4042070 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.983+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4030bf0 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.983+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc14c100 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.983+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc1473a0 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.984+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc15b380 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.984+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8da402ad10 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.984+0000 7f8db2ffd640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d9c06c2b0 0x7f8d9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:23.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.984+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f8da40abe10 con 0x7f8dbc0c9a30 2024-09-19T09:54:23.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.984+0000 7f8dba59c640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d9c06c2b0 0x7f8d9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:23.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.985+0000 7f8dba59c640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d9c06c2b0 0x7f8d9c06e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8dac007510 tx=0x7f8dac0074a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:23.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:23.989+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8da4045360 con 0x7f8dbc0c9a30 2024-09-19T09:54:24.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.187+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8dbc0c3440 con 0x7f8dbc0c9a30 2024-09-19T09:54:24.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.205+0000 7f8db2ffd640 1 -- 172.21.15.123:0/4099397121 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f8da407a500 con 0x7f8dbc0c9a30 2024-09-19T09:54:24.208 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:54:24.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d9c06c2b0 msgr2=0x7f8d9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d9c06c2b0 0x7f8d9c06e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8dac007510 tx=0x7f8dac0074a0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 msgr2=0x7f8dbc147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc147e80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8da402a200 tx=0x7f8da40046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 shutdown_connections 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d9c06c2b0 0x7f8d9c06e770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8dbc14edd0 0x7f8dbc143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dbc0c9a30 0x7f8dbc147e80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 --2- 172.21.15.123:0/4099397121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8dbc0724a0 0x7f8dbc149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 >> 172.21.15.123:0/4099397121 conn(0x7f8dbc06ed00 msgr2=0x7f8dbc0c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 shutdown_connections 2024-09-19T09:54:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.207+0000 7f8dc0ed0640 1 -- 172.21.15.123:0/4099397121 wait complete. 2024-09-19T09:54:24.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:54:24.259 INFO:tasks.ceph.mds.e.smithi123.stdout:starting mds.e at 2024-09-19T09:54:24.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.322+0000 7f8d66511640 1 Processor -- start 2024-09-19T09:54:24.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.322+0000 7f8d66511640 1 -- start start 2024-09-19T09:54:24.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.322+0000 7f8d66511640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d600c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.322+0000 7f8d66511640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d600c0cb0 con 0x7f8d6015b1c0 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.322+0000 7f8d66511640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6015b5a0 con 0x7f8d60155640 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.322+0000 7f8d66511640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6015f720 con 0x7f8d6015f290 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8d6015b1c0 0x7f8d600c78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36446/0 (socket says 172.21.15.123:36446) 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/2719873041 learned_addr learned my addr 172.21.15.123:0/2719873041 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d64aae640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d600c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621844058 0 0) 0x7f8d600c0cb0 con 0x7f8d6015b1c0 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d4c003520 con 0x7f8d6015b1c0 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759882646 0 0) 0x7f8d6015b5a0 con 0x7f8d60155640 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d600c0cb0 con 0x7f8d60155640 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 306290144 0 0) 0x7f8d4c003520 con 0x7f8d6015b1c0 2024-09-19T09:54:24.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 msgr2=0x7f8d600c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d600c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 >> v1:172.21.15.194:6789/0 conn(0x7f8d60155640 legacy=0x7f8d60071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600c8130 con 0x7f8d6015b1c0 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f8d48001670 con 0x7f8d6015b1c0 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d64aae640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d600c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 >> v1:172.21.15.123:6789/0 conn(0x7f8d6015b1c0 legacy=0x7f8d600c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d4c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0040b0 0x7f8d4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d4c004d40 0x7f8d4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c00bad0 con 0x7f8d4c0040b0 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c00bc80 con 0x7f8d4c004d40 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4c00be80 con 0x7f8d6015f290 2024-09-19T09:54:24.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0040b0 0x7f8d4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d5ffff640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d4c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.323+0000 7f8d64aae640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d4c004d40 0x7f8d4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 msgr2=0x7f8d4c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d4c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d4c004d40 msgr2=0x7f8d4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d4c004d40 0x7f8d4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/2719873041 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c003520 con 0x7f8d4c0040b0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5ffff640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6015f290 0x7f8d4c003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0040b0 0x7f8d4c004800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c190 tx=0x7f8d4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd8504b67a03457 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48007ce0 con 0x7f8d4c0040b0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8d48005ad0 con 0x7f8d4c0040b0 2024-09-19T09:54:24.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.324+0000 7f8d5effd640 1 -- 172.21.15.123:0/2719873041 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48007070 con 0x7f8d4c0040b0 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d66511640 1 -- 172.21.15.123:0/2719873041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0040b0 msgr2=0x7f8d4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d66511640 1 --2- 172.21.15.123:0/2719873041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d4c0040b0 0x7f8d4c004800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c190 tx=0x7f8d4c005830 comp rx=0 tx=0).stop 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d64aae640 1 -- 172.21.15.123:0/2719873041 reap_dead start 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d66511640 1 -- 172.21.15.123:0/2719873041 shutdown_connections 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d66511640 1 -- 172.21.15.123:0/2719873041 >> 172.21.15.123:0/2719873041 conn(0x7f8d60073880 msgr2=0x7f8d60073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d66511640 1 -- 172.21.15.123:0/2719873041 shutdown_connections 2024-09-19T09:54:24.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.325+0000 7f8d66511640 1 -- 172.21.15.123:0/2719873041 wait complete. 2024-09-19T09:54:24.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.326+0000 7f8d66511640 1 Processor -- start 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.326+0000 7f8d66511640 1 -- start start 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d66511640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d4c0040b0 0x7f8d600c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d66511640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 0x7f8d601f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d66511640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d600c18b0 0x7f8d6014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d66511640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600c86f0 con 0x7f8d600c3130 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d66511640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6015ee00 con 0x7f8d600c18b0 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d66511640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6015e7b0 con 0x7f8d4c0040b0 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 0x7f8d601f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 0x7f8d601f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50306/0 (socket says 172.21.15.123:50306) 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/4215895177 learned_addr learned my addr 172.21.15.123:0/4215895177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/4215895177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d4c0040b0 msgr2=0x7f8d600c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d4c0040b0 0x7f8d600c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/4215895177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d600c18b0 msgr2=0x7f8d6014f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d600c18b0 0x7f8d6014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.327+0000 7f8d5f7fe640 1 -- 172.21.15.123:0/4215895177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d601f11f0 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.328+0000 7f8d5f7fe640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 0x7f8d601f1cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c2b0 tx=0x7f8d480019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.328+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48037040 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.328+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8d48041070 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.328+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d600c3690 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.328+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d480047e0 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.328+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d600c3c50 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.329+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6015ea90 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.329+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d48004980 con 0x7f8d600c3130 2024-09-19T09:54:24.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.329+0000 7f8d5cff9640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d4006c2b0 0x7f8d4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.330+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5911+0+0 (secure 0 0 0) 0x7f8d480aaf10 con 0x7f8d600c3130 2024-09-19T09:54:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.330+0000 7f8d5ffff640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d4006c2b0 0x7f8d4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.330+0000 7f8d5ffff640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d4006c2b0 0x7f8d4006e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d50007fd0 tx=0x7f8d50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:24.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.335+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8d48079520 con 0x7f8d600c3130 2024-09-19T09:54:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:24.535+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8d600ca950 con 0x7f8d600c3130 2024-09-19T09:54:25.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.207+0000 7f8d5cff9640 1 -- 172.21.15.123:0/4215895177 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f8d48007df0 con 0x7f8d600c3130 2024-09-19T09:54:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d4006c2b0 msgr2=0x7f8d4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d4006c2b0 0x7f8d4006e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d50007fd0 tx=0x7f8d50009040 comp rx=0 tx=0).stop 2024-09-19T09:54:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 msgr2=0x7f8d601f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 0x7f8d601f1cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c2b0 tx=0x7f8d480019c0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 shutdown_connections 2024-09-19T09:54:25.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d600c18b0 0x7f8d6014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d600c3130 0x7f8d601f1cb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f8d4006c2b0 0x7f8d4006e770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 --2- 172.21.15.123:0/4215895177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d4c0040b0 0x7f8d600c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.209+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 >> 172.21.15.123:0/4215895177 conn(0x7f8d60073880 msgr2=0x7f8d601598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.210+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 shutdown_connections 2024-09-19T09:54:25.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.210+0000 7f8d66511640 1 -- 172.21.15.123:0/4215895177 wait complete. 2024-09-19T09:54:25.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:54:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.370+0000 7f7afaf78640 1 Processor -- start 2024-09-19T09:54:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.370+0000 7f7afaf78640 1 -- start start 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7afaf78640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7af40cdf40 0x7f7af4073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7afaf78640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7af415e650 0x7f7af4073790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7afaf78640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40cb580 con 0x7f7af40cdb60 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7afaf78640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7af40cb860 con 0x7f7af40cdf40 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7afaf78640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f7af40cbb40 con 0x7f7af415e650 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7af3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7af40cdf40 0x7f7af4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7af3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7af40cdf40 0x7f7af4073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50322/0 (socket says 172.21.15.123:50322) 2024-09-19T09:54:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7af3fff640 1 -- 172.21.15.123:0/989705356 learned_addr learned my addr 172.21.15.123:0/989705356 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.371+0000 7f7af9515640 1 --2- 172.21.15.123:0/989705356 >> v2:172.21.15.194:3300/0 conn(0x7f7af415e650 0x7f7af4073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af3fff640 1 -- 172.21.15.123:0/989705356 >> v2:172.21.15.194:3300/0 conn(0x7f7af415e650 msgr2=0x7f7af4073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af3fff640 1 --2- 172.21.15.123:0/989705356 >> v2:172.21.15.194:3300/0 conn(0x7f7af415e650 0x7f7af4073790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af3fff640 1 -- 172.21.15.123:0/989705356 >> v1:172.21.15.194:6789/0 conn(0x7f7af40cdb60 legacy=0x7f7af4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af3fff640 1 -- 172.21.15.123:0/989705356 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af40cbe20 con 0x7f7af40cdf40 2024-09-19T09:54:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af3fff640 1 --2- 172.21.15.123:0/989705356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af4073250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7af4074350 tx=0x7f7ae802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89dc01416e792ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af37fe640 1 -- 172.21.15.123:0/989705356 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8037070 con 0x7f7af40cdf40 2024-09-19T09:54:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af37fe640 1 -- 172.21.15.123:0/989705356 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7ae802ae50 con 0x7f7af40cdf40 2024-09-19T09:54:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.372+0000 7f7af37fe640 1 -- 172.21.15.123:0/989705356 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8032880 con 0x7f7af40cdf40 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 -- 172.21.15.123:0/989705356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 msgr2=0x7f7af4073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 --2- 172.21.15.123:0/989705356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af4073250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7af4074350 tx=0x7f7ae802a300 comp rx=0 tx=0).stop 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 -- 172.21.15.123:0/989705356 shutdown_connections 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 --2- 172.21.15.123:0/989705356 >> v2:172.21.15.194:3300/0 conn(0x7f7af415e650 0x7f7af4073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 --2- 172.21.15.123:0/989705356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af4073250 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 -- 172.21.15.123:0/989705356 >> 172.21.15.123:0/989705356 conn(0x7f7af406cab0 msgr2=0x7f7af406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 -- 172.21.15.123:0/989705356 shutdown_connections 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.373+0000 7f7afaf78640 1 -- 172.21.15.123:0/989705356 wait complete. 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.374+0000 7f7afaf78640 1 Processor -- start 2024-09-19T09:54:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.374+0000 7f7afaf78640 1 -- start start 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7afaf78640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7af40cdb60 0x7f7af40c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7afaf78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af40c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7afaf78640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af415e650 0x7f7af40b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7afaf78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7af40727d0 con 0x7f7af40cdf40 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7afaf78640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7af40c7b50 con 0x7f7af415e650 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7afaf78640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f7af40cc3e0 con 0x7f7af40cdb60 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af40c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af40c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50332/0 (socket says 172.21.15.123:50332) 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 -- 172.21.15.123:0/4100418459 learned_addr learned my addr 172.21.15.123:0/4100418459 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af8d14640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7af40cdb60 0x7f7af40c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af9515640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af415e650 0x7f7af40b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:25.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 -- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7af40cdb60 msgr2=0x7f7af40c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7af40cdb60 0x7f7af40c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 -- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af415e650 msgr2=0x7f7af40b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af415e650 0x7f7af40b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.375+0000 7f7af3fff640 1 -- 172.21.15.123:0/4100418459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af40c8480 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.376+0000 7f7af3fff640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af40c8ef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8000c00 tx=0x7f7ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.376+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8041020 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.376+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7ae803c890 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.376+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8037040 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.376+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af41f45f0 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.376+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af41f4b70 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.377+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af414efc0 con 0x7f7af40cdf40 2024-09-19T09:54:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.377+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ae8044020 con 0x7f7af40cdf40 2024-09-19T09:54:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.378+0000 7f7af17fa640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.378+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5911+0+0 (secure 0 0 0) 0x7f7ae80abb80 con 0x7f7af40cdf40 2024-09-19T09:54:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.378+0000 7f7af8d14640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.378+0000 7f7af8d14640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4001780 tx=0x7f7ae4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:25.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.382+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7ae804b030 con 0x7f7af40cdf40 2024-09-19T09:54:25.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:25.550+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7af4074030 con 0x7f7af40cdf40 2024-09-19T09:54:26.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.209+0000 7f7af17fa640 1 -- 172.21.15.123:0/4100418459 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f7ae8079c60 con 0x7f7af40cdf40 2024-09-19T09:54:26.211 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:54:26.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ae006c2e0 msgr2=0x7f7ae006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:26.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4001780 tx=0x7f7ae4009040 comp rx=0 tx=0).stop 2024-09-19T09:54:26.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 msgr2=0x7f7af40c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:26.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af40c8ef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8000c00 tx=0x7f7ae80046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 shutdown_connections 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7af415e650 0x7f7af40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af40cdf40 0x7f7af40c8ef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 --2- 172.21.15.123:0/4100418459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7af40cdb60 0x7f7af40c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 >> 172.21.15.123:0/4100418459 conn(0x7f7af406cab0 msgr2=0x7f7af41529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 shutdown_connections 2024-09-19T09:54:26.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.212+0000 7f7afaf78640 1 -- 172.21.15.123:0/4100418459 wait complete. 2024-09-19T09:54:26.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:54:26.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.328+0000 7f8788f66640 1 Processor -- start 2024-09-19T09:54:26.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.328+0000 7f8788f66640 1 -- start start 2024-09-19T09:54:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.329+0000 7f8788f66640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87841554a0 0x7f87840cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.329+0000 7f8788f66640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87840cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.329+0000 7f8788f66640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87840c9c90 con 0x7f87840c48b0 2024-09-19T09:54:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.329+0000 7f8788f66640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 -- 0x7f87840c9f30 con 0x7f87841554a0 2024-09-19T09:54:26.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.329+0000 7f8788f66640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f87840ca1d0 con 0x7f878415ecf0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f8781d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f87840c48b0 0x7f878415e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36458/0 (socket says 172.21.15.123:36458) 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f8781d9b640 1 -- 172.21.15.123:0/194568596 learned_addr learned my addr 172.21.15.123:0/194568596 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f8782d9d640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87840cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 --2- 172.21.15.123:0/194568596 >> v2:172.21.15.194:3300/0 conn(0x7f87841554a0 0x7f87840cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470111730 0 0) 0x7f87840c9c90 con 0x7f87840c48b0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8770003520 con 0x7f87840c48b0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 881983395 0 0) 0x7f8770003520 con 0x7f87840c48b0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 msgr2=0x7f87840cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87840cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 >> v2:172.21.15.194:3300/0 conn(0x7f87841554a0 msgr2=0x7f87840cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 --2- 172.21.15.123:0/194568596 >> v2:172.21.15.194:3300/0 conn(0x7f87841554a0 0x7f87840cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87840709d0 con 0x7f87840c48b0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2300831881 0 0) 0x7f876c001670 con 0x7f87840c48b0 2024-09-19T09:54:26.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 >> v1:172.21.15.123:6789/0 conn(0x7f87840c48b0 legacy=0x7f878415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8770003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8770004800 0x7f8770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87840c9f30 con 0x7f87700039b0 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f87840ca1d0 con 0x7f8770004800 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f877000b9c0 con 0x7f878415ecf0 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8770003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f8781d9b640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8770004800 0x7f8770004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f8782d9d640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 -- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 msgr2=0x7f87700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 -- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8770004800 msgr2=0x7f8770004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:26.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8770004800 0x7f8770004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f878259c640 1 -- 172.21.15.123:0/194568596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8770003520 con 0x7f87700039b0 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.330+0000 7f8782d9d640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f878415ecf0 0x7f87700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.331+0000 7f878259c640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8770003dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8774009fc0 tx=0x7f8770005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bbef5a27d1fdda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.331+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774009c10 con 0x7f87700039b0 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.331+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8774036070 con 0x7f87700039b0 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.331+0000 7f878159a640 1 -- 172.21.15.123:0/194568596 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877402d070 con 0x7f87700039b0 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8788f66640 1 -- 172.21.15.123:0/194568596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 msgr2=0x7f8770003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8788f66640 1 --2- 172.21.15.123:0/194568596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8770003dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8774009fc0 tx=0x7f8770005830 comp rx=0 tx=0).stop 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8782d9d640 1 -- 172.21.15.123:0/194568596 reap_dead start 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8788f66640 1 -- 172.21.15.123:0/194568596 shutdown_connections 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8788f66640 1 -- 172.21.15.123:0/194568596 >> 172.21.15.123:0/194568596 conn(0x7f878406f530 msgr2=0x7f878406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8788f66640 1 -- 172.21.15.123:0/194568596 shutdown_connections 2024-09-19T09:54:26.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.332+0000 7f8788f66640 1 -- 172.21.15.123:0/194568596 wait complete. 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.333+0000 7f8788f66640 1 Processor -- start 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.333+0000 7f8788f66640 1 -- start start 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8788f66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8784150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8788f66640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8784150b60 0x7f87841f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8788f66640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8784158580 0x7f87841f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8788f66640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8784071270 con 0x7f87700039b0 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8788f66640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8784070f90 con 0x7f8784158580 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8788f66640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 -- 0x7f8784071550 con 0x7f8784150b60 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8784150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8784150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50350/0 (socket says 172.21.15.123:50350) 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 -- 172.21.15.123:0/340171309 learned_addr learned my addr 172.21.15.123:0/340171309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8781d9b640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8784150b60 0x7f87841f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f8782d9d640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8784158580 0x7f87841f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 -- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8784150b60 msgr2=0x7f87841f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8784150b60 0x7f87841f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 -- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8784158580 msgr2=0x7f87841f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8784158580 0x7f87841f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 -- 172.21.15.123:0/340171309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878415e160 con 0x7f87700039b0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.334+0000 7f878259c640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8784150620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f877400e230 tx=0x7f8774009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.335+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774009c10 con 0x7f87700039b0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.335+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8774003b90 con 0x7f87700039b0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.335+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878415d160 con 0x7f87700039b0 2024-09-19T09:54:26.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.335+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774004030 con 0x7f87700039b0 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.335+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f878415d720 con 0x7f87700039b0 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.336+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87840cdd70 con 0x7f87700039b0 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.336+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8774005d10 con 0x7f87700039b0 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.337+0000 7f877affd640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f876406c2b0 0x7f876406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.337+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5473+0+0 (secure 0 0 0) 0x7f87740ac7f0 con 0x7f87700039b0 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.337+0000 7f8781d9b640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f876406c2b0 0x7f876406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.337+0000 7f8781d9b640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f876406c2b0 0x7f876406e770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f87840b4c00 tx=0x7f876c007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:26.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.341+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f87840cdd70 con 0x7f87700039b0 2024-09-19T09:54:26.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:26.506+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f87840ce330 con 0x7f87700039b0 2024-09-19T09:54:27.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.222+0000 7f877affd640 1 -- 172.21.15.123:0/340171309 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f87840ce330 con 0x7f87700039b0 2024-09-19T09:54:27.224 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-19T09:54:27.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.226+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f876406c2b0 msgr2=0x7f876406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:27.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.226+0000 7f8788f66640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f876406c2b0 0x7f876406e770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f87840b4c00 tx=0x7f876c007970 comp rx=0 tx=0).stop 2024-09-19T09:54:27.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.226+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 msgr2=0x7f8784150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:27.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.226+0000 7f8788f66640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8784150620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f877400e230 tx=0x7f8774009750 comp rx=0 tx=0).stop 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 shutdown_connections 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8784158580 0x7f87841f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:6824/2665176031,v1:172.21.15.123:6825/2665176031] conn(0x7f876406c2b0 0x7f876406e770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8784150b60 0x7f87841f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 --2- 172.21.15.123:0/340171309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87700039b0 0x7f8784150620 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 >> 172.21.15.123:0/340171309 conn(0x7f878406f530 msgr2=0x7f87840c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 shutdown_connections 2024-09-19T09:54:27.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-19T09:54:27.229+0000 7f8788f66640 1 -- 172.21.15.123:0/340171309 wait complete. 2024-09-19T09:54:27.251 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T09:54:27.251 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:54:27.251 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.265 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:54:27.265 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:54:27.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.320 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:54:27.320 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-19T09:54:27.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.376 INFO:tasks.ceph.mds.e:Stopped 2024-09-19T09:54:27.376 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:54:27.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.390 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:54:27.391 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:54:27.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.445 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:54:27.445 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-19T09:54:27.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.504 INFO:tasks.ceph.mds.f:Stopped 2024-09-19T09:54:27.504 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T09:54:27.504 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T09:54:27.504 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.578 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T09:54:27.579 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T09:54:27.579 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.646 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T09:54:27.646 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T09:54:27.646 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.717 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T09:54:27.717 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T09:54:27.717 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.783 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T09:54:27.783 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T09:54:27.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.847 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T09:54:27.847 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T09:54:27.847 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.921 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T09:54:27.921 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T09:54:27.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:27.977 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T09:54:27.977 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T09:54:27.977 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:28.039 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T09:54:28.040 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T09:54:28.040 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T09:54:28.040 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:28.066 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T09:54:28.066 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T09:54:28.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:28.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-19T09:54:28.091 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T09:54:28.091 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T09:54:28.091 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T09:54:28.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:28.118 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T09:54:28.118 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:54:28.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:28.141 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:54:28.142 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T09:54:28.142 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:54:28.192 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T09:54:28.193 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T09:54:28.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:54:28.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:54:28.248 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T09:54:28.669 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:54:28.670 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T09:54:28.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:54:28.756 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T09:54:28.828 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:54:28.828 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T09:54:28.909 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:54:28.909 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T09:54:29.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:54:29.149 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T09:54:29.240 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:54:29.241 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T09:54:29.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:54:29.318 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T09:54:29.406 INFO:tasks.ceph:Archiving mon data... 2024-09-19T09:54:29.408 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/data/mon.a.tgz 2024-09-19T09:54:29.408 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-09-19T09:54:29.433 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.pJ7cWTmDAC 2024-09-19T09:54:29.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pJ7cWTmDAC 2024-09-19T09:54:29.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.pJ7cWTmDAC 2024-09-19T09:54:29.692 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.pJ7cWTmDAC is 451KB 2024-09-19T09:54:29.763 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.pJ7cWTmDAC 2024-09-19T09:54:29.778 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/data/mon.b.tgz 2024-09-19T09:54:29.778 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-19T09:54:29.794 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.SAQ4Gyuovl 2024-09-19T09:54:29.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SAQ4Gyuovl 2024-09-19T09:54:29.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.SAQ4Gyuovl 2024-09-19T09:54:30.033 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.SAQ4Gyuovl is 458KB 2024-09-19T09:54:30.130 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.SAQ4Gyuovl 2024-09-19T09:54:30.145 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/data/mon.c.tgz 2024-09-19T09:54:30.145 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-19T09:54:30.200 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.eHSxsz0lvK 2024-09-19T09:54:30.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eHSxsz0lvK 2024-09-19T09:54:30.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.eHSxsz0lvK 2024-09-19T09:54:30.424 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.eHSxsz0lvK is 458KB 2024-09-19T09:54:30.521 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.eHSxsz0lvK 2024-09-19T09:54:30.536 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T09:54:30.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T09:54:30.538 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T09:54:30.619 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T09:54:30.657 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T09:54:30.657 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T09:54:30.659 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/remote/smithi123/crash 2024-09-19T09:54:30.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T09:54:30.685 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/remote/smithi194/crash 2024-09-19T09:54:30.686 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T09:54:30.720 INFO:tasks.ceph:Shutting down logrotate 2024-09-19T09:54:30.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:54:30.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:54:30.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T09:54:30.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T09:54:30.868 INFO:tasks.ceph:Compressing logs... 2024-09-19T09:54:30.869 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:54:30.871 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:54:30.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T09:54:30.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43152.log 2024-09-19T09:54:30.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-09-19T09:54:30.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.43152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51102.log 2024-09-19T09:54:30.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.42773.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44071.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43152.log.gz 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51102.log.gz 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56255.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44064.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53131.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56255.log.gz 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55056.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53131.log.gz 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52348.log 2024-09-19T09:54:30.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52879.log 2024-09-19T09:54:30.910 INFO:teuthology.orchestra.run.smithi123.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55056.log.gz 2024-09-19T09:54:30.950 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37363.log 2024-09-19T09:54:30.950 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37243.log 2024-09-19T09:54:30.950 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37363.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T09:54:30.950 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37363.log.gz 2024-09-19T09:54:30.950 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37243.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose 89.0% -- -- replaced with /var/log/ceph/ceph-client.admin.37243.log.gz /var/log/ceph/ceph-mds.b.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37454.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37454.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37454.log.gz 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37283.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37203.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T09:54:30.951 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37323.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0%/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37410.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.b.log: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-19T09:54:30.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37410.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37410.log.gz 2024-09-19T09:54:30.958 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.f.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-19T09:54:30.958 INFO:teuthology.orchestra.run.smithi194.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52348.log.gz 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54702.log 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45989.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52879.log.gz 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46432.log 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52753.log 2024-09-19T09:54:30.995 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54702.log.gz 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45820.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51658.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45233.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52753.log.gz 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.45233.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51658.log.gz 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45233.log.gz 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54396.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43406.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42983.log 2024-09-19T09:54:30.996 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54396.log.gz 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50664.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42983.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30118.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46558.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.tmp-client.admin.30118.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50664.log.gz 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.44069.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.30118.log.gz 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56493.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44069.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42983.log.gzgzip 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46516.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-09-19T09:54:30.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46516.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56493.log.gz 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56577.log 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55140.log 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52432.log 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55140.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56577.log.gz 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40929.log 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55140.log.gz 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51910.log 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52432.log: /var/log/ceph/ceph-client.admin.40929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55449.log 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52432.log.gz 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45820.log.gz 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2024-09-19T09:54:30.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43732.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51910.log: /var/log/ceph/ceph-client.admin.55449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51868.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.51910.log.gz 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44416.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43732.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55449.log.gz 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55709.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44416.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.51868.log.gz -5 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42857.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55709.log.gz 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54618.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.46790.log 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2024-09-19T09:54:30.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42857.log: /var/log/ceph/ceph-client.admin.54618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56171.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54618.log.gz 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49993.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54786.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56171.log.gz 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43723.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51430.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43723.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49993.log.gz 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53089.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55793.log 2024-09-19T09:54:31.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53089.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51430.log.gz 2024-09-19T09:54:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46073.log 2024-09-19T09:54:31.001 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46432.log.gz 2024-09-19T09:54:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55793.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46516.log.gz 2024-09-19T09:54:31.001 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46558.log.gz 2024-09-19T09:54:31.001 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43236.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53089.log.gz 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55793.log.gz 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54167.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5/var/log/ceph/ceph-client.admin.43236.log: --verbose -- /var/log/ceph/ceph-client.admin.55499.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42857.log.gz 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53923.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50478.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.54167.log.gz 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55499.log.gz 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.53923.log.gz 2024-09-19T09:54:31.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50478.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46073.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53401.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46115.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43236.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45494.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45717.log: /var/log/ceph/ceph-client.admin.53401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52180.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53401.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54534.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56297.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54534.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52180.log.gz 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54007.log 2024-09-19T09:54:31.003 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45494.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56297.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54534.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56451.log 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53275.log 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56297.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56451.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54007.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51742.log 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56451.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47372.log 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51388.log 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53275.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47372.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51742.log.gz 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49933.log 2024-09-19T09:54:31.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56411.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55014.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51388.log.gz 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56411.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.49933.log.gz 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50180.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56411.log.gz 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51700.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43025.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55014.log.gz 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51700.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50180.log.gz 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51700.log.gz 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55541.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56535.log 2024-09-19T09:54:31.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52096.log 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52534.log 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56535.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55541.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56535.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52534.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52096.log.gz /var/log/ceph/ceph-client.admin.43954.log 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45452.log 89.6% 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43025.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43732.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43954.log: gzip 92.0% -- replaced with /var/log/ceph/ceph-client.admin.52534.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43723.log.gz 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2024-09-19T09:54:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45452.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44064.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51186.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44071.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51186.log: /var/log/ceph/ceph-client.admin.54828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53047.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51186.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43068.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50622.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43068.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53047.log.gz 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51472.log 2024-09-19T09:54:31.007 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45452.log.gz 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44626.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50622.log.gz 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51472.log.gz 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43722.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz -5 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54293.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42555.log: /var/log/ceph/ceph-client.admin.43722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56722.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51060.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56722.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54293.log.gz 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52474.log 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43068.log.gz 2024-09-19T09:54:31.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51060.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56722.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55877.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51060.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55098.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36599.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43722.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52474.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55877.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43110.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55317.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55098.log.gz 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52222.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54251.log 2024-09-19T09:54:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52222.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55317.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52054.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54251.log: -- /var/log/ceph/ceph-client.admin.49891.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52222.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56213.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.54251.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52054.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52963.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51307.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52963.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56213.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52963.log.gz 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52837.log 2024-09-19T09:54:31.010 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46790.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51307.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46031.log 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51307.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47372.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55751.log 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46031.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52837.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43110.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50435.log 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45636.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.53215.log -- replaced with /var/log/ceph/ceph-client.admin.55751.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50435.log.gz 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55243.log 2024-09-19T09:54:31.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.53215.log.gz 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53317.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55243.log.gz 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51018.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42647.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53317.log.gz 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51018.log.gz 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50222.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42647.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36599.log.gz 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46306.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44500.log 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2024-09-19T09:54:31.012 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50222.log.gz 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54576.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50538.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52618.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50538.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54576.log.gz 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46348.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50538.log.gz 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50790.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52618.log.gz 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47170.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-09-19T09:54:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52138.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55583.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55583.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.52138.log.gz --verbose 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr: -- /var/log/ceph/ceph-client.admin.43416.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.55583.log.gz 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56087.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56087.log: /var/log/ceph/ceph-client.admin.53443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51784.log 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2024-09-19T09:54:31.014 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40929.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51514.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53881.log 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44290.log 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51784.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz/var/log/ceph/ceph-client.admin.53881.log: 91.9% 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44792.log 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51784.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46031.log.gz 87.8% 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46348.log.gz 87.9% 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46601.log 2024-09-19T09:54:31.015 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47170.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44792.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42647.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56764.log 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46601.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5/var/log/ceph/ceph-client.admin.42731.log: --verbose -- /var/log/ceph/ceph-client.admin.53797.log 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56764.log.gz 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44072.log 2024-09-19T09:54:31.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53797.log.gz 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50748.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52390.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45862.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50748.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44792.log.gz 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51952.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50748.log.gz 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45862.log: gzip -5 --verbose 89.7% -- -- replaced with /var/log/ceph/ceph-client.admin.52390.log.gz 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.56045.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55201.log 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51952.log.gz 2024-09-19T09:54:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55667.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56045.log: /var/log/ceph/ceph-client.admin.55201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43408.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56045.log.gz 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55667.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55201.log.gz 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55667.log.gz 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55919.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44074.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55919.log.gz 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54086.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44074.log: /var/log/ceph/ceph-client.admin.42511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46264.log 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54086.log.gz 2024-09-19T09:54:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54335.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46264.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54335.log: -- /var/log/ceph/ceph-client.admin.43414.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46474.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54335.log.gz 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.43414.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55961.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44458.log: /var/log/ceph/ceph-client.admin.55961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52795.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55961.log.gz 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52795.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose 88.0% -- /var/log/ceph/ceph-client.admin.54474.log 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz 2024-09-19T09:54:31.019 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51556.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52795.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50138.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44072.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47273.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54474.log: /var/log/ceph/ceph-client.admin.50138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51144.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54474.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50138.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56661.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54744.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.51144.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54744.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56661.log.gz 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2024-09-19T09:54:31.020 INFO:teuthology.orchestra.run.smithi123.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54744.log.gz 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53005.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43417.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gz 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44542.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44542.log: /var/log/ceph/ceph-client.admin.43731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42689.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50934.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46180.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42689.log: /var/log/ceph/ceph-client.admin.50934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-09-19T09:54:31.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44750.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50934.log.gz 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49849.log: /var/log/ceph/ceph-client.admin.44750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52576.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55835.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50096.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53173.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55835.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.52576.log.gz 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53671.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55835.log.gz 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53173.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50096.log.gz 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53671.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53173.log.gz 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50289.log 2024-09-19T09:54:31.022 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44894.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50289.log.gz 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56129.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56129.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56129.log.gz 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52682.log/var/log/ceph/ceph-client.admin.43729.log: 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52682.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56619.log 2024-09-19T09:54:31.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.52682.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52921.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56619.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42159.log 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45862.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52264.log 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54972.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43408.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2024-09-19T09:54:31.024 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36225.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42159.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54930.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52264.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45578.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42467.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54930.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-19T09:54:31.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43411.log: /var/log/ceph/ceph-client.admin.42467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51826.log 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50850.log 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.e.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44290.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52306.log 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51826.log: /var/log/ceph/ceph-client.admin.50850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50976.log 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51826.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43414.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.52306.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46474.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50850.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54660.log 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52306.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 90.0%/var/log/ceph/ceph-client.admin.50976.log: -- replaced with /var/log/ceph/ceph-client.admin.47273.log.gz 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53755.log 2024-09-19T09:54:31.026 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53629.log 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44416.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50976.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53755.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54660.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44542.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44500.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53755.log.gz 2024-09-19T09:54:31.027 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53629.log: /var/log/ceph/ceph-osd.3.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42689.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44750.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55625.log 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53629.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44894.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44584.log: /var/log/ceph/ceph-client.admin.55625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50580.log 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55625.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50580.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45760.log 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50580.log.gz 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43194.log 2024-09-19T09:54:31.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45760.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42159.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42467.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43415.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43194.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53713.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53965.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46601.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56351.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.53965.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53713.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56003.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54209.log 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53965.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56351.log.gz 2024-09-19T09:54:31.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56003.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45578.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46390.log 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56003.log.gz/var/log/ceph/ceph-client.admin.54209.log: 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54209.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46390.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.46264.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36225.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43194.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.45760.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43417.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43415.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46390.log.gz 2024-09-19T09:54:31.030 INFO:teuthology.orchestra.run.smithi123.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-19T09:54:31.040 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gz 2024-09-19T09:54:31.041 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46180.log.gz 2024-09-19T09:54:31.041 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2024-09-19T09:54:31.111 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2024-09-19T09:54:31.120 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T09:54:31.141 INFO:teuthology.orchestra.run.smithi194.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T09:54:31.153 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-19T09:54:31.380 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T09:54:33.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-19T09:54:33.102 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T09:54:50.171 INFO:teuthology.orchestra.run.smithi194.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T09:54:50.928 INFO:teuthology.orchestra.run.smithi194.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T09:54:52.908 INFO:teuthology.orchestra.run.smithi123.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T09:54:54.683 INFO:teuthology.orchestra.run.smithi123.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T09:55:00.056 INFO:teuthology.orchestra.run.smithi194.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T09:55:01.925 INFO:teuthology.orchestra.run.smithi194.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T09:55:01.927 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-19T09:55:01.927 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m31.003s 2024-09-19T09:55:01.927 INFO:teuthology.orchestra.run.smithi194.stderr:user 1m36.208s 2024-09-19T09:55:01.927 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m3.367s 2024-09-19T09:55:02.649 INFO:teuthology.orchestra.run.smithi123.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T09:55:03.243 INFO:teuthology.orchestra.run.smithi123.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-19T09:55:09.776 INFO:teuthology.orchestra.run.smithi123.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T09:55:09.778 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-19T09:55:09.778 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m38.894s 2024-09-19T09:55:09.778 INFO:teuthology.orchestra.run.smithi123.stderr:user 2m17.093s 2024-09-19T09:55:09.778 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m4.875s 2024-09-19T09:55:09.778 INFO:tasks.ceph:Archiving logs... 2024-09-19T09:55:09.779 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/remote/smithi123/log 2024-09-19T09:55:09.780 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:55:27.829 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/remote/smithi194/log 2024-09-19T09:55:27.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:55:43.497 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:55:43.507 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:55:43.507 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:55:43.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:55:43.587 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:55:43.601 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:55:43.602 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:55:43.605 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:55:43.619 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:55:43.620 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:55:43.626 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:55:43.626 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-19T09:55:43.626 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +439us[ +436us] +/- 42ms 2024-09-19T09:55:43.626 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -1787us[-1787us] +/- 76ms 2024-09-19T09:55:43.626 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +782us[ +779us] +/- 66ms 2024-09-19T09:55:43.627 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:55:43.660 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:55:43.661 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-19T09:55:43.661 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +441us[ +435us] +/- 42ms 2024-09-19T09:55:43.661 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -1800us[-1807us] +/- 76ms 2024-09-19T09:55:43.661 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +768us[ +768us] +/- 66ms 2024-09-19T09:55:43.661 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:55:43.661 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:55:43.671 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:55:43.671 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:55:43.680 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:55:43.820 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:55:43.881 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:55:43.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:55:43.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:55:43.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:55:43.939 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:55:43.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:55:43.984 INFO:teuthology.task.internal:Duration was 1203.195064 seconds 2024-09-19T09:55:43.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:55:43.996 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:55:43.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:55:44.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:55:44.038 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:55:44.063 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:55:44.548 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:55:44.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-09-19T09:55:44.549 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:55:44.570 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T09:55:44.570 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:55:44.604 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:55:44.604 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:55:44.614 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:55:44.670 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:55:44.670 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:55:44.686 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:55:44.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:55:44.851 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:55:44.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:55:44.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:55:44.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:55:44.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:55:44.933 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:55:44.965 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-09-19T09:55:44.979 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-19T09:55:45.005 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:55:45.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:55:45.031 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:55:45.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:55:45.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:55:45.071 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:55:45.072 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/remote/smithi123 2024-09-19T09:55:45.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:55:45.106 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911929/remote/smithi194 2024-09-19T09:55:45.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:55:45.146 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:55:45.147 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:55:45.150 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:55:45.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:55:45.207 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:55:45.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:55:45.220 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:55:45.221 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:55:45.226 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:55:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:55 /home/ubuntu/cephtest 2024-09-19T09:55:45.251 INFO:teuthology.orchestra.run.smithi194.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:55 /home/ubuntu/cephtest 2024-09-19T09:55:45.252 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:55:45.262 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:55:45.286 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} duration: 1203.1950643062592 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:55:45.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:55:45.373 INFO:teuthology.run:pass